[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:02:28 dist-test-slave-jq4t krb5kdc[29302](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:02:28 dist-test-slave-jq4t krb5kdc[29302](info): set up 2 sockets
Aug 09 13:02:28 dist-test-slave-jq4t krb5kdc[29302](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260809 13:02:30.176352 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.467s user 0.006s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:02:30 dist-test-slave-jq4t krb5kdc[29302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280550, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:02:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:02:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
I20260809 13:02:30.399374 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:45415
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:35861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:45415
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:02:30.805614 29319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:02:30.806032 29319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:02:30.806248 29319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:02:30.814272 29319 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:02:30.814457 29319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:02:30.814581 29319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:02:30.814685 29319 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:02:30.814778 29319 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:02:30.827468 29319 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:35861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:45415
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:45415
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:02:30.829458 29319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:02:30.831176 29319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:02:30.845774 29328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:30.845866 29331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:30.845834 29326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:02:30.846258 29319 server_base.cc:1034] running on GCE node
I20260809 13:02:30.847445 29319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:02:30.849412 29319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:02:30.850662 29319 hybrid_clock.cc:648] HybridClock initialized: now 1786280550850610 us; error 66 us; skew 500 ppm
I20260809 13:02:30.851055 29319 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:02:30 dist-test-slave-jq4t krb5kdc[29302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280550, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:02:30.854704 29319 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:02:30.856554 29319 webserver.cc:460] Webserver started at http://127.28.155.254:34381/ using document root <none> and password file <none>
I20260809 13:02:30.857484 29319 fs_manager.cc:359] Metadata directory not provided
I20260809 13:02:30.857645 29319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:02:30.857982 29319 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:02:30.861685 29319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "e0004e7a49c94330b9937cb54ea76f1e"
format_stamp: "Formatted at 2026-08-09 13:02:30 on dist-test-slave-jq4t"
server_key: "b8d7eb1d7c7513b021ad31b467854dc8"
server_key_iv: "b22e3f235fc73c0c06f53b53871914fc"
server_key_version: "encryptionkey@0"
I20260809 13:02:30.862502 29319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "e0004e7a49c94330b9937cb54ea76f1e"
format_stamp: "Formatted at 2026-08-09 13:02:30 on dist-test-slave-jq4t"
server_key: "b8d7eb1d7c7513b021ad31b467854dc8"
server_key_iv: "b22e3f235fc73c0c06f53b53871914fc"
server_key_version: "encryptionkey@0"
I20260809 13:02:30.868731 29319 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260809 13:02:30.872779 29343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:30.874348 29319 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:02:30.874557 29319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "e0004e7a49c94330b9937cb54ea76f1e"
format_stamp: "Formatted at 2026-08-09 13:02:30 on dist-test-slave-jq4t"
server_key: "b8d7eb1d7c7513b021ad31b467854dc8"
server_key_iv: "b22e3f235fc73c0c06f53b53871914fc"
server_key_version: "encryptionkey@0"
I20260809 13:02:30.874785 29319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:02:30.904838 29319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:02:30.909648 29319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:02:30.909993 29319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:02:30.930759 29319 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:45415
I20260809 13:02:30.930786 29421 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:45415 every 8 connection(s)
I20260809 13:02:30.932751 29319 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:02:30.935786 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 29319
I20260809 13:02:30.936187 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:02:30.937917 29424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:30.938324 29295 external_mini_cluster.cc:1428] Setting key 92fdc137565f399a0b871b9e4daf67e2
I20260809 13:02:30.950883 29424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0004e7a49c94330b9937cb54ea76f1e: Bootstrap starting.
I20260809 13:02:30.954502 29424 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e0004e7a49c94330b9937cb54ea76f1e: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:30.955662 29424 log.cc:824] T 00000000000000000000000000000000 P e0004e7a49c94330b9937cb54ea76f1e: Log is configured to *not* fsync() on all Append() calls
I20260809 13:02:30.959682 29424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0004e7a49c94330b9937cb54ea76f1e: No bootstrap required, opened a new log
Aug 09 13:02:30 dist-test-slave-jq4t krb5kdc[29302](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280550, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:02:30.967856 29424 raft_consensus.cc:348] T 00000000000000000000000000000000 P e0004e7a49c94330b9937cb54ea76f1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0004e7a49c94330b9937cb54ea76f1e" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 45415 } }
I20260809 13:02:30.968387 29424 raft_consensus.cc:374] T 00000000000000000000000000000000 P e0004e7a49c94330b9937cb54ea76f1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:30.968520 29424 raft_consensus.cc:729] T 00000000000000000000000000000000 P e0004e7a49c94330b9937cb54ea76f1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0004e7a49c94330b9937cb54ea76f1e, State: Initialized, Role: FOLLOWER
I20260809 13:02:30.969185 29424 consensus_queue.cc:260] T 00000000000000000000000000000000 P e0004e7a49c94330b9937cb54ea76f1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0004e7a49c94330b9937cb54ea76f1e" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 45415 } }
I20260809 13:02:30.969456 29424 raft_consensus.cc:388] T 00000000000000000000000000000000 P e0004e7a49c94330b9937cb54ea76f1e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:02:30.969617 29424 raft_consensus.cc:482] T 00000000000000000000000000000000 P e0004e7a49c94330b9937cb54ea76f1e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:02:30.969820 29424 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e0004e7a49c94330b9937cb54ea76f1e [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:30.972779 29424 raft_consensus.cc:504] T 00000000000000000000000000000000 P e0004e7a49c94330b9937cb54ea76f1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0004e7a49c94330b9937cb54ea76f1e" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 45415 } }
I20260809 13:02:30.974315 29424 leader_election.cc:302] T 00000000000000000000000000000000 P e0004e7a49c94330b9937cb54ea76f1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e0004e7a49c94330b9937cb54ea76f1e; no voters:
I20260809 13:02:30.975104 29424 leader_election.cc:288] T 00000000000000000000000000000000 P e0004e7a49c94330b9937cb54ea76f1e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:02:30.975222 29434 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e0004e7a49c94330b9937cb54ea76f1e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:02:30.975991 29434 raft_consensus.cc:686] T 00000000000000000000000000000000 P e0004e7a49c94330b9937cb54ea76f1e [term 1 LEADER]: Becoming Leader. State: Replica: e0004e7a49c94330b9937cb54ea76f1e, State: Running, Role: LEADER
I20260809 13:02:30.976644 29434 consensus_queue.cc:237] T 00000000000000000000000000000000 P e0004e7a49c94330b9937cb54ea76f1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0004e7a49c94330b9937cb54ea76f1e" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 45415 } }
I20260809 13:02:30.980883 29436 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0004e7a49c94330b9937cb54ea76f1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e0004e7a49c94330b9937cb54ea76f1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0004e7a49c94330b9937cb54ea76f1e" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 45415 } } }
I20260809 13:02:30.981432 29436 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0004e7a49c94330b9937cb54ea76f1e [sys.catalog]: This master's current role is: LEADER
I20260809 13:02:30.980752 29434 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0004e7a49c94330b9937cb54ea76f1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader e0004e7a49c94330b9937cb54ea76f1e. Latest consensus state: current_term: 1 leader_uuid: "e0004e7a49c94330b9937cb54ea76f1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0004e7a49c94330b9937cb54ea76f1e" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 45415 } } }
I20260809 13:02:30.982353 29431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:30.942687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40178 (local address 127.28.155.254:45415)
0809 13:02:30.943664 (+ 977us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:30.943684 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:30.944878 (+ 1194us) server_negotiation.cc:407] Connection header received
0809 13:02:30.953964 (+ 9086us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:30.953986 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:30.954339 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:30.954746 (+ 407us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:30.958881 (+ 4135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:30.960674 (+ 1793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:30.962377 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:30.963123 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:30.963354 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:30.969839 (+ 6485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:30.969852 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:30.969866 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:30.969943 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:30.973436 (+ 3493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:30.974282 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:30.974289 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:30.974294 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:30.974476 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:30.975147 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:30.975152 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:30.975156 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:30.976180 (+ 1024us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:30.979422 (+ 3242us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:30.979944 (+ 522us) server_negotiation.cc:299] Negotiation successful
0809 13:02:30.980393 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":691,"thread_start_us":407,"threads_started":1}
I20260809 13:02:30.982529 29434 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0004e7a49c94330b9937cb54ea76f1e [sys.catalog]: This master's current role is: LEADER
I20260809 13:02:30.986171 29424 sys_catalog.cc:564] T 00000000000000000000000000000000 P e0004e7a49c94330b9937cb54ea76f1e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:02:30.986387 29438 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:02:30.995481 29438 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:02:31.006165 29438 catalog_manager.cc:1347] Generated new cluster ID: 3cae286f65df4275b1103f04ebe5296f
I20260809 13:02:31.006299 29438 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:02:31.026278 29438 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:02:31.028064 29438 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:02:31.054129 29438 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e0004e7a49c94330b9937cb54ea76f1e: Generated new TSK 0
I20260809 13:02:31.055130 29438 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
I20260809 13:02:31.116430 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:0
--local_ip_for_outbound_sockets=127.28.155.193
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:45415
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:35861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:02:31.511838 29458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:02:31.512204 29458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:02:31.512385 29458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:02:31.520303 29458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:02:31.520478 29458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:02:31.520699 29458 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:02:31.531512 29458 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:35861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:45415
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:02:31.533088 29458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:02:31.534538 29458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:02:31.549053 29467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:31.549120 29465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:31.549041 29463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:02:31.550261 29458 server_base.cc:1034] running on GCE node
I20260809 13:02:31.550926 29458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:02:31.551961 29458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:02:31.553198 29458 hybrid_clock.cc:648] HybridClock initialized: now 1786280551553158 us; error 79 us; skew 500 ppm
I20260809 13:02:31.553608 29458 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:02:31 dist-test-slave-jq4t krb5kdc[29302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280551, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:02:31.557054 29458 init.cc:377] Logged in from keytab as kudu/127.28.155.193@KRBTEST.COM (short username kudu)
I20260809 13:02:31.558641 29458 webserver.cc:460] Webserver started at http://127.28.155.193:33163/ using document root <none> and password file <none>
I20260809 13:02:31.559329 29458 fs_manager.cc:359] Metadata directory not provided
I20260809 13:02:31.559438 29458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:02:31.559726 29458 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:02:31.562922 29458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-0/data/instance:
uuid: "103ba19c5bc5407182c4d5884e206818"
format_stamp: "Formatted at 2026-08-09 13:02:31 on dist-test-slave-jq4t"
server_key: "58a27c60a22e363a9ac83c691d703826"
server_key_iv: "dcaf14b49f50abb7cad00e901714a848"
server_key_version: "encryptionkey@0"
I20260809 13:02:31.563685 29458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance:
uuid: "103ba19c5bc5407182c4d5884e206818"
format_stamp: "Formatted at 2026-08-09 13:02:31 on dist-test-slave-jq4t"
server_key: "58a27c60a22e363a9ac83c691d703826"
server_key_iv: "dcaf14b49f50abb7cad00e901714a848"
server_key_version: "encryptionkey@0"
I20260809 13:02:31.569144 29458 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 13:02:31.572850 29480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:31.574259 29458 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:02:31.574448 29458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "103ba19c5bc5407182c4d5884e206818"
format_stamp: "Formatted at 2026-08-09 13:02:31 on dist-test-slave-jq4t"
server_key: "58a27c60a22e363a9ac83c691d703826"
server_key_iv: "dcaf14b49f50abb7cad00e901714a848"
server_key_version: "encryptionkey@0"
I20260809 13:02:31.574672 29458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:02:31.601706 29458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:02:31.606377 29458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:02:31.606712 29458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:02:31.607829 29458 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:02:31.609405 29458 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:02:31.609484 29458 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:31.609653 29458 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:02:31.609719 29458 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:31.647011 29458 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:33641
I20260809 13:02:31.647116 29664 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:33641 every 8 connection(s)
I20260809 13:02:31.648415 29458 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:02:31.652109 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 29458
I20260809 13:02:31.652345 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance
I20260809 13:02:31.653033 29295 external_mini_cluster.cc:1428] Setting key 7288564a88041c10b0e21643375a120c
Aug 09 13:02:31 dist-test-slave-jq4t krb5kdc[29302](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280551, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:02:31.670905 29667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:31.651399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:37679 (local address 127.28.155.254:45415)
0809 13:02:31.651958 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:31.651965 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:31.653156 (+ 1191us) server_negotiation.cc:407] Connection header received
0809 13:02:31.655373 (+ 2217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:31.655378 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:31.655461 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:31.655590 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:31.657236 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:31.658441 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:31.660048 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:31.660780 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:31.660930 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:31.664986 (+ 4056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:31.664991 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:31.664994 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:31.665027 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:31.667705 (+ 2678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:31.668438 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:31.668448 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:31.668451 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:31.668632 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:31.669080 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:31.669085 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:31.669088 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:31.669369 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:31.669538 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:31.670250 (+ 712us) server_negotiation.cc:299] Negotiation successful
0809 13:02:31.670490 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416,"thread_start_us":289,"threads_started":1}
I20260809 13:02:31.671896 29669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:31.652035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:45415 (local address 127.28.155.193:37679)
0809 13:02:31.652976 (+ 941us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:31.653033 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:31.655112 (+ 2079us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:31.655787 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:31.655795 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:31.656356 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:02:31.657016 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:31.657034 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:31.658594 (+ 1560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:31.658598 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:31.659860 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:31.659873 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:31.661015 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:31.661021 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:31.661222 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:31.661971 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:02:31.661994 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:02:31.664749 (+ 2755us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:02:31.667850 (+ 3101us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:31.667859 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:31.667875 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:31.668305 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:31.668747 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:31.668753 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:31.668756 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:31.668956 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:31.669517 (+ 561us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:02:31.669525 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:02:31.669864 (+ 339us) client_negotiation.cc:769] Sending connection context
0809 13:02:31.670130 (+ 266us) client_negotiation.cc:240] Negotiation successful
0809 13:02:31.670676 (+ 546us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":644,"thread_start_us":422,"threads_started":1}
I20260809 13:02:31.673677 29665 heartbeater.cc:347] Connected to a master server at 127.28.155.254:45415
WARNING: no policy specified for kudu/127.28.155.194@KRBTEST.COM; defaulting to no policy
I20260809 13:02:31.674062 29665 heartbeater.cc:464] Registering TS with master...
I20260809 13:02:31.674983 29665 heartbeater.cc:511] Master 127.28.155.254:45415 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.194@KRBTEST.COM" created.
I20260809 13:02:31.677717 29363 ts_manager.cc:194] Registered new tserver with Master: 103ba19c5bc5407182c4d5884e206818 (127.28.155.193:33641)
I20260809 13:02:31.679701 29363 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.193@KRBTEST.COM'} at 127.28.155.193:37679
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
I20260809 13:02:31.702127 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:0
--local_ip_for_outbound_sockets=127.28.155.194
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:45415
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:35861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:02:32.054622 29674 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:02:32.054904 29674 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:02:32.055018 29674 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:02:32.062574 29674 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:02:32.062714 29674 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:02:32.062913 29674 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:02:32.073740 29674 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:35861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:45415
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:02:32.075197 29674 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:02:32.076792 29674 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:02:32.091670 29684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:32.091627 29687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:32.091632 29685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:02:32.092528 29674 server_base.cc:1034] running on GCE node
I20260809 13:02:32.093175 29674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:02:32.094137 29674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:02:32.095357 29674 hybrid_clock.cc:648] HybridClock initialized: now 1786280552095306 us; error 47 us; skew 500 ppm
I20260809 13:02:32.095732 29674 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:02:32 dist-test-slave-jq4t krb5kdc[29302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280552, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:02:32.099112 29674 init.cc:377] Logged in from keytab as kudu/127.28.155.194@KRBTEST.COM (short username kudu)
I20260809 13:02:32.100744 29674 webserver.cc:460] Webserver started at http://127.28.155.194:40291/ using document root <none> and password file <none>
I20260809 13:02:32.101485 29674 fs_manager.cc:359] Metadata directory not provided
I20260809 13:02:32.101647 29674 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:02:32.102005 29674 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:02:32.105574 29674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-1/data/instance:
uuid: "e3ba92a6cfb6449a8f463540f51cf1ab"
format_stamp: "Formatted at 2026-08-09 13:02:32 on dist-test-slave-jq4t"
server_key: "af3b36e0770530656ec4ecd55f432a8c"
server_key_iv: "dbf05905ced2113756f1763476e76f58"
server_key_version: "encryptionkey@0"
I20260809 13:02:32.106444 29674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance:
uuid: "e3ba92a6cfb6449a8f463540f51cf1ab"
format_stamp: "Formatted at 2026-08-09 13:02:32 on dist-test-slave-jq4t"
server_key: "af3b36e0770530656ec4ecd55f432a8c"
server_key_iv: "dbf05905ced2113756f1763476e76f58"
server_key_version: "encryptionkey@0"
I20260809 13:02:32.112167 29674 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260809 13:02:32.116029 29699 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:32.117534 29674 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:02:32.117733 29674 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "e3ba92a6cfb6449a8f463540f51cf1ab"
format_stamp: "Formatted at 2026-08-09 13:02:32 on dist-test-slave-jq4t"
server_key: "af3b36e0770530656ec4ecd55f432a8c"
server_key_iv: "dbf05905ced2113756f1763476e76f58"
server_key_version: "encryptionkey@0"
I20260809 13:02:32.117972 29674 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:02:32.134013 29674 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:02:32.138602 29674 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:02:32.138944 29674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:02:32.140019 29674 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:02:32.141573 29674 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:02:32.141686 29674 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:32.141861 29674 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:02:32.141944 29674 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:32.180977 29674 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:35585
I20260809 13:02:32.181018 29868 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:35585 every 8 connection(s)
I20260809 13:02:32.182435 29674 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:02:32.184067 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 29674
I20260809 13:02:32.184360 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance
I20260809 13:02:32.184890 29295 external_mini_cluster.cc:1428] Setting key 85111cca5d2f1a4f44eec6ff756900a6
Aug 09 13:02:32 dist-test-slave-jq4t krb5kdc[29302](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280552, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:02:32.205302 29872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:32.185557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:42951 (local address 127.28.155.254:45415)
0809 13:02:32.186158 (+ 601us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:32.186167 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:32.187432 (+ 1265us) server_negotiation.cc:407] Connection header received
0809 13:02:32.189544 (+ 2112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:32.189550 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:32.189639 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:32.189751 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:32.191417 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:32.192212 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:32.193963 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:32.194464 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:32.194608 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:32.198604 (+ 3996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:32.198609 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:32.198612 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:32.198648 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:32.201571 (+ 2923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:32.202619 (+ 1048us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:32.202623 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:32.202625 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:32.202768 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:32.203352 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:32.203355 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:32.203357 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:32.203654 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:32.203796 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:32.204803 (+ 1007us) server_negotiation.cc:299] Negotiation successful
0809 13:02:32.205009 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":274,"threads_started":1}
I20260809 13:02:32.206964 29874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:32.186235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:45415 (local address 127.28.155.194:42951)
0809 13:02:32.187267 (+ 1032us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:32.187327 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:32.189231 (+ 1904us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:32.190037 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:32.190046 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:32.190603 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:02:32.191230 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:32.191249 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:32.192394 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:32.192399 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:32.193802 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:32.193816 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:32.194728 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:32.194736 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:32.194981 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:32.195748 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:02:32.195771 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:02:32.198316 (+ 2545us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:02:32.201740 (+ 3424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:32.201753 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:32.201774 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:32.202487 (+ 713us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:32.202885 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:32.202893 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:32.202900 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:32.203224 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:32.203817 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:02:32.203828 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:02:32.204355 (+ 527us) client_negotiation.cc:769] Sending connection context
0809 13:02:32.204699 (+ 344us) client_negotiation.cc:240] Negotiation successful
0809 13:02:32.205390 (+ 691us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":381,"threads_started":1}
I20260809 13:02:32.208784 29870 heartbeater.cc:347] Connected to a master server at 127.28.155.254:45415
I20260809 13:02:32.209138 29870 heartbeater.cc:464] Registering TS with master...
I20260809 13:02:32.209945 29870 heartbeater.cc:511] Master 127.28.155.254:45415 requested a full tablet report, sending...
I20260809 13:02:32.211586 29363 ts_manager.cc:194] Registered new tserver with Master: e3ba92a6cfb6449a8f463540f51cf1ab (127.28.155.194:35585)
WARNING: no policy specified for kudu/127.28.155.195@KRBTEST.COM; defaulting to no policy
I20260809 13:02:32.212556 29363 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.194@KRBTEST.COM'} at 127.28.155.194:42951
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
I20260809 13:02:32.239311 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:0
--local_ip_for_outbound_sockets=127.28.155.195
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:45415
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:35861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:02:32.597407 29879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:02:32.597805 29879 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:02:32.597991 29879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:02:32.606068 29879 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:02:32.606247 29879 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:02:32.606446 29879 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:02:32.616894 29879 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:35861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:45415
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:02:32.618372 29879 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:02:32.619833 29879 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:02:32.634115 29887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:32.634163 29892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:32.634104 29889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:02:32.635056 29879 server_base.cc:1034] running on GCE node
I20260809 13:02:32.635704 29879 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:02:32.636688 29879 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:02:32.637928 29879 hybrid_clock.cc:648] HybridClock initialized: now 1786280552637878 us; error 58 us; skew 500 ppm
I20260809 13:02:32.638265 29879 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:02:32 dist-test-slave-jq4t krb5kdc[29302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280552, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:02:32.641716 29879 init.cc:377] Logged in from keytab as kudu/127.28.155.195@KRBTEST.COM (short username kudu)
I20260809 13:02:32.643304 29879 webserver.cc:460] Webserver started at http://127.28.155.195:46199/ using document root <none> and password file <none>
I20260809 13:02:32.644025 29879 fs_manager.cc:359] Metadata directory not provided
I20260809 13:02:32.644177 29879 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:02:32.644564 29879 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:02:32.647694 29879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-2/data/instance:
uuid: "741082415b9a4e4d8afcb51f60cfcc67"
format_stamp: "Formatted at 2026-08-09 13:02:32 on dist-test-slave-jq4t"
server_key: "78d2367f8da21ba014fc5b83bfe20b2a"
server_key_iv: "5b15246b47974bab9ed127be3c54b3cc"
server_key_version: "encryptionkey@0"
I20260809 13:02:32.648568 29879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance:
uuid: "741082415b9a4e4d8afcb51f60cfcc67"
format_stamp: "Formatted at 2026-08-09 13:02:32 on dist-test-slave-jq4t"
server_key: "78d2367f8da21ba014fc5b83bfe20b2a"
server_key_iv: "5b15246b47974bab9ed127be3c54b3cc"
server_key_version: "encryptionkey@0"
I20260809 13:02:32.653909 29879 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 13:02:32.657475 29906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:32.658809 29879 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 13:02:32.659003 29879 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "741082415b9a4e4d8afcb51f60cfcc67"
format_stamp: "Formatted at 2026-08-09 13:02:32 on dist-test-slave-jq4t"
server_key: "78d2367f8da21ba014fc5b83bfe20b2a"
server_key_iv: "5b15246b47974bab9ed127be3c54b3cc"
server_key_version: "encryptionkey@0"
I20260809 13:02:32.659224 29879 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:02:32.677351 29879 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:02:32.682107 29879 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:02:32.682468 29879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:02:32.682844 29665 heartbeater.cc:503] Master 127.28.155.254:45415 was elected leader, sending a full tablet report...
I20260809 13:02:32.683856 29879 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:02:32.685735 29879 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:02:32.685812 29879 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:32.685907 29879 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:02:32.685952 29879 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:32.721266 29879 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:34091
I20260809 13:02:32.721457 30092 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:34091 every 8 connection(s)
I20260809 13:02:32.722745 29879 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:02:32.731334 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 29879
I20260809 13:02:32.731566 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance
I20260809 13:02:32.732087 29295 external_mini_cluster.cc:1428] Setting key 52f81c55a788318a3ed671a995c82100
Aug 09 13:02:32 dist-test-slave-jq4t krb5kdc[29302](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280552, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:02:32.744138 30096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:32.725662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:43769 (local address 127.28.155.254:45415)
0809 13:02:32.726139 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:32.726144 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:32.727152 (+ 1008us) server_negotiation.cc:407] Connection header received
0809 13:02:32.729122 (+ 1970us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:32.729128 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:32.729227 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:32.729354 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:32.730976 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:32.731919 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:32.733802 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:32.734268 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:32.734380 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:32.738389 (+ 4009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:32.738394 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:32.738397 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:32.738432 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:32.741089 (+ 2657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:32.741864 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:32.741869 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:32.741871 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:32.741999 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:32.742459 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:32.742463 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:32.742465 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:32.742758 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:32.742883 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:32.743639 (+ 756us) server_negotiation.cc:299] Negotiation successful
0809 13:02:32.743829 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":234,"threads_started":1}
I20260809 13:02:32.745203 30097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:32.726236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:45415 (local address 127.28.155.195:43769)
0809 13:02:32.726977 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:32.727016 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:32.728832 (+ 1816us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:32.729627 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:32.729635 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:32.730179 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:02:32.730767 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:32.730784 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:32.732086 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:32.732090 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:32.733610 (+ 1520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:32.733625 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:32.734551 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:32.734562 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:32.734820 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:32.735549 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:02:32.735589 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:02:32.738178 (+ 2589us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:02:32.741247 (+ 3069us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:32.741254 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:32.741268 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:32.741740 (+ 472us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:32.742136 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:32.742140 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:32.742143 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:32.742347 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:32.742885 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:02:32.742892 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:02:32.743265 (+ 373us) client_negotiation.cc:769] Sending connection context
0809 13:02:32.743531 (+ 266us) client_negotiation.cc:240] Negotiation successful
0809 13:02:32.743966 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":288,"threads_started":1}
I20260809 13:02:32.746850 30094 heartbeater.cc:347] Connected to a master server at 127.28.155.254:45415
I20260809 13:02:32.747259 30094 heartbeater.cc:464] Registering TS with master...
I20260809 13:02:32.748225 30094 heartbeater.cc:511] Master 127.28.155.254:45415 requested a full tablet report, sending...
I20260809 13:02:32.749876 29363 ts_manager.cc:194] Registered new tserver with Master: 741082415b9a4e4d8afcb51f60cfcc67 (127.28.155.195:34091)
I20260809 13:02:32.750710 29363 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.195@KRBTEST.COM'} at 127.28.155.195:43769
I20260809 13:02:32.762356 29295 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 13:02:32 dist-test-slave-jq4t krb5kdc[29302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280552, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 13:02:32 dist-test-slave-jq4t krb5kdc[29302](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280552, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.28.155.193@KRBTEST.COM
I20260809 13:02:32.815397 30103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:32.798688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50854 (local address 127.28.155.193:33641)
0809 13:02:32.800234 (+ 1546us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:32.800242 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:32.800270 (+ 28us) server_negotiation.cc:407] Connection header received
0809 13:02:32.800336 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:32.800343 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:32.800676 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:32.800819 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:32.802305 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:32.803378 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:32.804736 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:32.805395 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:32.805504 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:32.809657 (+ 4153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:32.809670 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:32.809685 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:32.809727 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:32.812894 (+ 3167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:32.813524 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:32.813531 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:32.813533 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:32.813666 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:32.814004 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:32.814007 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:32.814009 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:32.814364 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:32.814608 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:32.814853 (+ 245us) server_negotiation.cc:299] Negotiation successful
0809 13:02:32.815063 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1361,"thread_start_us":1169,"threads_started":1}
W20260809 13:02:32.816841 29531 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50854
Aug 09 13:02:32 dist-test-slave-jq4t krb5kdc[29302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280552, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 13:02:32 dist-test-slave-jq4t krb5kdc[29302](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280552, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.193@KRBTEST.COM
I20260809 13:02:32.866930 30103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:32.853106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50868 (local address 127.28.155.193:33641)
0809 13:02:32.853348 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:32.853358 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:32.853584 (+ 226us) server_negotiation.cc:407] Connection header received
0809 13:02:32.853745 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:32.853750 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:32.853851 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:32.853941 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:32.855338 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:32.856034 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:32.857332 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:32.857756 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:32.857853 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:32.861842 (+ 3989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:32.861847 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:32.861850 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:32.861884 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:32.864656 (+ 2772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:32.865294 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:32.865298 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:32.865300 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:32.865426 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:32.865729 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:32.865733 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:32.865735 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:32.865975 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:32.866163 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:32.866405 (+ 242us) server_negotiation.cc:299] Negotiation successful
0809 13:02:32.866576 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260809 13:02:32.868986 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 29458
I20260809 13:02:32.883282 30103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:32.870876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50882 (local address 127.28.155.193:33641)
0809 13:02:32.871080 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:32.871088 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:32.871414 (+ 326us) server_negotiation.cc:407] Connection header received
0809 13:02:32.871626 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:32.871630 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:32.871686 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:32.871787 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:32.873107 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:32.873808 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:32.875161 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:32.875601 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:32.875736 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:32.878136 (+ 2400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:32.878141 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:32.878163 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:32.878212 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:32.881016 (+ 2804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:32.881619 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:32.881623 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:32.881625 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:32.881760 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:32.882087 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:32.882090 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:32.882092 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:32.882340 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:32.882538 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:32.882736 (+ 198us) server_negotiation.cc:299] Negotiation successful
0809 13:02:32.882896 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 13:02:32.884135 29659 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:02:32.978503 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 29458
I20260809 13:02:33.006170 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 29674
Aug 09 13:02:33 dist-test-slave-jq4t krb5kdc[29302](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280552, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.194@KRBTEST.COM
I20260809 13:02:33.024324 30115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:33.007303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50678 (local address 127.28.155.194:35585)
0809 13:02:33.007858 (+ 555us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:33.007866 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:33.007892 (+ 26us) server_negotiation.cc:407] Connection header received
0809 13:02:33.007959 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:33.007966 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:33.008209 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:33.008358 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:33.009733 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:33.010793 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:33.012171 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:33.012855 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:33.012964 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:33.017467 (+ 4503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:33.017482 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:33.017500 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:33.017544 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:33.020958 (+ 3414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:33.021728 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:33.021735 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:33.021738 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:33.021894 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:33.022405 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:33.022409 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:33.022411 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:33.022821 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:33.023241 (+ 420us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:33.023617 (+ 376us) server_negotiation.cc:299] Negotiation successful
0809 13:02:33.023931 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":279,"threads_started":1}
I20260809 13:02:33.025758 29860 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:02:33.112210 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 29674
I20260809 13:02:33.138752 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 29879
Aug 09 13:02:33 dist-test-slave-jq4t krb5kdc[29302](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280552, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.195@KRBTEST.COM
I20260809 13:02:33.156384 30118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:33.140086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32946 (local address 127.28.155.195:34091)
0809 13:02:33.140912 (+ 826us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:33.140919 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:33.140951 (+ 32us) server_negotiation.cc:407] Connection header received
0809 13:02:33.141019 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:33.141026 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:33.141237 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:33.141376 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:33.142622 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:33.143711 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:33.145179 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:33.145759 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:33.145879 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:33.150343 (+ 4464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:33.150356 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:33.150371 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:33.150415 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:33.153506 (+ 3091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:33.154283 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:33.154290 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:33.154293 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:33.154431 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:33.154821 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:33.154824 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:33.154826 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:33.155184 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:33.155441 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:33.155711 (+ 270us) server_negotiation.cc:299] Negotiation successful
0809 13:02:33.155955 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":669,"thread_start_us":490,"threads_started":1}
I20260809 13:02:33.157878 30086 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:02:33.244791 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 29879
I20260809 13:02:33.269553 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 29319
I20260809 13:02:33.270943 29414 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:02:33.387856 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 29319
2026-08-09T13:02:33Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4745 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:02:33 dist-test-slave-jq4t krb5kdc[30123](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:02:33 dist-test-slave-jq4t krb5kdc[30123](info): set up 2 sockets
Aug 09 13:02:33 dist-test-slave-jq4t krb5kdc[30123](info): commencing operation
krb5kdc: starting...
W20260809 13:02:34.701476 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.258s user 0.001s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:02:34 dist-test-slave-jq4t krb5kdc[30123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280554, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:02:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:02:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
I20260809 13:02:34.916949 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:44651
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:39911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:44651
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:02:35.280344 30147 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:02:35.280817 30147 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:02:35.280997 30147 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:02:35.288654 30147 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:02:35.288797 30147 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:02:35.288906 30147 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:02:35.289017 30147 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:02:35.289113 30147 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:02:35.299649 30147 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:39911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:44651
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:44651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:02:35.301164 30147 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:02:35.302603 30147 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:02:35.315940 30154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:35.316285 30153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:35.316286 30157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:02:35.317158 30147 server_base.cc:1034] running on GCE node
I20260809 13:02:35.318109 30147 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:02:35.319592 30147 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:02:35.320817 30147 hybrid_clock.cc:648] HybridClock initialized: now 1786280555320765 us; error 30 us; skew 500 ppm
I20260809 13:02:35.321193 30147 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:02:35 dist-test-slave-jq4t krb5kdc[30123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280555, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:02:35.326951 30147 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:02:35.328661 30147 webserver.cc:460] Webserver started at http://127.28.155.254:38335/ using document root <none> and password file <none>
I20260809 13:02:35.329353 30147 fs_manager.cc:359] Metadata directory not provided
I20260809 13:02:35.329460 30147 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:02:35.329738 30147 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:02:35.333009 30147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "abebe0f63a2f4a87b09043ea6f151e81"
format_stamp: "Formatted at 2026-08-09 13:02:35 on dist-test-slave-jq4t"
server_key: "530dec7f9fbb3d1efca744c576fd782d"
server_key_iv: "a548b1e866c7097479581e78150e89dc"
server_key_version: "encryptionkey@0"
I20260809 13:02:35.333773 30147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "abebe0f63a2f4a87b09043ea6f151e81"
format_stamp: "Formatted at 2026-08-09 13:02:35 on dist-test-slave-jq4t"
server_key: "530dec7f9fbb3d1efca744c576fd782d"
server_key_iv: "a548b1e866c7097479581e78150e89dc"
server_key_version: "encryptionkey@0"
I20260809 13:02:35.339311 30147 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 13:02:35.342893 30165 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:35.344349 30147 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 13:02:35.344573 30147 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "abebe0f63a2f4a87b09043ea6f151e81"
format_stamp: "Formatted at 2026-08-09 13:02:35 on dist-test-slave-jq4t"
server_key: "530dec7f9fbb3d1efca744c576fd782d"
server_key_iv: "a548b1e866c7097479581e78150e89dc"
server_key_version: "encryptionkey@0"
I20260809 13:02:35.344769 30147 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:02:35.359717 30147 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:02:35.363989 30147 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:02:35.364265 30147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:02:35.390033 30147 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:44651
I20260809 13:02:35.390111 30241 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:44651 every 8 connection(s)
I20260809 13:02:35.391999 30147 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:02:35.396224 30245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:35.400023 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 30147
I20260809 13:02:35.400343 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:02:35.401244 29295 external_mini_cluster.cc:1428] Setting key 7927c655b5911734d68d6eef5cd75207
I20260809 13:02:35.410138 30245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abebe0f63a2f4a87b09043ea6f151e81: Bootstrap starting.
I20260809 13:02:35.413774 30245 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P abebe0f63a2f4a87b09043ea6f151e81: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:35.414927 30245 log.cc:824] T 00000000000000000000000000000000 P abebe0f63a2f4a87b09043ea6f151e81: Log is configured to *not* fsync() on all Append() calls
Aug 09 13:02:35 dist-test-slave-jq4t krb5kdc[30123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280554, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:02:35.418147 30245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abebe0f63a2f4a87b09043ea6f151e81: No bootstrap required, opened a new log
I20260809 13:02:35.425629 30248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:35.403543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51922 (local address 127.28.155.254:44651)
0809 13:02:35.404393 (+ 850us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:35.404406 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:35.404449 (+ 43us) server_negotiation.cc:407] Connection header received
0809 13:02:35.406327 (+ 1878us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:35.406354 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:35.406798 (+ 444us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:35.407241 (+ 443us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:35.409017 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:35.410514 (+ 1497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:35.411883 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:35.412796 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:35.413010 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:35.417625 (+ 4615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:35.417633 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:35.417648 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:35.417686 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:35.421048 (+ 3362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:35.421807 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:35.421814 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:35.421821 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:35.422030 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:35.422463 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:35.422467 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:35.422472 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:35.423089 (+ 617us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:35.423428 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:35.423976 (+ 548us) server_negotiation.cc:299] Negotiation successful
0809 13:02:35.424441 (+ 465us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":633,"thread_start_us":398,"threads_started":1}
I20260809 13:02:35.426607 30245 raft_consensus.cc:348] T 00000000000000000000000000000000 P abebe0f63a2f4a87b09043ea6f151e81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abebe0f63a2f4a87b09043ea6f151e81" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44651 } }
I20260809 13:02:35.427011 30245 raft_consensus.cc:374] T 00000000000000000000000000000000 P abebe0f63a2f4a87b09043ea6f151e81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:35.427162 30245 raft_consensus.cc:729] T 00000000000000000000000000000000 P abebe0f63a2f4a87b09043ea6f151e81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abebe0f63a2f4a87b09043ea6f151e81, State: Initialized, Role: FOLLOWER
I20260809 13:02:35.427739 30245 consensus_queue.cc:260] T 00000000000000000000000000000000 P abebe0f63a2f4a87b09043ea6f151e81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abebe0f63a2f4a87b09043ea6f151e81" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44651 } }
I20260809 13:02:35.428020 30245 raft_consensus.cc:388] T 00000000000000000000000000000000 P abebe0f63a2f4a87b09043ea6f151e81 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:02:35.428176 30245 raft_consensus.cc:482] T 00000000000000000000000000000000 P abebe0f63a2f4a87b09043ea6f151e81 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:02:35.428390 30245 raft_consensus.cc:3037] T 00000000000000000000000000000000 P abebe0f63a2f4a87b09043ea6f151e81 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:35.430809 30245 raft_consensus.cc:504] T 00000000000000000000000000000000 P abebe0f63a2f4a87b09043ea6f151e81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abebe0f63a2f4a87b09043ea6f151e81" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44651 } }
I20260809 13:02:35.431401 30245 leader_election.cc:302] T 00000000000000000000000000000000 P abebe0f63a2f4a87b09043ea6f151e81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: abebe0f63a2f4a87b09043ea6f151e81; no voters:
I20260809 13:02:35.432181 30245 leader_election.cc:288] T 00000000000000000000000000000000 P abebe0f63a2f4a87b09043ea6f151e81 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:02:35.432299 30250 raft_consensus.cc:2781] T 00000000000000000000000000000000 P abebe0f63a2f4a87b09043ea6f151e81 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:02:35.433084 30250 raft_consensus.cc:686] T 00000000000000000000000000000000 P abebe0f63a2f4a87b09043ea6f151e81 [term 1 LEADER]: Becoming Leader. State: Replica: abebe0f63a2f4a87b09043ea6f151e81, State: Running, Role: LEADER
I20260809 13:02:35.433681 30250 consensus_queue.cc:237] T 00000000000000000000000000000000 P abebe0f63a2f4a87b09043ea6f151e81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abebe0f63a2f4a87b09043ea6f151e81" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44651 } }
I20260809 13:02:35.434743 30245 sys_catalog.cc:564] T 00000000000000000000000000000000 P abebe0f63a2f4a87b09043ea6f151e81 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:02:35.437759 30253 sys_catalog.cc:455] T 00000000000000000000000000000000 P abebe0f63a2f4a87b09043ea6f151e81 [sys.catalog]: SysCatalogTable state changed. Reason: New leader abebe0f63a2f4a87b09043ea6f151e81. Latest consensus state: current_term: 1 leader_uuid: "abebe0f63a2f4a87b09043ea6f151e81" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abebe0f63a2f4a87b09043ea6f151e81" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44651 } } }
I20260809 13:02:35.438197 30253 sys_catalog.cc:458] T 00000000000000000000000000000000 P abebe0f63a2f4a87b09043ea6f151e81 [sys.catalog]: This master's current role is: LEADER
I20260809 13:02:35.438961 30252 sys_catalog.cc:455] T 00000000000000000000000000000000 P abebe0f63a2f4a87b09043ea6f151e81 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "abebe0f63a2f4a87b09043ea6f151e81" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abebe0f63a2f4a87b09043ea6f151e81" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44651 } } }
I20260809 13:02:35.439266 30252 sys_catalog.cc:458] T 00000000000000000000000000000000 P abebe0f63a2f4a87b09043ea6f151e81 [sys.catalog]: This master's current role is: LEADER
I20260809 13:02:35.440418 30261 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:02:35.446211 30261 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:02:35.456415 30261 catalog_manager.cc:1347] Generated new cluster ID: e1f228876f214768885eeb8389be71fa
I20260809 13:02:35.456617 30261 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:02:35.469519 30261 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:02:35.471683 30261 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:02:35.482285 30261 catalog_manager.cc:5868] T 00000000000000000000000000000000 P abebe0f63a2f4a87b09043ea6f151e81: Generated new TSK 0
I20260809 13:02:35.483263 30261 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
I20260809 13:02:35.548606 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:0
--local_ip_for_outbound_sockets=127.28.155.193
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:44651
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:39911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:02:35.914238 30285 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:02:35.914554 30285 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:02:35.914734 30285 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:02:35.922366 30285 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:02:35.922497 30285 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:02:35.922683 30285 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:02:35.933647 30285 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:39911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:44651
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:02:35.935150 30285 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:02:35.936877 30285 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:02:35.951417 30297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:35.951519 30301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:35.951483 30298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:02:35.952785 30285 server_base.cc:1034] running on GCE node
I20260809 13:02:35.953495 30285 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:02:35.954577 30285 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:02:35.955794 30285 hybrid_clock.cc:648] HybridClock initialized: now 1786280555955723 us; error 62 us; skew 500 ppm
I20260809 13:02:35.956152 30285 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:02:35 dist-test-slave-jq4t krb5kdc[30123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280555, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:02:35.959750 30285 init.cc:377] Logged in from keytab as kudu/127.28.155.193@KRBTEST.COM (short username kudu)
I20260809 13:02:35.961400 30285 webserver.cc:460] Webserver started at http://127.28.155.193:38277/ using document root <none> and password file <none>
I20260809 13:02:35.962142 30285 fs_manager.cc:359] Metadata directory not provided
I20260809 13:02:35.962255 30285 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:02:35.962533 30285 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:02:35.965785 30285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-0/data/instance:
uuid: "f7d861ba23ee4a8388f6aaf54e56dda5"
format_stamp: "Formatted at 2026-08-09 13:02:35 on dist-test-slave-jq4t"
server_key: "bd237e5e18c9a2a86f3646da55a1e2e0"
server_key_iv: "9cea6366d871e92def8a1a15652ce046"
server_key_version: "encryptionkey@0"
I20260809 13:02:35.966549 30285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance:
uuid: "f7d861ba23ee4a8388f6aaf54e56dda5"
format_stamp: "Formatted at 2026-08-09 13:02:35 on dist-test-slave-jq4t"
server_key: "bd237e5e18c9a2a86f3646da55a1e2e0"
server_key_iv: "9cea6366d871e92def8a1a15652ce046"
server_key_version: "encryptionkey@0"
I20260809 13:02:35.971908 30285 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 13:02:35.975836 30313 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:35.977828 30285 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 13:02:35.978044 30285 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "f7d861ba23ee4a8388f6aaf54e56dda5"
format_stamp: "Formatted at 2026-08-09 13:02:35 on dist-test-slave-jq4t"
server_key: "bd237e5e18c9a2a86f3646da55a1e2e0"
server_key_iv: "9cea6366d871e92def8a1a15652ce046"
server_key_version: "encryptionkey@0"
I20260809 13:02:35.978298 30285 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:02:35.993633 30285 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:02:35.998631 30285 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:02:35.998975 30285 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:02:36.000097 30285 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:02:36.001709 30285 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:02:36.001828 30285 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:36.001987 30285 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:02:36.002084 30285 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:36.038282 30285 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:41465
I20260809 13:02:36.038324 30485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:41465 every 8 connection(s)
I20260809 13:02:36.039708 30285 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:02:36.046249 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 30285
I20260809 13:02:36.046522 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance
I20260809 13:02:36.047436 29295 external_mini_cluster.cc:1428] Setting key 9709547432e38882451c6cf07f8bc8ca
Aug 09 13:02:36 dist-test-slave-jq4t krb5kdc[30123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280555, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:02:36.065971 30491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:36.042543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:38353 (local address 127.28.155.254:44651)
0809 13:02:36.043035 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:36.043040 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:36.044127 (+ 1087us) server_negotiation.cc:407] Connection header received
0809 13:02:36.046346 (+ 2219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:36.046370 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:36.046467 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:36.046570 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:36.048772 (+ 2202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:36.049911 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:36.052648 (+ 2737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:36.053065 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:36.053171 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:36.058222 (+ 5051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:36.058230 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:36.058238 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:36.058292 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:36.062213 (+ 3921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:36.063057 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:36.063065 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:36.063071 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:36.063261 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:36.063743 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:36.063751 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:36.063757 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:36.064178 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:36.064354 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:36.065199 (+ 845us) server_negotiation.cc:299] Negotiation successful
0809 13:02:36.065468 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":237,"threads_started":1}
I20260809 13:02:36.066725 30492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:36.043165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:44651 (local address 127.28.155.193:38353)
0809 13:02:36.043947 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:36.043991 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:36.045999 (+ 2008us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:36.046904 (+ 905us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:36.046919 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:36.047745 (+ 826us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:02:36.048566 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:36.048589 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:36.050081 (+ 1492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:36.050087 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:36.052437 (+ 2350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:36.052460 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:36.053329 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:36.053339 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:36.053732 (+ 393us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:36.054556 (+ 824us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:02:36.054595 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:02:36.057896 (+ 3301us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:02:36.062401 (+ 4505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:36.062408 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:36.062424 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:36.062899 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:36.063396 (+ 497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:36.063399 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:36.063402 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:36.063609 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:36.064315 (+ 706us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:02:36.064321 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:02:36.064776 (+ 455us) client_negotiation.cc:769] Sending connection context
0809 13:02:36.065027 (+ 251us) client_negotiation.cc:240] Negotiation successful
0809 13:02:36.065459 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":291,"threads_started":1}
I20260809 13:02:36.068600 30486 heartbeater.cc:347] Connected to a master server at 127.28.155.254:44651
I20260809 13:02:36.068959 30486 heartbeater.cc:464] Registering TS with master...
I20260809 13:02:36.069785 30486 heartbeater.cc:511] Master 127.28.155.254:44651 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.28.155.194@KRBTEST.COM; defaulting to no policy
I20260809 13:02:36.072211 30193 ts_manager.cc:194] Registered new tserver with Master: f7d861ba23ee4a8388f6aaf54e56dda5 (127.28.155.193:41465)
I20260809 13:02:36.074033 30193 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.193@KRBTEST.COM'} at 127.28.155.193:38353
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
I20260809 13:02:36.100533 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:0
--local_ip_for_outbound_sockets=127.28.155.194
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:44651
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:39911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:02:36.466187 30498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:02:36.466480 30498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:02:36.466588 30498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:02:36.473928 30498 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:02:36.474056 30498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:02:36.474179 30498 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:02:36.484318 30498 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:39911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:44651
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:02:36.485689 30498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:02:36.487094 30498 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:02:36.501220 30510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:36.501264 30509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:36.501307 30512 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:02:36.502079 30498 server_base.cc:1034] running on GCE node
I20260809 13:02:36.502760 30498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:02:36.503711 30498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:02:36.504914 30498 hybrid_clock.cc:648] HybridClock initialized: now 1786280556504865 us; error 49 us; skew 500 ppm
I20260809 13:02:36.505219 30498 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:02:36 dist-test-slave-jq4t krb5kdc[30123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280556, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:02:36.508603 30498 init.cc:377] Logged in from keytab as kudu/127.28.155.194@KRBTEST.COM (short username kudu)
I20260809 13:02:36.510195 30498 webserver.cc:460] Webserver started at http://127.28.155.194:41185/ using document root <none> and password file <none>
I20260809 13:02:36.510937 30498 fs_manager.cc:359] Metadata directory not provided
I20260809 13:02:36.511076 30498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:02:36.511442 30498 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:02:36.514757 30498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-1/data/instance:
uuid: "6983edde4d1746dbb5beab6bfb34deb5"
format_stamp: "Formatted at 2026-08-09 13:02:36 on dist-test-slave-jq4t"
server_key: "1558a7c5d5b1c6483d851c882a3e3c03"
server_key_iv: "48f4f80f6e1b5017fde06cefbd42a04c"
server_key_version: "encryptionkey@0"
I20260809 13:02:36.515735 30498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance:
uuid: "6983edde4d1746dbb5beab6bfb34deb5"
format_stamp: "Formatted at 2026-08-09 13:02:36 on dist-test-slave-jq4t"
server_key: "1558a7c5d5b1c6483d851c882a3e3c03"
server_key_iv: "48f4f80f6e1b5017fde06cefbd42a04c"
server_key_version: "encryptionkey@0"
I20260809 13:02:36.521530 30498 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 13:02:36.525331 30522 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:36.526769 30498 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:02:36.526950 30498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "6983edde4d1746dbb5beab6bfb34deb5"
format_stamp: "Formatted at 2026-08-09 13:02:36 on dist-test-slave-jq4t"
server_key: "1558a7c5d5b1c6483d851c882a3e3c03"
server_key_iv: "48f4f80f6e1b5017fde06cefbd42a04c"
server_key_version: "encryptionkey@0"
I20260809 13:02:36.527189 30498 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:02:36.545326 30498 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:02:36.549994 30498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:02:36.550321 30498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:02:36.551414 30498 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:02:36.552994 30498 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:02:36.553084 30498 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:36.553227 30498 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:02:36.553282 30498 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:36.589452 30498 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:46461
I20260809 13:02:36.589550 30695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:46461 every 8 connection(s)
I20260809 13:02:36.590898 30498 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:02:36.595552 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 30498
I20260809 13:02:36.595799 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance
I20260809 13:02:36.596271 29295 external_mini_cluster.cc:1428] Setting key 3f728defff9bec6217af36a200141629
Aug 09 13:02:36 dist-test-slave-jq4t krb5kdc[30123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280556, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:02:36.614943 30701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:36.593854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:46951 (local address 127.28.155.254:44651)
0809 13:02:36.594349 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:36.594354 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:36.595424 (+ 1070us) server_negotiation.cc:407] Connection header received
0809 13:02:36.597570 (+ 2146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:36.597576 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:36.597682 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:36.597808 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:36.599450 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:36.600227 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:36.601979 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:36.602434 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:36.602587 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:36.606792 (+ 4205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:36.606802 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:36.606809 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:36.606860 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:36.610947 (+ 4087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:36.611843 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:36.611851 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:36.611858 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:36.612081 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:36.612682 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:36.612689 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:36.612695 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:36.613122 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:36.613288 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:36.614101 (+ 813us) server_negotiation.cc:299] Negotiation successful
0809 13:02:36.614430 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":236,"threads_started":1}
I20260809 13:02:36.615893 30703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:36.594477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:44651 (local address 127.28.155.194:46951)
0809 13:02:36.595245 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:36.595292 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:36.597285 (+ 1993us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:36.598084 (+ 799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:36.598093 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:36.598655 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:02:36.599262 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:36.599280 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:36.600412 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:36.600416 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:36.601811 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:36.601825 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:36.602705 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:36.602713 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:36.602955 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:36.603724 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:02:36.603754 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:02:36.606521 (+ 2767us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:02:36.611152 (+ 4631us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:36.611160 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:36.611175 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:36.611677 (+ 502us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:36.612247 (+ 570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:36.612251 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:36.612253 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:36.612530 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:36.613271 (+ 741us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:02:36.613278 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:02:36.613669 (+ 391us) client_negotiation.cc:769] Sending connection context
0809 13:02:36.613945 (+ 276us) client_negotiation.cc:240] Negotiation successful
0809 13:02:36.614400 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":303,"threads_started":1}
I20260809 13:02:36.617599 30696 heartbeater.cc:347] Connected to a master server at 127.28.155.254:44651
I20260809 13:02:36.617969 30696 heartbeater.cc:464] Registering TS with master...
I20260809 13:02:36.618796 30696 heartbeater.cc:511] Master 127.28.155.254:44651 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.28.155.195@KRBTEST.COM; defaulting to no policy
I20260809 13:02:36.620810 30193 ts_manager.cc:194] Registered new tserver with Master: 6983edde4d1746dbb5beab6bfb34deb5 (127.28.155.194:46461)
I20260809 13:02:36.621773 30193 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.194@KRBTEST.COM'} at 127.28.155.194:46951
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
I20260809 13:02:36.648267 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:0
--local_ip_for_outbound_sockets=127.28.155.195
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:44651
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:39911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:02:36.999663 30708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:02:37.000065 30708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:02:37.000248 30708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:02:37.007797 30708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:02:37.008005 30708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:02:37.008194 30708 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:02:37.018710 30708 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:39911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:44651
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:02:37.020183 30708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:02:37.021625 30708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:02:37.035929 30715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:37.035840 30718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:37.035889 30716 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:02:37.037040 30708 server_base.cc:1034] running on GCE node
I20260809 13:02:37.037904 30708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:02:37.039258 30708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:02:37.040556 30708 hybrid_clock.cc:648] HybridClock initialized: now 1786280557040481 us; error 80 us; skew 500 ppm
I20260809 13:02:37.040984 30708 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:02:37 dist-test-slave-jq4t krb5kdc[30123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280557, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:02:37.045210 30708 init.cc:377] Logged in from keytab as kudu/127.28.155.195@KRBTEST.COM (short username kudu)
I20260809 13:02:37.046906 30708 webserver.cc:460] Webserver started at http://127.28.155.195:42363/ using document root <none> and password file <none>
I20260809 13:02:37.047740 30708 fs_manager.cc:359] Metadata directory not provided
I20260809 13:02:37.047909 30708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:02:37.048272 30708 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:02:37.051656 30708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-2/data/instance:
uuid: "64b86d10d22244c68c336b05c14b49b8"
format_stamp: "Formatted at 2026-08-09 13:02:37 on dist-test-slave-jq4t"
server_key: "d211be423e5f3ba6392e6a5d4b54531c"
server_key_iv: "b7ce7dce7392da02a1a222e241435694"
server_key_version: "encryptionkey@0"
I20260809 13:02:37.052629 30708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance:
uuid: "64b86d10d22244c68c336b05c14b49b8"
format_stamp: "Formatted at 2026-08-09 13:02:37 on dist-test-slave-jq4t"
server_key: "d211be423e5f3ba6392e6a5d4b54531c"
server_key_iv: "b7ce7dce7392da02a1a222e241435694"
server_key_version: "encryptionkey@0"
I20260809 13:02:37.058518 30708 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 13:02:37.062501 30731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:37.063970 30708 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 13:02:37.064180 30708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "64b86d10d22244c68c336b05c14b49b8"
format_stamp: "Formatted at 2026-08-09 13:02:37 on dist-test-slave-jq4t"
server_key: "d211be423e5f3ba6392e6a5d4b54531c"
server_key_iv: "b7ce7dce7392da02a1a222e241435694"
server_key_version: "encryptionkey@0"
I20260809 13:02:37.064417 30708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:02:37.078328 30486 heartbeater.cc:503] Master 127.28.155.254:44651 was elected leader, sending a full tablet report...
I20260809 13:02:37.084570 30708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:02:37.089066 30708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:02:37.089390 30708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:02:37.090478 30708 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:02:37.091987 30708 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:02:37.092103 30708 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:37.092267 30708 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:02:37.092344 30708 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:37.129923 30708 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:43697
I20260809 13:02:37.129992 30899 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:43697 every 8 connection(s)
I20260809 13:02:37.131433 30708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:02:37.141945 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 30708
I20260809 13:02:37.142171 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance
I20260809 13:02:37.142738 29295 external_mini_cluster.cc:1428] Setting key f83b94681475118c13044077617e7936
Aug 09 13:02:37 dist-test-slave-jq4t krb5kdc[30123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280557, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:02:37.153874 30902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:37.134301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:54179 (local address 127.28.155.254:44651)
0809 13:02:37.134792 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:37.134796 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:37.135740 (+ 944us) server_negotiation.cc:407] Connection header received
0809 13:02:37.137842 (+ 2102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:37.137848 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:37.137953 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:37.138078 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:37.139715 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.140654 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.142920 (+ 2266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.143363 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.143472 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:37.147701 (+ 4229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:37.147706 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:37.147709 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:37.147744 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:37.150833 (+ 3089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:37.151611 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:37.151614 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:37.151617 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:37.151747 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:37.152227 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:37.152230 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:37.152232 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:37.152590 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:37.152719 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:37.153401 (+ 682us) server_negotiation.cc:299] Negotiation successful
0809 13:02:37.153585 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":272,"threads_started":1}
I20260809 13:02:37.154990 30903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:37.134784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:44651 (local address 127.28.155.195:54179)
0809 13:02:37.135566 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:37.135615 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:37.137549 (+ 1934us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:37.138342 (+ 793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:37.138350 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:37.138911 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:02:37.139522 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:37.139541 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.140829 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.140833 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:37.142678 (+ 1845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:37.142696 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.143642 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.143649 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:37.143864 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:37.144607 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:02:37.144650 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:02:37.147477 (+ 2827us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:02:37.150993 (+ 3516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:37.151004 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:37.151020 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:37.151500 (+ 480us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:37.151875 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:37.151878 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:37.151882 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:37.152118 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:37.152709 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:02:37.152716 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:02:37.153066 (+ 350us) client_negotiation.cc:769] Sending connection context
0809 13:02:37.153317 (+ 251us) client_negotiation.cc:240] Negotiation successful
0809 13:02:37.153784 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":283,"threads_started":1}
I20260809 13:02:37.156462 30900 heartbeater.cc:347] Connected to a master server at 127.28.155.254:44651
I20260809 13:02:37.156947 30900 heartbeater.cc:464] Registering TS with master...
I20260809 13:02:37.157848 30900 heartbeater.cc:511] Master 127.28.155.254:44651 requested a full tablet report, sending...
I20260809 13:02:37.159544 30193 ts_manager.cc:194] Registered new tserver with Master: 64b86d10d22244c68c336b05c14b49b8 (127.28.155.195:43697)
I20260809 13:02:37.160427 30193 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.195@KRBTEST.COM'} at 127.28.155.195:54179
I20260809 13:02:37.172156 29295 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 13:02:37.192647 30902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:37.179269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51926 (local address 127.28.155.254:44651)
0809 13:02:37.179480 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:37.179485 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:37.180041 (+ 556us) server_negotiation.cc:407] Connection header received
0809 13:02:37.180193 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:37.180196 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:37.180266 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:37.180365 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:37.182031 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.182887 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.184305 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.184797 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.184904 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:37.187256 (+ 2352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:37.187261 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:37.187264 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:37.187300 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:37.189917 (+ 2617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:37.190560 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:37.190565 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:37.190567 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:37.190720 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:37.191075 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:37.191080 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:37.191083 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:37.191468 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:37.191676 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:37.192092 (+ 416us) server_negotiation.cc:299] Negotiation successful
0809 13:02:37.192297 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 13:02:37.200606 30193 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51926:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 13:02:37.207960 30193 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:02:37.231925 30918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:37.222126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53580 (local address 127.28.155.195:43697)
0809 13:02:37.222978 (+ 852us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:37.222987 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:37.223025 (+ 38us) server_negotiation.cc:407] Connection header received
0809 13:02:37.223326 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:37.223335 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:37.223628 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:37.223833 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:02:37.224934 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.226628 (+ 1694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.228882 (+ 2254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.230538 (+ 1656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.230764 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:37.230988 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:37.231371 (+ 383us) server_negotiation.cc:299] Negotiation successful
0809 13:02:37.231544 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":679,"thread_start_us":486,"threads_started":1}
I20260809 13:02:37.232035 30916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:37.221973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:43697 (local address 127.0.0.1:53580)
0809 13:02:37.222828 (+ 855us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:37.222882 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:37.223071 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:37.224173 (+ 1102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:37.224179 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:37.224202 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:02:37.224695 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:37.224710 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.226812 (+ 2102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.226820 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:37.228711 (+ 1891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:37.228725 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.230801 (+ 2076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.230810 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:37.231074 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:37.231116 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 13:02:37.231278 (+ 162us) client_negotiation.cc:240] Negotiation successful
0809 13:02:37.231510 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"thread_start_us":392,"threads_started":1}
I20260809 13:02:37.234999 30922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:37.224151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:41465 (local address 127.0.0.1:45230)
0809 13:02:37.224825 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:37.224841 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:37.224945 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:37.226413 (+ 1468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:37.226418 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:37.226443 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:02:37.227065 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:37.227090 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.229133 (+ 2043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.229139 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:37.232224 (+ 3085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:37.232241 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.234113 (+ 1872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.234120 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:37.234302 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:37.234341 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 13:02:37.234424 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 13:02:37.234614 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":1189,"threads_started":1}
I20260809 13:02:37.235733 30919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:37.223329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:46461 (local address 127.0.0.1:57376)
0809 13:02:37.223851 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:37.223871 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:37.223982 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:37.226752 (+ 2770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:37.226761 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:37.226793 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:02:37.227426 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:37.227441 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.230534 (+ 3093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.230540 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:37.232891 (+ 2351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:37.232907 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.234826 (+ 1919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.234834 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:37.235018 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:37.235051 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 13:02:37.235120 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 13:02:37.235297 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":400,"mutex_wait_us":4,"thread_start_us":405,"threads_started":1}
I20260809 13:02:37.235800 30923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:37.225099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45230 (local address 127.28.155.193:41465)
0809 13:02:37.225826 (+ 727us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:37.225835 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:37.225862 (+ 27us) server_negotiation.cc:407] Connection header received
0809 13:02:37.225953 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:37.225961 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:37.226201 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:37.226981 (+ 780us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:02:37.227299 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.228981 (+ 1682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.232453 (+ 3472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.233850 (+ 1397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.234954 (+ 1104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:37.235155 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:37.235228 (+ 73us) server_negotiation.cc:299] Negotiation successful
0809 13:02:37.235394 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":554,"thread_start_us":396,"threads_started":1}
I20260809 13:02:37.236718 30921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:37.223860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57376 (local address 127.28.155.194:46461)
0809 13:02:37.226138 (+ 2278us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:37.226146 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:37.226174 (+ 28us) server_negotiation.cc:407] Connection header received
0809 13:02:37.226274 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:37.226281 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:37.226521 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:37.227642 (+ 1121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:02:37.227897 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.230334 (+ 2437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.233071 (+ 2737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.234567 (+ 1496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.236017 (+ 1450us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:37.236184 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:37.236288 (+ 104us) server_negotiation.cc:299] Negotiation successful
0809 13:02:37.236436 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2108,"thread_start_us":2840,"threads_started":1}
I20260809 13:02:37.237092 30806 tablet_service.cc:1467] Processing CreateTablet for tablet 9d72127275974d7098042f201103566f (DEFAULT_TABLE table=test-table [id=28d54f9c65cb483d859b6a5ae2d5fbcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:02:37.240118 30806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d72127275974d7098042f201103566f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:37.239676 30395 tablet_service.cc:1467] Processing CreateTablet for tablet 9d72127275974d7098042f201103566f (DEFAULT_TABLE table=test-table [id=28d54f9c65cb483d859b6a5ae2d5fbcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:02:37.240180 30602 tablet_service.cc:1467] Processing CreateTablet for tablet 9d72127275974d7098042f201103566f (DEFAULT_TABLE table=test-table [id=28d54f9c65cb483d859b6a5ae2d5fbcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:02:37.241233 30395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d72127275974d7098042f201103566f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:37.241636 30602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d72127275974d7098042f201103566f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:37.254882 30924 tablet_bootstrap.cc:492] T 9d72127275974d7098042f201103566f P f7d861ba23ee4a8388f6aaf54e56dda5: Bootstrap starting.
I20260809 13:02:37.257352 30927 tablet_bootstrap.cc:492] T 9d72127275974d7098042f201103566f P 64b86d10d22244c68c336b05c14b49b8: Bootstrap starting.
I20260809 13:02:37.259128 30924 tablet_bootstrap.cc:654] T 9d72127275974d7098042f201103566f P f7d861ba23ee4a8388f6aaf54e56dda5: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:37.259227 30925 tablet_bootstrap.cc:492] T 9d72127275974d7098042f201103566f P 6983edde4d1746dbb5beab6bfb34deb5: Bootstrap starting.
I20260809 13:02:37.260731 30924 log.cc:824] T 9d72127275974d7098042f201103566f P f7d861ba23ee4a8388f6aaf54e56dda5: Log is configured to *not* fsync() on all Append() calls
I20260809 13:02:37.261176 30927 tablet_bootstrap.cc:654] T 9d72127275974d7098042f201103566f P 64b86d10d22244c68c336b05c14b49b8: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:37.262486 30925 tablet_bootstrap.cc:654] T 9d72127275974d7098042f201103566f P 6983edde4d1746dbb5beab6bfb34deb5: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:37.262748 30927 log.cc:824] T 9d72127275974d7098042f201103566f P 64b86d10d22244c68c336b05c14b49b8: Log is configured to *not* fsync() on all Append() calls
I20260809 13:02:37.263763 30925 log.cc:824] T 9d72127275974d7098042f201103566f P 6983edde4d1746dbb5beab6bfb34deb5: Log is configured to *not* fsync() on all Append() calls
I20260809 13:02:37.266530 30927 tablet_bootstrap.cc:492] T 9d72127275974d7098042f201103566f P 64b86d10d22244c68c336b05c14b49b8: No bootstrap required, opened a new log
I20260809 13:02:37.266855 30927 ts_tablet_manager.cc:1397] T 9d72127275974d7098042f201103566f P 64b86d10d22244c68c336b05c14b49b8: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260809 13:02:37.267169 30924 tablet_bootstrap.cc:492] T 9d72127275974d7098042f201103566f P f7d861ba23ee4a8388f6aaf54e56dda5: No bootstrap required, opened a new log
I20260809 13:02:37.267313 30925 tablet_bootstrap.cc:492] T 9d72127275974d7098042f201103566f P 6983edde4d1746dbb5beab6bfb34deb5: No bootstrap required, opened a new log
I20260809 13:02:37.267496 30924 ts_tablet_manager.cc:1397] T 9d72127275974d7098042f201103566f P f7d861ba23ee4a8388f6aaf54e56dda5: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.010s
I20260809 13:02:37.267606 30925 ts_tablet_manager.cc:1397] T 9d72127275974d7098042f201103566f P 6983edde4d1746dbb5beab6bfb34deb5: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.006s
I20260809 13:02:37.275915 30924 raft_consensus.cc:348] T 9d72127275974d7098042f201103566f P f7d861ba23ee4a8388f6aaf54e56dda5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64b86d10d22244c68c336b05c14b49b8" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 43697 } } peers { permanent_uuid: "6983edde4d1746dbb5beab6bfb34deb5" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 46461 } } peers { permanent_uuid: "f7d861ba23ee4a8388f6aaf54e56dda5" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 41465 } }
I20260809 13:02:37.276365 30924 raft_consensus.cc:374] T 9d72127275974d7098042f201103566f P f7d861ba23ee4a8388f6aaf54e56dda5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:37.276466 30924 raft_consensus.cc:729] T 9d72127275974d7098042f201103566f P f7d861ba23ee4a8388f6aaf54e56dda5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d861ba23ee4a8388f6aaf54e56dda5, State: Initialized, Role: FOLLOWER
I20260809 13:02:37.277153 30924 consensus_queue.cc:260] T 9d72127275974d7098042f201103566f P f7d861ba23ee4a8388f6aaf54e56dda5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64b86d10d22244c68c336b05c14b49b8" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 43697 } } peers { permanent_uuid: "6983edde4d1746dbb5beab6bfb34deb5" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 46461 } } peers { permanent_uuid: "f7d861ba23ee4a8388f6aaf54e56dda5" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 41465 } }
I20260809 13:02:37.278442 30925 raft_consensus.cc:348] T 9d72127275974d7098042f201103566f P 6983edde4d1746dbb5beab6bfb34deb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64b86d10d22244c68c336b05c14b49b8" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 43697 } } peers { permanent_uuid: "6983edde4d1746dbb5beab6bfb34deb5" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 46461 } } peers { permanent_uuid: "f7d861ba23ee4a8388f6aaf54e56dda5" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 41465 } }
I20260809 13:02:37.278441 30927 raft_consensus.cc:348] T 9d72127275974d7098042f201103566f P 64b86d10d22244c68c336b05c14b49b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64b86d10d22244c68c336b05c14b49b8" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 43697 } } peers { permanent_uuid: "6983edde4d1746dbb5beab6bfb34deb5" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 46461 } } peers { permanent_uuid: "f7d861ba23ee4a8388f6aaf54e56dda5" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 41465 } }
I20260809 13:02:37.278918 30925 raft_consensus.cc:374] T 9d72127275974d7098042f201103566f P 6983edde4d1746dbb5beab6bfb34deb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:37.278921 30927 raft_consensus.cc:374] T 9d72127275974d7098042f201103566f P 64b86d10d22244c68c336b05c14b49b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:37.279019 30925 raft_consensus.cc:729] T 9d72127275974d7098042f201103566f P 6983edde4d1746dbb5beab6bfb34deb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6983edde4d1746dbb5beab6bfb34deb5, State: Initialized, Role: FOLLOWER
I20260809 13:02:37.279021 30927 raft_consensus.cc:729] T 9d72127275974d7098042f201103566f P 64b86d10d22244c68c336b05c14b49b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64b86d10d22244c68c336b05c14b49b8, State: Initialized, Role: FOLLOWER
I20260809 13:02:37.279171 30924 ts_tablet_manager.cc:1428] T 9d72127275974d7098042f201103566f P f7d861ba23ee4a8388f6aaf54e56dda5: Time spent starting tablet: real 0.012s user 0.007s sys 0.005s
I20260809 13:02:37.279744 30925 consensus_queue.cc:260] T 9d72127275974d7098042f201103566f P 6983edde4d1746dbb5beab6bfb34deb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64b86d10d22244c68c336b05c14b49b8" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 43697 } } peers { permanent_uuid: "6983edde4d1746dbb5beab6bfb34deb5" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 46461 } } peers { permanent_uuid: "f7d861ba23ee4a8388f6aaf54e56dda5" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 41465 } }
I20260809 13:02:37.279744 30927 consensus_queue.cc:260] T 9d72127275974d7098042f201103566f P 64b86d10d22244c68c336b05c14b49b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64b86d10d22244c68c336b05c14b49b8" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 43697 } } peers { permanent_uuid: "6983edde4d1746dbb5beab6bfb34deb5" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 46461 } } peers { permanent_uuid: "f7d861ba23ee4a8388f6aaf54e56dda5" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 41465 } }
I20260809 13:02:37.281093 30900 heartbeater.cc:503] Master 127.28.155.254:44651 was elected leader, sending a full tablet report...
I20260809 13:02:37.281585 30696 heartbeater.cc:503] Master 127.28.155.254:44651 was elected leader, sending a full tablet report...
I20260809 13:02:37.282212 30925 ts_tablet_manager.cc:1428] T 9d72127275974d7098042f201103566f P 6983edde4d1746dbb5beab6bfb34deb5: Time spent starting tablet: real 0.014s user 0.012s sys 0.004s
I20260809 13:02:37.283016 30927 ts_tablet_manager.cc:1428] T 9d72127275974d7098042f201103566f P 64b86d10d22244c68c336b05c14b49b8: Time spent starting tablet: real 0.016s user 0.017s sys 0.000s
W20260809 13:02:37.292713 30489 tablet.cc:2369] T 9d72127275974d7098042f201103566f P f7d861ba23ee4a8388f6aaf54e56dda5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 13:02:37.343168 30699 tablet.cc:2369] T 9d72127275974d7098042f201103566f P 6983edde4d1746dbb5beab6bfb34deb5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 13:02:37.383407 30901 tablet.cc:2369] T 9d72127275974d7098042f201103566f P 64b86d10d22244c68c336b05c14b49b8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:02:37.415275 30932 raft_consensus.cc:482] T 9d72127275974d7098042f201103566f P f7d861ba23ee4a8388f6aaf54e56dda5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:02:37.415637 30932 raft_consensus.cc:504] T 9d72127275974d7098042f201103566f P f7d861ba23ee4a8388f6aaf54e56dda5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64b86d10d22244c68c336b05c14b49b8" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 43697 } } peers { permanent_uuid: "6983edde4d1746dbb5beab6bfb34deb5" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 46461 } } peers { permanent_uuid: "f7d861ba23ee4a8388f6aaf54e56dda5" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 41465 } }
I20260809 13:02:37.417958 30932 leader_election.cc:288] T 9d72127275974d7098042f201103566f P f7d861ba23ee4a8388f6aaf54e56dda5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64b86d10d22244c68c336b05c14b49b8 (127.28.155.195:43697), 6983edde4d1746dbb5beab6bfb34deb5 (127.28.155.194:46461)
I20260809 13:02:37.425207 30918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:37.418417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:50381 (local address 127.28.155.195:43697)
0809 13:02:37.418689 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:37.418698 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:37.418980 (+ 282us) server_negotiation.cc:407] Connection header received
0809 13:02:37.419229 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:37.419238 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:37.419333 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:37.419436 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:02:37.420196 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.421227 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.423250 (+ 2023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.424122 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.424249 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:37.424304 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:37.424801 (+ 497us) server_negotiation.cc:299] Negotiation successful
0809 13:02:37.424943 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260809 13:02:37.425282 30938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:37.418159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:43697 (local address 127.28.155.193:50381)
0809 13:02:37.418864 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:37.418881 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:37.419071 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:37.419585 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:37.419589 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:37.419612 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:02:37.420033 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:37.420050 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.421379 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.421385 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:37.423069 (+ 1684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:37.423082 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.424347 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.424353 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:37.424593 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:37.424659 (+ 66us) client_negotiation.cc:769] Sending connection context
0809 13:02:37.424736 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 13:02:37.424839 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"mutex_wait_us":4,"thread_start_us":373,"threads_started":1}
I20260809 13:02:37.425467 30921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:37.419273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:45599 (local address 127.28.155.194:46461)
0809 13:02:37.419505 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:37.419514 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:37.419810 (+ 296us) server_negotiation.cc:407] Connection header received
0809 13:02:37.419916 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:37.419922 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:37.420009 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:37.420119 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:02:37.420808 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.421677 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.423474 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.424337 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.424528 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:37.424603 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:37.425059 (+ 456us) server_negotiation.cc:299] Negotiation successful
0809 13:02:37.425201 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260809 13:02:37.425642 30939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:37.418965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:46461 (local address 127.28.155.193:45599)
0809 13:02:37.419696 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:37.419712 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:37.419818 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:37.420168 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:37.420172 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:37.420196 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:02:37.420630 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:37.420643 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.421826 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.421830 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:37.423313 (+ 1483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:37.423329 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.424613 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.424617 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:37.424865 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:37.424899 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 13:02:37.424999 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 13:02:37.425139 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"mutex_wait_us":38,"thread_start_us":373,"threads_started":1}
I20260809 13:02:37.426609 30830 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d72127275974d7098042f201103566f" candidate_uuid: "f7d861ba23ee4a8388f6aaf54e56dda5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64b86d10d22244c68c336b05c14b49b8" is_pre_election: true
I20260809 13:02:37.426613 30634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d72127275974d7098042f201103566f" candidate_uuid: "f7d861ba23ee4a8388f6aaf54e56dda5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6983edde4d1746dbb5beab6bfb34deb5" is_pre_election: true
I20260809 13:02:37.427152 30634 raft_consensus.cc:2454] T 9d72127275974d7098042f201103566f P 6983edde4d1746dbb5beab6bfb34deb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7d861ba23ee4a8388f6aaf54e56dda5 in term 0.
I20260809 13:02:37.427165 30830 raft_consensus.cc:2454] T 9d72127275974d7098042f201103566f P 64b86d10d22244c68c336b05c14b49b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7d861ba23ee4a8388f6aaf54e56dda5 in term 0.
I20260809 13:02:37.427836 30318 leader_election.cc:302] T 9d72127275974d7098042f201103566f P f7d861ba23ee4a8388f6aaf54e56dda5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64b86d10d22244c68c336b05c14b49b8, f7d861ba23ee4a8388f6aaf54e56dda5; no voters:
I20260809 13:02:37.428252 30932 raft_consensus.cc:2781] T 9d72127275974d7098042f201103566f P f7d861ba23ee4a8388f6aaf54e56dda5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:02:37.428406 30932 raft_consensus.cc:482] T 9d72127275974d7098042f201103566f P f7d861ba23ee4a8388f6aaf54e56dda5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:02:37.428570 30932 raft_consensus.cc:3037] T 9d72127275974d7098042f201103566f P f7d861ba23ee4a8388f6aaf54e56dda5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:37.430912 30932 raft_consensus.cc:504] T 9d72127275974d7098042f201103566f P f7d861ba23ee4a8388f6aaf54e56dda5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64b86d10d22244c68c336b05c14b49b8" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 43697 } } peers { permanent_uuid: "6983edde4d1746dbb5beab6bfb34deb5" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 46461 } } peers { permanent_uuid: "f7d861ba23ee4a8388f6aaf54e56dda5" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 41465 } }
I20260809 13:02:37.431586 30932 leader_election.cc:288] T 9d72127275974d7098042f201103566f P f7d861ba23ee4a8388f6aaf54e56dda5 [CANDIDATE]: Term 1 election: Requested vote from peers 64b86d10d22244c68c336b05c14b49b8 (127.28.155.195:43697), 6983edde4d1746dbb5beab6bfb34deb5 (127.28.155.194:46461)
I20260809 13:02:37.432144 30830 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d72127275974d7098042f201103566f" candidate_uuid: "f7d861ba23ee4a8388f6aaf54e56dda5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64b86d10d22244c68c336b05c14b49b8"
I20260809 13:02:37.432229 30634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d72127275974d7098042f201103566f" candidate_uuid: "f7d861ba23ee4a8388f6aaf54e56dda5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6983edde4d1746dbb5beab6bfb34deb5"
I20260809 13:02:37.432410 30830 raft_consensus.cc:3037] T 9d72127275974d7098042f201103566f P 64b86d10d22244c68c336b05c14b49b8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:37.432433 30634 raft_consensus.cc:3037] T 9d72127275974d7098042f201103566f P 6983edde4d1746dbb5beab6bfb34deb5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:37.434825 30830 raft_consensus.cc:2454] T 9d72127275974d7098042f201103566f P 64b86d10d22244c68c336b05c14b49b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d861ba23ee4a8388f6aaf54e56dda5 in term 1.
I20260809 13:02:37.434839 30634 raft_consensus.cc:2454] T 9d72127275974d7098042f201103566f P 6983edde4d1746dbb5beab6bfb34deb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d861ba23ee4a8388f6aaf54e56dda5 in term 1.
I20260809 13:02:37.435292 30318 leader_election.cc:302] T 9d72127275974d7098042f201103566f P f7d861ba23ee4a8388f6aaf54e56dda5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6983edde4d1746dbb5beab6bfb34deb5, f7d861ba23ee4a8388f6aaf54e56dda5; no voters:
I20260809 13:02:37.435611 30932 raft_consensus.cc:2781] T 9d72127275974d7098042f201103566f P f7d861ba23ee4a8388f6aaf54e56dda5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:02:37.436187 30932 raft_consensus.cc:686] T 9d72127275974d7098042f201103566f P f7d861ba23ee4a8388f6aaf54e56dda5 [term 1 LEADER]: Becoming Leader. State: Replica: f7d861ba23ee4a8388f6aaf54e56dda5, State: Running, Role: LEADER
I20260809 13:02:37.436744 30932 consensus_queue.cc:237] T 9d72127275974d7098042f201103566f P f7d861ba23ee4a8388f6aaf54e56dda5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64b86d10d22244c68c336b05c14b49b8" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 43697 } } peers { permanent_uuid: "6983edde4d1746dbb5beab6bfb34deb5" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 46461 } } peers { permanent_uuid: "f7d861ba23ee4a8388f6aaf54e56dda5" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 41465 } }
I20260809 13:02:37.441697 30190 catalog_manager.cc:5495] T 9d72127275974d7098042f201103566f P f7d861ba23ee4a8388f6aaf54e56dda5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7d861ba23ee4a8388f6aaf54e56dda5 (127.28.155.193). New cstate: current_term: 1 leader_uuid: "f7d861ba23ee4a8388f6aaf54e56dda5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64b86d10d22244c68c336b05c14b49b8" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6983edde4d1746dbb5beab6bfb34deb5" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 46461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7d861ba23ee4a8388f6aaf54e56dda5" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 41465 } health_report { overall_health: HEALTHY } } }
Aug 09 13:02:37 dist-test-slave-jq4t krb5kdc[30123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280554, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.193@KRBTEST.COM
I20260809 13:02:37.480458 30923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:37.465083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45242 (local address 127.28.155.193:41465)
0809 13:02:37.465384 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:37.465393 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:37.465780 (+ 387us) server_negotiation.cc:407] Connection header received
0809 13:02:37.465921 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:37.465925 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:37.466013 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:37.466113 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:37.467651 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.468523 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.469982 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.470380 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.470476 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:37.474857 (+ 4381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:37.474875 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:37.474893 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:37.474968 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:37.477862 (+ 2894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:37.478507 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:37.478514 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:37.478516 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:37.478677 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:37.479018 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:37.479022 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:37.479024 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:37.479379 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:37.479626 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:37.479861 (+ 235us) server_negotiation.cc:299] Negotiation successful
0809 13:02:37.480087 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
Aug 09 13:02:37 dist-test-slave-jq4t krb5kdc[30123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280557, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 13:02:37 dist-test-slave-jq4t krb5kdc[30123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280557, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.28.155.193@KRBTEST.COM
I20260809 13:02:37.534982 30923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:37.519655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45254 (local address 127.28.155.193:41465)
0809 13:02:37.519918 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:37.519926 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:37.520225 (+ 299us) server_negotiation.cc:407] Connection header received
0809 13:02:37.520462 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:37.520466 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:37.520594 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:37.520706 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:37.522209 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.523004 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.524369 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.524901 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.525052 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:37.529229 (+ 4177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:37.529235 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:37.529238 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:37.529275 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:37.532066 (+ 2791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:37.532815 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:37.532820 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:37.532826 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:37.532981 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:37.533397 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:37.533404 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:37.533412 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:37.533696 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:37.534039 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:37.534329 (+ 290us) server_negotiation.cc:299] Negotiation successful
0809 13:02:37.534583 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
Aug 09 13:02:37 dist-test-slave-jq4t krb5kdc[30123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280557, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 13:02:37 dist-test-slave-jq4t krb5kdc[30123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280557, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.193@KRBTEST.COM
I20260809 13:02:37.591059 30923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:37.576099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45268 (local address 127.28.155.193:41465)
0809 13:02:37.576377 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:37.576386 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:37.576625 (+ 239us) server_negotiation.cc:407] Connection header received
0809 13:02:37.576804 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:37.576809 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:37.576900 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:37.576992 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:37.578435 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.579240 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.580601 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.581050 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.581154 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:37.585422 (+ 4268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:37.585428 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:37.585432 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:37.585474 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:37.588170 (+ 2696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:37.588936 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:37.588942 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:37.588948 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:37.589103 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:37.589516 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:37.589520 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:37.589522 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:37.589822 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:37.590117 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:37.590428 (+ 311us) server_negotiation.cc:299] Negotiation successful
0809 13:02:37.590689 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
W20260809 13:02:37.593132 30361 tablet_service.cc:2908] Rejecting scan request for tablet 9d72127275974d7098042f201103566f: Uninitialized: clean time has not yet been initialized
I20260809 13:02:37.596467 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 30285
I20260809 13:02:37.610813 30923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:37.597851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45282 (local address 127.28.155.193:41465)
0809 13:02:37.598025 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:37.598033 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:37.598074 (+ 41us) server_negotiation.cc:407] Connection header received
0809 13:02:37.598337 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:37.598352 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:37.598438 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:37.598550 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:37.599826 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.601069 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.602297 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.603020 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.603145 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:37.605608 (+ 2463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:37.605613 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:37.605617 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:37.605652 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:37.608283 (+ 2631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:37.609025 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:37.609030 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:37.609033 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:37.609185 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:37.609527 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:37.609530 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:37.609532 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:37.609816 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:37.610032 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:37.610308 (+ 276us) server_negotiation.cc:299] Negotiation successful
0809 13:02:37.610537 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 13:02:37.611629 30481 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:02:37.707041 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 30285
I20260809 13:02:37.734431 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 30498
Aug 09 13:02:37 dist-test-slave-jq4t krb5kdc[30123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280557, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.194@KRBTEST.COM
I20260809 13:02:37.751945 30921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:37.735530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57384 (local address 127.28.155.194:46461)
0809 13:02:37.735757 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:37.735763 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:37.735784 (+ 21us) server_negotiation.cc:407] Connection header received
0809 13:02:37.735885 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:37.735892 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:37.735993 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:37.736118 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:37.737603 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.738668 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.740060 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.740656 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.740804 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:37.745417 (+ 4613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:37.745443 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:37.745460 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:37.745504 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:37.748892 (+ 3388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:37.749615 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:37.749624 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:37.749627 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:37.749777 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:37.750212 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:37.750218 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:37.750223 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:37.750648 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:37.751053 (+ 405us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:37.751340 (+ 287us) server_negotiation.cc:299] Negotiation successful
0809 13:02:37.751590 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 13:02:37.752918 30691 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:02:37.845536 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 30498
I20260809 13:02:37.874601 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 30708
Aug 09 13:02:37 dist-test-slave-jq4t krb5kdc[30123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280557, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.195@KRBTEST.COM
I20260809 13:02:37.890050 30918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:37.875617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53596 (local address 127.28.155.195:43697)
0809 13:02:37.875785 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:37.875790 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:37.875810 (+ 20us) server_negotiation.cc:407] Connection header received
0809 13:02:37.875986 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:37.875991 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:37.876062 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:37.876160 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:37.877570 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.878339 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.879642 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:37.880050 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:37.880150 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:37.884368 (+ 4218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:37.884386 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:37.884404 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:37.884442 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:37.887394 (+ 2952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:37.888077 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:37.888085 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:37.888087 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:37.888223 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:37.888628 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:37.888632 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:37.888634 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:37.889016 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:37.889259 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:37.889483 (+ 224us) server_negotiation.cc:299] Negotiation successful
0809 13:02:37.889661 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 13:02:37.890786 30891 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:02:37.983206 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 30708
I20260809 13:02:38.012686 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 30147
I20260809 13:02:38.014092 30237 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:02:38.133584 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 30147
2026-08-09T13:02:38Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4746 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:02:38 dist-test-slave-jq4t krb5kdc[30973](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:02:38 dist-test-slave-jq4t krb5kdc[30973](info): set up 2 sockets
Aug 09 13:02:38 dist-test-slave-jq4t krb5kdc[30973](info): commencing operation
krb5kdc: starting...
W20260809 13:02:39.437855 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.248s user 0.000s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:02:39 dist-test-slave-jq4t krb5kdc[30973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:02:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:02:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
I20260809 13:02:39.664459 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:45179
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:35931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:45179
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:02:40.028251 30996 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:02:40.028694 30996 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:02:40.028877 30996 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:02:40.036594 30996 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:02:40.036734 30996 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 13:02:40.036819 30996 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:02:40.036938 30996 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:02:40.037024 30996 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:02:40.037134 30996 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:02:40.048281 30996 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:35931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:45179
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:45179
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:02:40.049861 30996 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:02:40.051368 30996 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:02:40.064536 31005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:40.064608 31006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:40.064638 31008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:02:40.065618 30996 server_base.cc:1034] running on GCE node
I20260809 13:02:40.066555 30996 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:02:40.068095 30996 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:02:40.069360 30996 hybrid_clock.cc:648] HybridClock initialized: now 1786280560069304 us; error 59 us; skew 500 ppm
I20260809 13:02:40.069730 30996 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:02:40 dist-test-slave-jq4t krb5kdc[30973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280560, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:02:40.073318 30996 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:02:40.074994 30996 webserver.cc:460] Webserver started at http://127.28.155.254:33197/ using document root <none> and password file <none>
I20260809 13:02:40.075780 30996 fs_manager.cc:359] Metadata directory not provided
I20260809 13:02:40.075932 30996 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:02:40.076290 30996 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:02:40.079537 30996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "4c6b37c34f834e44b0e4cc60b0aadf01"
format_stamp: "Formatted at 2026-08-09 13:02:40 on dist-test-slave-jq4t"
server_key: "d23e80ed517c5cbd2a23d43eb6c1340d"
server_key_iv: "9d8beafd5850eff022acdfeaf1f390a5"
server_key_version: "encryptionkey@0"
I20260809 13:02:40.080353 30996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "4c6b37c34f834e44b0e4cc60b0aadf01"
format_stamp: "Formatted at 2026-08-09 13:02:40 on dist-test-slave-jq4t"
server_key: "d23e80ed517c5cbd2a23d43eb6c1340d"
server_key_iv: "9d8beafd5850eff022acdfeaf1f390a5"
server_key_version: "encryptionkey@0"
I20260809 13:02:40.086009 30996 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 13:02:40.089756 31019 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:40.091291 30996 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 13:02:40.091506 30996 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "4c6b37c34f834e44b0e4cc60b0aadf01"
format_stamp: "Formatted at 2026-08-09 13:02:40 on dist-test-slave-jq4t"
server_key: "d23e80ed517c5cbd2a23d43eb6c1340d"
server_key_iv: "9d8beafd5850eff022acdfeaf1f390a5"
server_key_version: "encryptionkey@0"
I20260809 13:02:40.091749 30996 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:02:40.109472 30996 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:02:40.113895 30996 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:02:40.114212 30996 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:02:40.138235 30996 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:45179
I20260809 13:02:40.138255 31104 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:45179 every 8 connection(s)
I20260809 13:02:40.139731 30996 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:02:40.143858 31106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:40.148428 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 30996
I20260809 13:02:40.148716 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:02:40.149612 29295 external_mini_cluster.cc:1428] Setting key f814aac77b5676970009fe149ceb1e27
I20260809 13:02:40.156556 31106 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c6b37c34f834e44b0e4cc60b0aadf01: Bootstrap starting.
I20260809 13:02:40.160496 31106 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c6b37c34f834e44b0e4cc60b0aadf01: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:40.161780 31106 log.cc:824] T 00000000000000000000000000000000 P 4c6b37c34f834e44b0e4cc60b0aadf01: Log is configured to *not* fsync() on all Append() calls
Aug 09 13:02:40 dist-test-slave-jq4t krb5kdc[30973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:02:40.165612 31106 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c6b37c34f834e44b0e4cc60b0aadf01: No bootstrap required, opened a new log
I20260809 13:02:40.176380 31110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:40.151825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38980 (local address 127.28.155.254:45179)
0809 13:02:40.152702 (+ 877us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:40.152715 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:40.152764 (+ 49us) server_negotiation.cc:407] Connection header received
0809 13:02:40.154857 (+ 2093us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:40.154881 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:40.155288 (+ 407us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:40.155616 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:40.157580 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:40.158926 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:40.160824 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:40.161590 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:40.161747 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:40.166680 (+ 4933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:40.166692 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:40.166714 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:40.166771 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:40.171244 (+ 4473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:40.172054 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:40.172064 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:40.172072 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:40.172312 (+ 240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:40.172815 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:40.172821 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:40.172825 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:40.173646 (+ 821us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:40.173991 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:40.174322 (+ 331us) server_negotiation.cc:299] Negotiation successful
0809 13:02:40.174838 (+ 516us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":648,"thread_start_us":409,"threads_started":1}
I20260809 13:02:40.177527 31106 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c6b37c34f834e44b0e4cc60b0aadf01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c6b37c34f834e44b0e4cc60b0aadf01" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 45179 } }
I20260809 13:02:40.178021 31106 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4c6b37c34f834e44b0e4cc60b0aadf01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:40.178169 31106 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c6b37c34f834e44b0e4cc60b0aadf01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c6b37c34f834e44b0e4cc60b0aadf01, State: Initialized, Role: FOLLOWER
I20260809 13:02:40.178767 31106 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c6b37c34f834e44b0e4cc60b0aadf01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c6b37c34f834e44b0e4cc60b0aadf01" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 45179 } }
I20260809 13:02:40.179031 31106 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4c6b37c34f834e44b0e4cc60b0aadf01 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:02:40.179183 31106 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c6b37c34f834e44b0e4cc60b0aadf01 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:02:40.179385 31106 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c6b37c34f834e44b0e4cc60b0aadf01 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:40.181879 31106 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c6b37c34f834e44b0e4cc60b0aadf01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c6b37c34f834e44b0e4cc60b0aadf01" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 45179 } }
I20260809 13:02:40.182425 31106 leader_election.cc:302] T 00000000000000000000000000000000 P 4c6b37c34f834e44b0e4cc60b0aadf01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c6b37c34f834e44b0e4cc60b0aadf01; no voters:
I20260809 13:02:40.183272 31106 leader_election.cc:288] T 00000000000000000000000000000000 P 4c6b37c34f834e44b0e4cc60b0aadf01 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:02:40.183384 31113 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c6b37c34f834e44b0e4cc60b0aadf01 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:02:40.184252 31113 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4c6b37c34f834e44b0e4cc60b0aadf01 [term 1 LEADER]: Becoming Leader. State: Replica: 4c6b37c34f834e44b0e4cc60b0aadf01, State: Running, Role: LEADER
I20260809 13:02:40.184854 31113 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c6b37c34f834e44b0e4cc60b0aadf01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c6b37c34f834e44b0e4cc60b0aadf01" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 45179 } }
I20260809 13:02:40.185647 31106 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c6b37c34f834e44b0e4cc60b0aadf01 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:02:40.187683 31115 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c6b37c34f834e44b0e4cc60b0aadf01 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c6b37c34f834e44b0e4cc60b0aadf01. Latest consensus state: current_term: 1 leader_uuid: "4c6b37c34f834e44b0e4cc60b0aadf01" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c6b37c34f834e44b0e4cc60b0aadf01" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 45179 } } }
I20260809 13:02:40.188265 31114 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c6b37c34f834e44b0e4cc60b0aadf01 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4c6b37c34f834e44b0e4cc60b0aadf01" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c6b37c34f834e44b0e4cc60b0aadf01" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 45179 } } }
I20260809 13:02:40.188587 31114 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c6b37c34f834e44b0e4cc60b0aadf01 [sys.catalog]: This master's current role is: LEADER
I20260809 13:02:40.188891 31115 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c6b37c34f834e44b0e4cc60b0aadf01 [sys.catalog]: This master's current role is: LEADER
I20260809 13:02:40.190294 31121 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:02:40.196583 31121 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:02:40.205757 31121 catalog_manager.cc:1347] Generated new cluster ID: d7acd236662146d4af747e05e998b618
I20260809 13:02:40.205919 31121 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:02:40.218746 31121 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:02:40.220821 31121 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:02:40.233246 31121 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4c6b37c34f834e44b0e4cc60b0aadf01: Generated new TSK 0
I20260809 13:02:40.234376 31121 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
I20260809 13:02:40.300225 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:0
--local_ip_for_outbound_sockets=127.28.155.193
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:45179
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:35931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:02:40.661554 31146 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:02:40.661854 31146 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:02:40.662027 31146 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:02:40.669617 31146 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:02:40.669761 31146 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:02:40.669925 31146 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 13:02:40.670020 31146 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:02:40.680724 31146 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:35931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.28.155.254:45179
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:02:40.682168 31146 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:02:40.683599 31146 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:02:40.698083 31152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:40.698088 31156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:40.698119 31154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:02:40.698982 31146 server_base.cc:1034] running on GCE node
I20260809 13:02:40.699563 31146 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:02:40.700443 31146 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:02:40.701731 31146 hybrid_clock.cc:648] HybridClock initialized: now 1786280560701654 us; error 47 us; skew 500 ppm
I20260809 13:02:40.702041 31146 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:02:40 dist-test-slave-jq4t krb5kdc[30973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280560, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:02:40.714242 31146 init.cc:377] Logged in from keytab as kudu/127.28.155.193@KRBTEST.COM (short username kudu)
I20260809 13:02:40.715890 31146 webserver.cc:460] Webserver started at http://127.28.155.193:44109/ using document root <none> and password file <none>
I20260809 13:02:40.716774 31146 fs_manager.cc:359] Metadata directory not provided
I20260809 13:02:40.716917 31146 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:02:40.717272 31146 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:02:40.720355 31146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-0/data/instance:
uuid: "aea98063dbf84d1cb1c6f455f2afba8f"
format_stamp: "Formatted at 2026-08-09 13:02:40 on dist-test-slave-jq4t"
server_key: "90f25cc0a05169b98789fcd35bf87b82"
server_key_iv: "ab5e106a2943a05fee93380ddeb8aa80"
server_key_version: "encryptionkey@0"
I20260809 13:02:40.721266 31146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance:
uuid: "aea98063dbf84d1cb1c6f455f2afba8f"
format_stamp: "Formatted at 2026-08-09 13:02:40 on dist-test-slave-jq4t"
server_key: "90f25cc0a05169b98789fcd35bf87b82"
server_key_iv: "ab5e106a2943a05fee93380ddeb8aa80"
server_key_version: "encryptionkey@0"
I20260809 13:02:40.726948 31146 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 13:02:40.730580 31166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:40.731935 31146 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 13:02:40.732123 31146 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "aea98063dbf84d1cb1c6f455f2afba8f"
format_stamp: "Formatted at 2026-08-09 13:02:40 on dist-test-slave-jq4t"
server_key: "90f25cc0a05169b98789fcd35bf87b82"
server_key_iv: "ab5e106a2943a05fee93380ddeb8aa80"
server_key_version: "encryptionkey@0"
I20260809 13:02:40.732375 31146 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:02:40.761751 31146 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:02:40.766682 31146 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:02:40.767004 31146 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:02:40.770093 31146 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:02:40.770226 31146 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:40.770401 31146 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:02:40.770572 31146 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 09 13:02:40 dist-test-slave-jq4t krb5kdc[30973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280560, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:02:40.795013 31180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:40.770649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:43863 (local address 127.28.155.254:45179)
0809 13:02:40.771228 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:40.771235 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:40.772416 (+ 1181us) server_negotiation.cc:407] Connection header received
0809 13:02:40.774594 (+ 2178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:40.774600 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:40.774695 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:40.774826 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:40.777330 (+ 2504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:40.778386 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:40.781307 (+ 2921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:40.781924 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:40.782074 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:40.787545 (+ 5471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:40.787552 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:40.787557 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:40.787600 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:40.790511 (+ 2911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:40.791385 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:40.791391 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:40.791398 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:40.791616 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:40.792219 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:40.792227 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:40.792232 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:40.792625 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:40.792870 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:40.794206 (+ 1336us) server_negotiation.cc:299] Negotiation successful
0809 13:02:40.794519 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":304,"threads_started":1}
I20260809 13:02:40.797149 31185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:40.771259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:45179 (local address 127.28.155.193:43863)
0809 13:02:40.772214 (+ 955us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:40.772270 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:40.774278 (+ 2008us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:40.775156 (+ 878us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:40.775167 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:40.775989 (+ 822us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:02:40.777025 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:40.777058 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:40.778604 (+ 1546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:40.778611 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:40.781131 (+ 2520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:40.781149 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:40.782206 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:40.782218 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:40.782568 (+ 350us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:40.783477 (+ 909us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:02:40.783503 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:02:40.787262 (+ 3759us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:02:40.790661 (+ 3399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:40.790670 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:40.790686 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:40.791220 (+ 534us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:40.791780 (+ 560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:40.791786 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:40.791790 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:40.792093 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:40.792924 (+ 831us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:02:40.792936 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:02:40.793623 (+ 687us) client_negotiation.cc:769] Sending connection context
0809 13:02:40.794067 (+ 444us) client_negotiation.cc:240] Negotiation successful
0809 13:02:40.794842 (+ 775us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":663,"thread_start_us":413,"threads_started":1}
I20260809 13:02:40.820406 31180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:40.803738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:57027 (local address 127.28.155.254:45179)
0809 13:02:40.803952 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:40.803961 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:40.804831 (+ 870us) server_negotiation.cc:407] Connection header received
0809 13:02:40.805073 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:40.805079 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:40.805202 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:40.805322 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:40.806960 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:40.807666 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:40.810289 (+ 2623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:40.811133 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:40.811288 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:40.813664 (+ 2376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:40.813669 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:40.813672 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:40.813705 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:40.816845 (+ 3140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:40.818129 (+ 1284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:40.818136 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:40.818142 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:40.818313 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:40.818761 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:40.818764 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:40.818766 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:40.819070 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:40.819199 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:40.819888 (+ 689us) server_negotiation.cc:299] Negotiation successful
0809 13:02:40.820162 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 13:02:40.820889 31266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:40.803834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:45179 (local address 127.28.155.193:57027)
0809 13:02:40.804699 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:40.804727 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:40.804914 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:40.805391 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:40.805398 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:40.806225 (+ 827us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:02:40.806753 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:40.806773 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:40.807809 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:40.807818 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:40.810104 (+ 2286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:40.810133 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:40.811368 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:40.811375 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:40.811555 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:40.812246 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:02:40.812264 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:02:40.813443 (+ 1179us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:02:40.817036 (+ 3593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:40.817042 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:40.817050 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:40.817947 (+ 897us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:40.818442 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:40.818447 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:40.818450 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:40.818636 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:40.819193 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:02:40.819198 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:02:40.819488 (+ 290us) client_negotiation.cc:769] Sending connection context
0809 13:02:40.819690 (+ 202us) client_negotiation.cc:240] Negotiation successful
0809 13:02:40.820179 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":661,"thread_start_us":460,"threads_started":1}
I20260809 13:02:40.831650 31146 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:46873
I20260809 13:02:40.831670 31343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:46873 every 8 connection(s)
I20260809 13:02:40.832991 31146 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:02:40.835430 31345 heartbeater.cc:347] Connected to a master server at 127.28.155.254:45179
I20260809 13:02:40.835680 31345 heartbeater.cc:464] Registering TS with master...
I20260809 13:02:40.836503 31345 heartbeater.cc:511] Master 127.28.155.254:45179 requested a full tablet report, sending...
I20260809 13:02:40.836654 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 31146
I20260809 13:02:40.836905 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance
I20260809 13:02:40.837641 29295 external_mini_cluster.cc:1428] Setting key bad876ea8a7b4393ada3d6f971d251a8
I20260809 13:02:40.838937 31042 ts_manager.cc:194] Registered new tserver with Master: aea98063dbf84d1cb1c6f455f2afba8f (127.28.155.193:46873)
I20260809 13:02:40.840600 31042 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.193@KRBTEST.COM'} at 127.28.155.193:43863
WARNING: no policy specified for kudu/127.28.155.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
I20260809 13:02:40.887938 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:0
--local_ip_for_outbound_sockets=127.28.155.194
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:45179
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:35931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:02:41.251703 31352 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:02:41.252198 31352 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:02:41.252434 31352 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:02:41.264235 31352 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:02:41.264398 31352 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:02:41.264602 31352 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 13:02:41.264760 31352 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:02:41.280283 31352 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:35931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.28.155.254:45179
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:02:41.282408 31352 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:02:41.284624 31352 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:02:41.302539 31360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:41.302570 31358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:41.302768 31364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:02:41.303704 31352 server_base.cc:1034] running on GCE node
I20260809 13:02:41.304373 31352 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:02:41.305387 31352 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:02:41.306630 31352 hybrid_clock.cc:648] HybridClock initialized: now 1786280561306560 us; error 31 us; skew 500 ppm
I20260809 13:02:41.306954 31352 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:02:41 dist-test-slave-jq4t krb5kdc[30973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280561, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:02:41.310303 31352 init.cc:377] Logged in from keytab as kudu/127.28.155.194@KRBTEST.COM (short username kudu)
I20260809 13:02:41.311918 31352 webserver.cc:460] Webserver started at http://127.28.155.194:34817/ using document root <none> and password file <none>
I20260809 13:02:41.312780 31352 fs_manager.cc:359] Metadata directory not provided
I20260809 13:02:41.312886 31352 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:02:41.313186 31352 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:02:41.316289 31352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-1/data/instance:
uuid: "cd053217f1c84d43a496413b422b9ed1"
format_stamp: "Formatted at 2026-08-09 13:02:41 on dist-test-slave-jq4t"
server_key: "e67678e029ab48a43e65506cb883b517"
server_key_iv: "3dcd2735cea5f4418732a5ee2db7bbee"
server_key_version: "encryptionkey@0"
I20260809 13:02:41.317204 31352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance:
uuid: "cd053217f1c84d43a496413b422b9ed1"
format_stamp: "Formatted at 2026-08-09 13:02:41 on dist-test-slave-jq4t"
server_key: "e67678e029ab48a43e65506cb883b517"
server_key_iv: "3dcd2735cea5f4418732a5ee2db7bbee"
server_key_version: "encryptionkey@0"
I20260809 13:02:41.322839 31352 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 13:02:41.326759 31373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:41.328272 31352 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 13:02:41.328526 31352 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "cd053217f1c84d43a496413b422b9ed1"
format_stamp: "Formatted at 2026-08-09 13:02:41 on dist-test-slave-jq4t"
server_key: "e67678e029ab48a43e65506cb883b517"
server_key_iv: "3dcd2735cea5f4418732a5ee2db7bbee"
server_key_version: "encryptionkey@0"
I20260809 13:02:41.328796 31352 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:02:41.349709 31352 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:02:41.354007 31352 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:02:41.354305 31352 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:02:41.357344 31352 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:02:41.357434 31352 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:41.357586 31352 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:02:41.357683 31352 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 13:02:41 dist-test-slave-jq4t krb5kdc[30973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280561, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:02:41.383584 31388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:41.357836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:49013 (local address 127.28.155.254:45179)
0809 13:02:41.358714 (+ 878us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:41.358721 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:41.359767 (+ 1046us) server_negotiation.cc:407] Connection header received
0809 13:02:41.362143 (+ 2376us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:41.362149 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:41.362248 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:41.362372 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:41.364789 (+ 2417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:41.365912 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:41.369188 (+ 3276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:41.369629 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:41.369781 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:41.374733 (+ 4952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:41.374741 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:41.374749 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:41.374801 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:41.378367 (+ 3566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:41.379746 (+ 1379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:41.379752 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:41.379756 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:41.379950 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:41.380623 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:41.380627 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:41.380631 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:41.381127 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:41.381366 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:41.382604 (+ 1238us) server_negotiation.cc:299] Negotiation successful
0809 13:02:41.382993 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":740,"thread_start_us":610,"threads_started":1}
I20260809 13:02:41.384727 31389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:41.358611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:45179 (local address 127.28.155.194:49013)
0809 13:02:41.359564 (+ 953us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:41.359617 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:41.361820 (+ 2203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:41.362642 (+ 822us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:41.362650 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:41.363435 (+ 785us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:02:41.364468 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:41.364532 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:41.366106 (+ 1574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:41.366110 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:41.368746 (+ 2636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:41.368770 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:41.369892 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:41.369901 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:41.370134 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:41.370921 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:02:41.370944 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:02:41.374324 (+ 3380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:02:41.378600 (+ 4276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:41.378612 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:41.378636 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:41.379505 (+ 869us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:41.380092 (+ 587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:41.380097 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:41.380102 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:41.380431 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:41.381354 (+ 923us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:02:41.381395 (+ 41us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:02:41.382018 (+ 623us) client_negotiation.cc:769] Sending connection context
0809 13:02:41.382424 (+ 406us) client_negotiation.cc:240] Negotiation successful
0809 13:02:41.383022 (+ 598us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":658,"thread_start_us":433,"threads_started":1}
I20260809 13:02:41.407470 31388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:41.391936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:45531 (local address 127.28.155.254:45179)
0809 13:02:41.392141 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:41.392149 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:41.393036 (+ 887us) server_negotiation.cc:407] Connection header received
0809 13:02:41.393251 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:41.393257 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:41.393335 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:41.393443 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:41.394407 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:41.395273 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:41.396888 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:41.397535 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:41.397719 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:41.400760 (+ 3041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:41.400765 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:41.400768 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:41.400803 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:41.404569 (+ 3766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:41.405315 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:41.405321 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:41.405324 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:41.405460 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:41.405860 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:41.405865 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:41.405869 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:41.406257 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:41.406420 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:41.406858 (+ 438us) server_negotiation.cc:299] Negotiation successful
0809 13:02:41.407104 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 13:02:41.407742 31476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:41.392063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:45179 (local address 127.28.155.194:45531)
0809 13:02:41.392925 (+ 862us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:41.392941 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:41.393111 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:41.393468 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:41.393473 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:41.393950 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:02:41.394256 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:41.394265 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:41.395411 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:41.395416 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:41.396740 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:41.396753 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:41.397813 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:41.397826 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:41.398157 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:41.399040 (+ 883us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:02:41.399071 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:02:41.400441 (+ 1370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:02:41.404723 (+ 4282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:41.404732 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:41.404737 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:41.405175 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:41.405587 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:41.405592 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:41.405596 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:41.405739 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:41.406383 (+ 644us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:02:41.406387 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:02:41.406592 (+ 205us) client_negotiation.cc:769] Sending connection context
0809 13:02:41.406733 (+ 141us) client_negotiation.cc:240] Negotiation successful
0809 13:02:41.407129 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":711,"thread_start_us":466,"threads_started":1}
I20260809 13:02:41.421710 31352 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:35203
I20260809 13:02:41.421732 31574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:35203 every 8 connection(s)
I20260809 13:02:41.423029 31352 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:02:41.425276 31575 heartbeater.cc:347] Connected to a master server at 127.28.155.254:45179
I20260809 13:02:41.425531 31575 heartbeater.cc:464] Registering TS with master...
I20260809 13:02:41.426332 31575 heartbeater.cc:511] Master 127.28.155.254:45179 requested a full tablet report, sending...
I20260809 13:02:41.426935 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 31352
I20260809 13:02:41.427269 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance
I20260809 13:02:41.427759 29295 external_mini_cluster.cc:1428] Setting key cc5c52ca0381628e144f7a4692a99f3d
I20260809 13:02:41.428010 31042 ts_manager.cc:194] Registered new tserver with Master: cd053217f1c84d43a496413b422b9ed1 (127.28.155.194:35203)
I20260809 13:02:41.429206 31042 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.194@KRBTEST.COM'} at 127.28.155.194:49013
WARNING: no policy specified for kudu/127.28.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
I20260809 13:02:41.476125 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:0
--local_ip_for_outbound_sockets=127.28.155.195
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:45179
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:35931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:02:41.828351 31579 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:02:41.828734 31579 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:02:41.828910 31579 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:02:41.837221 31579 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:02:41.837348 31579 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:02:41.837534 31579 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 13:02:41.837697 31579 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:02:41.843343 31345 heartbeater.cc:503] Master 127.28.155.254:45179 was elected leader, sending a full tablet report...
I20260809 13:02:41.848668 31579 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:35931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.28.155.254:45179
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:02:41.850147 31579 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:02:41.851637 31579 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:02:41.865998 31590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:41.866446 31585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:41.865918 31587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:02:41.867712 31579 server_base.cc:1034] running on GCE node
I20260809 13:02:41.868427 31579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:02:41.869537 31579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:02:41.870843 31579 hybrid_clock.cc:648] HybridClock initialized: now 1786280561870742 us; error 40 us; skew 500 ppm
I20260809 13:02:41.871191 31579 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:02:41 dist-test-slave-jq4t krb5kdc[30973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280561, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:02:41.874691 31579 init.cc:377] Logged in from keytab as kudu/127.28.155.195@KRBTEST.COM (short username kudu)
I20260809 13:02:41.876245 31579 webserver.cc:460] Webserver started at http://127.28.155.195:37653/ using document root <none> and password file <none>
I20260809 13:02:41.877061 31579 fs_manager.cc:359] Metadata directory not provided
I20260809 13:02:41.877203 31579 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:02:41.877573 31579 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:02:41.880760 31579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-2/data/instance:
uuid: "0473bbb7cf2d4c13bafb6bd19d529c11"
format_stamp: "Formatted at 2026-08-09 13:02:41 on dist-test-slave-jq4t"
server_key: "14c95e71031d8075e99896948603b93e"
server_key_iv: "83c8d1f683637f85575df6d26b7bd1a3"
server_key_version: "encryptionkey@0"
I20260809 13:02:41.881645 31579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance:
uuid: "0473bbb7cf2d4c13bafb6bd19d529c11"
format_stamp: "Formatted at 2026-08-09 13:02:41 on dist-test-slave-jq4t"
server_key: "14c95e71031d8075e99896948603b93e"
server_key_iv: "83c8d1f683637f85575df6d26b7bd1a3"
server_key_version: "encryptionkey@0"
I20260809 13:02:41.887615 31579 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260809 13:02:41.891391 31600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:41.892962 31579 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:02:41.893103 31579 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "0473bbb7cf2d4c13bafb6bd19d529c11"
format_stamp: "Formatted at 2026-08-09 13:02:41 on dist-test-slave-jq4t"
server_key: "14c95e71031d8075e99896948603b93e"
server_key_iv: "83c8d1f683637f85575df6d26b7bd1a3"
server_key_version: "encryptionkey@0"
I20260809 13:02:41.893297 31579 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:02:41.906313 31579 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:02:41.911090 31579 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:02:41.911335 31579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:02:41.914660 31579 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:02:41.914778 31579 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:41.914980 31579 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:02:41.915102 31579 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 13:02:41 dist-test-slave-jq4t krb5kdc[30973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280561, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:02:41.939316 31610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:41.914620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:33771 (local address 127.28.155.254:45179)
0809 13:02:41.915242 (+ 622us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:41.915249 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:41.916401 (+ 1152us) server_negotiation.cc:407] Connection header received
0809 13:02:41.918712 (+ 2311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:41.918721 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:41.918830 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:41.918972 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:41.921073 (+ 2101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:41.922215 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:41.925017 (+ 2802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:41.925691 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:41.925839 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:41.931005 (+ 5166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:41.931010 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:41.931013 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:41.931058 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:41.934713 (+ 3655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:41.935992 (+ 1279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:41.935996 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:41.935999 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:41.936152 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:41.936897 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:41.936902 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:41.936905 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:41.937371 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:41.937533 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:41.938592 (+ 1059us) server_negotiation.cc:299] Negotiation successful
0809 13:02:41.938848 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":301,"threads_started":1}
I20260809 13:02:41.940436 31612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:41.915265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:45179 (local address 127.28.155.195:33771)
0809 13:02:41.916204 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:41.916264 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:41.918402 (+ 2138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:41.919204 (+ 802us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:41.919213 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:41.919789 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:02:41.920801 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:41.920836 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:41.922385 (+ 1549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:41.922394 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:41.924858 (+ 2464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:41.924880 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:41.925975 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:41.925984 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:41.926208 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:41.927063 (+ 855us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:02:41.927088 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:02:41.930718 (+ 3630us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:02:41.934925 (+ 4207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:41.934940 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:41.934977 (+ 37us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:41.935830 (+ 853us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:41.936286 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:41.936295 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:41.936305 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:41.936725 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:41.937515 (+ 790us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:02:41.937523 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:02:41.938162 (+ 639us) client_negotiation.cc:769] Sending connection context
0809 13:02:41.938480 (+ 318us) client_negotiation.cc:240] Negotiation successful
0809 13:02:41.939105 (+ 625us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":643,"thread_start_us":433,"threads_started":1}
I20260809 13:02:41.962641 31610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:41.946901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:48463 (local address 127.28.155.254:45179)
0809 13:02:41.947179 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:41.947190 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:41.947757 (+ 567us) server_negotiation.cc:407] Connection header received
0809 13:02:41.947938 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:41.947946 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:41.948029 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:41.948145 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:41.949575 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:41.950938 (+ 1363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:41.953098 (+ 2160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:41.953561 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:41.953713 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:41.955680 (+ 1967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:41.955684 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:41.955687 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:41.955720 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:41.959347 (+ 3627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:41.960276 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:41.960284 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:41.960288 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:41.960436 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:41.961012 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:41.961020 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:41.961025 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:41.961379 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:41.961562 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:41.961975 (+ 413us) server_negotiation.cc:299] Negotiation successful
0809 13:02:41.962243 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260809 13:02:41.962750 31697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:41.946928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:45179 (local address 127.28.155.195:48463)
0809 13:02:41.947636 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:41.947657 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:41.947796 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:41.948175 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:41.948180 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:41.948901 (+ 721us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:02:41.949385 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:41.949407 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:41.951127 (+ 1720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:41.951134 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:41.952895 (+ 1761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:41.952908 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:41.953769 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:41.953776 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:41.953948 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:41.954674 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:02:41.954692 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:02:41.955460 (+ 768us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:02:41.959489 (+ 4029us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:41.959494 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:41.959499 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:41.960156 (+ 657us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:41.960617 (+ 461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:41.960626 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:41.960633 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:41.960841 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:41.961512 (+ 671us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:02:41.961519 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:02:41.961726 (+ 207us) client_negotiation.cc:769] Sending connection context
0809 13:02:41.961879 (+ 153us) client_negotiation.cc:240] Negotiation successful
0809 13:02:41.962276 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":388,"threads_started":1}
I20260809 13:02:41.974412 31579 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:44761
I20260809 13:02:41.974432 31774 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:44761 every 8 connection(s)
I20260809 13:02:41.975749 31579 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:02:41.978242 31775 heartbeater.cc:347] Connected to a master server at 127.28.155.254:45179
I20260809 13:02:41.978509 31775 heartbeater.cc:464] Registering TS with master...
I20260809 13:02:41.978786 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 31579
I20260809 13:02:41.978988 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance
I20260809 13:02:41.979329 31775 heartbeater.cc:511] Master 127.28.155.254:45179 requested a full tablet report, sending...
I20260809 13:02:41.979496 29295 external_mini_cluster.cc:1428] Setting key 3ee3745b2937aa5fc3b2bcbeac299314
I20260809 13:02:41.981189 31042 ts_manager.cc:194] Registered new tserver with Master: 0473bbb7cf2d4c13bafb6bd19d529c11 (127.28.155.195:44761)
I20260809 13:02:41.982241 31042 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.195@KRBTEST.COM'} at 127.28.155.195:33771
I20260809 13:02:41.982997 29295 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 13:02:42 dist-test-slave-jq4t krb5kdc[30973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280562, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 13:02:42 dist-test-slave-jq4t krb5kdc[30973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280562, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:02:42.042142 31610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:42.026252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38984 (local address 127.28.155.254:45179)
0809 13:02:42.026530 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:42.026538 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:42.026687 (+ 149us) server_negotiation.cc:407] Connection header received
0809 13:02:42.026980 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:42.026985 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:42.027059 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:42.027209 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:42.028998 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.029835 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.031315 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.031780 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.031950 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:42.036528 (+ 4578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:42.036537 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:42.036543 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:42.036598 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:42.039292 (+ 2694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:42.040020 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:42.040026 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:42.040030 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:42.040177 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:42.040604 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:42.040609 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:42.040614 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:42.040896 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:42.041192 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:42.041495 (+ 303us) server_negotiation.cc:299] Negotiation successful
0809 13:02:42.041733 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260809 13:02:42.046933 31042 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38984:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 13:02:42.054256 31042 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:02:42.092370 31794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:42.067810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:35203 (local address 127.0.0.1:32876)
0809 13:02:42.079952 (+ 12142us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:42.080034 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:42.080333 (+ 299us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:42.082487 (+ 2154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:42.082494 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:42.082526 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:02:42.083039 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:42.083056 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.085612 (+ 2556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.085618 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:42.089012 (+ 3394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:42.089038 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.091266 (+ 2228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.091276 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:42.091507 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:42.091587 (+ 80us) client_negotiation.cc:769] Sending connection context
0809 13:02:42.091724 (+ 137us) client_negotiation.cc:240] Negotiation successful
0809 13:02:42.091944 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11693,"thread_start_us":14871,"threads_started":1}
I20260809 13:02:42.092732 31792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:42.068050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32876 (local address 127.28.155.194:35203)
0809 13:02:42.081764 (+ 13714us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:42.081774 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:42.081808 (+ 34us) server_negotiation.cc:407] Connection header received
0809 13:02:42.081924 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:42.081936 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:42.082246 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:42.082475 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:02:42.083310 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.085390 (+ 2080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.089305 (+ 3915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.090998 (+ 1693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.091883 (+ 885us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:42.092099 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:42.092181 (+ 82us) server_negotiation.cc:299] Negotiation successful
0809 13:02:42.092380 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13510,"thread_start_us":13346,"threads_started":1}
I20260809 13:02:42.093885 31791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:42.068293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:46873 (local address 127.0.0.1:40052)
0809 13:02:42.081894 (+ 13601us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:42.081920 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:42.082037 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:42.082757 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:42.082762 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:42.082796 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:02:42.083400 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:42.083418 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.086055 (+ 2637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.086064 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:42.089458 (+ 3394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:42.089480 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.092786 (+ 3306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.092887 (+ 101us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:42.093184 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:42.093220 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 13:02:42.093306 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 13:02:42.093465 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13458,"mutex_wait_us":2,"thread_start_us":12225,"threads_started":1}
I20260809 13:02:42.095397 31795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:42.068422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40052 (local address 127.28.155.193:46873)
0809 13:02:42.082242 (+ 13820us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:42.082248 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:42.082276 (+ 28us) server_negotiation.cc:407] Connection header received
0809 13:02:42.082360 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:42.082365 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:42.082523 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:42.082755 (+ 232us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:02:42.083655 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.085823 (+ 2168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.089743 (+ 3920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.091885 (+ 2142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.092218 (+ 333us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:42.093489 (+ 1271us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:42.093570 (+ 81us) server_negotiation.cc:299] Negotiation successful
0809 13:02:42.093771 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13658,"thread_start_us":13443,"threads_started":1}
I20260809 13:02:42.097486 31463 tablet_service.cc:1467] Processing CreateTablet for tablet 4a076d63e32d409aaba3dcaea108af65 (DEFAULT_TABLE table=test-table [id=daeb92d9341940b79c142b40d9af3005]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:02:42.099259 31463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a076d63e32d409aaba3dcaea108af65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:42.099045 31241 tablet_service.cc:1467] Processing CreateTablet for tablet 4a076d63e32d409aaba3dcaea108af65 (DEFAULT_TABLE table=test-table [id=daeb92d9341940b79c142b40d9af3005]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:02:42.100469 31241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a076d63e32d409aaba3dcaea108af65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:42.103003 31796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:42.083263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:44761 (local address 127.0.0.1:51020)
0809 13:02:42.090105 (+ 6842us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:42.090133 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:42.090258 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:42.094869 (+ 4611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:42.094874 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:42.094905 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:02:42.095269 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:42.095282 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.097794 (+ 2512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.097800 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:42.100043 (+ 2243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:42.100061 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.102111 (+ 2050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.102118 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:42.102315 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:42.102362 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 13:02:42.102467 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 13:02:42.102621 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6693,"thread_start_us":7068,"threads_started":1}
I20260809 13:02:42.103826 31798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:42.083681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51020 (local address 127.28.155.195:44761)
0809 13:02:42.093531 (+ 9850us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:42.093540 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:42.093581 (+ 41us) server_negotiation.cc:407] Connection header received
0809 13:02:42.094199 (+ 618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:42.094210 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:42.094631 (+ 421us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:42.094855 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:02:42.095760 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.097608 (+ 1848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.100309 (+ 2701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.101864 (+ 1555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.102082 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:42.102250 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:42.103293 (+ 1043us) server_negotiation.cc:299] Negotiation successful
0809 13:02:42.103488 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9659,"thread_start_us":9453,"threads_started":1}
I20260809 13:02:42.107754 31678 tablet_service.cc:1467] Processing CreateTablet for tablet 4a076d63e32d409aaba3dcaea108af65 (DEFAULT_TABLE table=test-table [id=daeb92d9341940b79c142b40d9af3005]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:02:42.109071 31678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a076d63e32d409aaba3dcaea108af65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:42.117318 31799 tablet_bootstrap.cc:492] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1: Bootstrap starting.
I20260809 13:02:42.121364 31799 tablet_bootstrap.cc:654] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:42.122578 31800 tablet_bootstrap.cc:492] T 4a076d63e32d409aaba3dcaea108af65 P 0473bbb7cf2d4c13bafb6bd19d529c11: Bootstrap starting.
I20260809 13:02:42.122915 31799 log.cc:824] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1: Log is configured to *not* fsync() on all Append() calls
I20260809 13:02:42.128271 31800 tablet_bootstrap.cc:654] T 4a076d63e32d409aaba3dcaea108af65 P 0473bbb7cf2d4c13bafb6bd19d529c11: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:42.129184 31802 tablet_bootstrap.cc:492] T 4a076d63e32d409aaba3dcaea108af65 P aea98063dbf84d1cb1c6f455f2afba8f: Bootstrap starting.
I20260809 13:02:42.129835 31800 log.cc:824] T 4a076d63e32d409aaba3dcaea108af65 P 0473bbb7cf2d4c13bafb6bd19d529c11: Log is configured to *not* fsync() on all Append() calls
I20260809 13:02:42.131417 31799 tablet_bootstrap.cc:492] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1: No bootstrap required, opened a new log
I20260809 13:02:42.131768 31799 ts_tablet_manager.cc:1397] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.008s
I20260809 13:02:42.133194 31802 tablet_bootstrap.cc:654] T 4a076d63e32d409aaba3dcaea108af65 P aea98063dbf84d1cb1c6f455f2afba8f: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:42.134006 31800 tablet_bootstrap.cc:492] T 4a076d63e32d409aaba3dcaea108af65 P 0473bbb7cf2d4c13bafb6bd19d529c11: No bootstrap required, opened a new log
I20260809 13:02:42.134310 31800 ts_tablet_manager.cc:1397] T 4a076d63e32d409aaba3dcaea108af65 P 0473bbb7cf2d4c13bafb6bd19d529c11: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260809 13:02:42.134604 31802 log.cc:824] T 4a076d63e32d409aaba3dcaea108af65 P aea98063dbf84d1cb1c6f455f2afba8f: Log is configured to *not* fsync() on all Append() calls
I20260809 13:02:42.141963 31799 raft_consensus.cc:348] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } }
I20260809 13:02:42.142433 31799 raft_consensus.cc:374] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:42.142551 31799 raft_consensus.cc:729] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd053217f1c84d43a496413b422b9ed1, State: Initialized, Role: FOLLOWER
I20260809 13:02:42.143199 31799 consensus_queue.cc:260] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } }
I20260809 13:02:42.144256 31802 tablet_bootstrap.cc:492] T 4a076d63e32d409aaba3dcaea108af65 P aea98063dbf84d1cb1c6f455f2afba8f: No bootstrap required, opened a new log
I20260809 13:02:42.144596 31802 ts_tablet_manager.cc:1397] T 4a076d63e32d409aaba3dcaea108af65 P aea98063dbf84d1cb1c6f455f2afba8f: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.009s
I20260809 13:02:42.147228 31800 raft_consensus.cc:348] T 4a076d63e32d409aaba3dcaea108af65 P 0473bbb7cf2d4c13bafb6bd19d529c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } }
I20260809 13:02:42.147711 31800 raft_consensus.cc:374] T 4a076d63e32d409aaba3dcaea108af65 P 0473bbb7cf2d4c13bafb6bd19d529c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:42.147830 31800 raft_consensus.cc:729] T 4a076d63e32d409aaba3dcaea108af65 P 0473bbb7cf2d4c13bafb6bd19d529c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473bbb7cf2d4c13bafb6bd19d529c11, State: Initialized, Role: FOLLOWER
I20260809 13:02:42.148592 31800 consensus_queue.cc:260] T 4a076d63e32d409aaba3dcaea108af65 P 0473bbb7cf2d4c13bafb6bd19d529c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } }
I20260809 13:02:42.157109 31800 ts_tablet_manager.cc:1428] T 4a076d63e32d409aaba3dcaea108af65 P 0473bbb7cf2d4c13bafb6bd19d529c11: Time spent starting tablet: real 0.023s user 0.022s sys 0.000s
I20260809 13:02:42.157485 31575 heartbeater.cc:503] Master 127.28.155.254:45179 was elected leader, sending a full tablet report...
I20260809 13:02:42.158087 31799 ts_tablet_manager.cc:1428] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1: Time spent starting tablet: real 0.026s user 0.018s sys 0.008s
I20260809 13:02:42.158649 31775 heartbeater.cc:503] Master 127.28.155.254:45179 was elected leader, sending a full tablet report...
I20260809 13:02:42.158775 31802 raft_consensus.cc:348] T 4a076d63e32d409aaba3dcaea108af65 P aea98063dbf84d1cb1c6f455f2afba8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } }
I20260809 13:02:42.159277 31802 raft_consensus.cc:374] T 4a076d63e32d409aaba3dcaea108af65 P aea98063dbf84d1cb1c6f455f2afba8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:42.159420 31802 raft_consensus.cc:729] T 4a076d63e32d409aaba3dcaea108af65 P aea98063dbf84d1cb1c6f455f2afba8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aea98063dbf84d1cb1c6f455f2afba8f, State: Initialized, Role: FOLLOWER
I20260809 13:02:42.160171 31802 consensus_queue.cc:260] T 4a076d63e32d409aaba3dcaea108af65 P aea98063dbf84d1cb1c6f455f2afba8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } }
I20260809 13:02:42.162312 31802 ts_tablet_manager.cc:1428] T 4a076d63e32d409aaba3dcaea108af65 P aea98063dbf84d1cb1c6f455f2afba8f: Time spent starting tablet: real 0.018s user 0.015s sys 0.001s
W20260809 13:02:42.175201 31576 tablet.cc:2369] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 13:02:42.227653 31777 tablet.cc:2369] T 4a076d63e32d409aaba3dcaea108af65 P 0473bbb7cf2d4c13bafb6bd19d529c11: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:02:42.237443 31807 raft_consensus.cc:482] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:02:42.237880 31807 raft_consensus.cc:504] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } }
I20260809 13:02:42.239691 31807 leader_election.cc:288] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aea98063dbf84d1cb1c6f455f2afba8f (127.28.155.193:46873), 0473bbb7cf2d4c13bafb6bd19d529c11 (127.28.155.195:44761)
I20260809 13:02:42.247053 31795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:42.240360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:53557 (local address 127.28.155.193:46873)
0809 13:02:42.240590 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:42.240598 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:42.241212 (+ 614us) server_negotiation.cc:407] Connection header received
0809 13:02:42.241461 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:42.241468 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:42.241550 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:42.241655 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:02:42.242309 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.243197 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.245271 (+ 2074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.246041 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.246237 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:42.246318 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:42.246662 (+ 344us) server_negotiation.cc:299] Negotiation successful
0809 13:02:42.246792 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 13:02:42.247175 31798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:42.240332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:57187 (local address 127.28.155.195:44761)
0809 13:02:42.240591 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:42.240598 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:42.241785 (+ 1187us) server_negotiation.cc:407] Connection header received
0809 13:02:42.242051 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:42.242055 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:42.242116 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:42.242216 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:02:42.242798 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.243570 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.245436 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.246206 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.246398 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:42.246496 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:42.246785 (+ 289us) server_negotiation.cc:299] Negotiation successful
0809 13:02:42.246910 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 13:02:42.247656 31811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:42.240223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:46873 (local address 127.28.155.194:53557)
0809 13:02:42.241077 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:42.241098 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:42.241300 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:42.241689 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:42.241693 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:42.241723 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:02:42.242158 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:42.242168 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.243331 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.243338 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:42.245103 (+ 1765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:42.245116 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.246271 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.246278 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:42.246444 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:42.246522 (+ 78us) client_negotiation.cc:769] Sending connection context
0809 13:02:42.246633 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 13:02:42.246764 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":728,"mutex_wait_us":70,"thread_start_us":535,"threads_started":1}
I20260809 13:02:42.247787 31810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:42.240246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:44761 (local address 127.28.155.194:57187)
0809 13:02:42.241666 (+ 1420us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:42.241680 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:42.241869 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:42.242234 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:42.242239 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:42.242261 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:02:42.242641 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:42.242651 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.243760 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.243766 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:42.245273 (+ 1507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:42.245286 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.246435 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.246442 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:42.246620 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:42.246644 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 13:02:42.246746 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 13:02:42.246867 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1290,"mutex_wait_us":5,"spinlock_wait_cycles":50560,"thread_start_us":1087,"threads_started":1}
I20260809 13:02:42.248834 31715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a076d63e32d409aaba3dcaea108af65" candidate_uuid: "cd053217f1c84d43a496413b422b9ed1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" is_pre_election: true
I20260809 13:02:42.248823 31274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a076d63e32d409aaba3dcaea108af65" candidate_uuid: "cd053217f1c84d43a496413b422b9ed1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" is_pre_election: true
I20260809 13:02:42.249377 31274 raft_consensus.cc:2454] T 4a076d63e32d409aaba3dcaea108af65 P aea98063dbf84d1cb1c6f455f2afba8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd053217f1c84d43a496413b422b9ed1 in term 0.
I20260809 13:02:42.249377 31715 raft_consensus.cc:2454] T 4a076d63e32d409aaba3dcaea108af65 P 0473bbb7cf2d4c13bafb6bd19d529c11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd053217f1c84d43a496413b422b9ed1 in term 0.
I20260809 13:02:42.250115 31377 leader_election.cc:302] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0473bbb7cf2d4c13bafb6bd19d529c11, aea98063dbf84d1cb1c6f455f2afba8f, cd053217f1c84d43a496413b422b9ed1; no voters:
I20260809 13:02:42.250578 31807 raft_consensus.cc:2781] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:02:42.250752 31807 raft_consensus.cc:482] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:02:42.250892 31807 raft_consensus.cc:3037] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:42.253618 31807 raft_consensus.cc:504] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } }
I20260809 13:02:42.254374 31807 leader_election.cc:288] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1 [CANDIDATE]: Term 1 election: Requested vote from peers aea98063dbf84d1cb1c6f455f2afba8f (127.28.155.193:46873), 0473bbb7cf2d4c13bafb6bd19d529c11 (127.28.155.195:44761)
I20260809 13:02:42.254830 31274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a076d63e32d409aaba3dcaea108af65" candidate_uuid: "cd053217f1c84d43a496413b422b9ed1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aea98063dbf84d1cb1c6f455f2afba8f"
I20260809 13:02:42.254943 31715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a076d63e32d409aaba3dcaea108af65" candidate_uuid: "cd053217f1c84d43a496413b422b9ed1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11"
I20260809 13:02:42.255089 31274 raft_consensus.cc:3037] T 4a076d63e32d409aaba3dcaea108af65 P aea98063dbf84d1cb1c6f455f2afba8f [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:42.255170 31715 raft_consensus.cc:3037] T 4a076d63e32d409aaba3dcaea108af65 P 0473bbb7cf2d4c13bafb6bd19d529c11 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:42.258539 31274 raft_consensus.cc:2454] T 4a076d63e32d409aaba3dcaea108af65 P aea98063dbf84d1cb1c6f455f2afba8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd053217f1c84d43a496413b422b9ed1 in term 1.
I20260809 13:02:42.258533 31715 raft_consensus.cc:2454] T 4a076d63e32d409aaba3dcaea108af65 P 0473bbb7cf2d4c13bafb6bd19d529c11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd053217f1c84d43a496413b422b9ed1 in term 1.
I20260809 13:02:42.259017 31374 leader_election.cc:302] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473bbb7cf2d4c13bafb6bd19d529c11, cd053217f1c84d43a496413b422b9ed1; no voters:
I20260809 13:02:42.259379 31807 raft_consensus.cc:2781] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:02:42.259859 31807 raft_consensus.cc:686] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1 [term 1 LEADER]: Becoming Leader. State: Replica: cd053217f1c84d43a496413b422b9ed1, State: Running, Role: LEADER
I20260809 13:02:42.260516 31807 consensus_queue.cc:237] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } }
I20260809 13:02:42.265412 31041 catalog_manager.cc:5495] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd053217f1c84d43a496413b422b9ed1 (127.28.155.194). New cstate: current_term: 1 leader_uuid: "cd053217f1c84d43a496413b422b9ed1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } health_report { overall_health: UNKNOWN } } }
I20260809 13:02:42.309110 31792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:42.303438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32886 (local address 127.28.155.194:35203)
0809 13:02:42.303715 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:42.303722 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:42.303751 (+ 29us) server_negotiation.cc:407] Connection header received
0809 13:02:42.304047 (+ 296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:42.304052 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:42.304152 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:42.304281 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:02:42.304716 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.305466 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.306818 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.307234 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.307327 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:42.307839 (+ 512us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:02:42.308405 (+ 566us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:02:42.308614 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:42.308713 (+ 99us) server_negotiation.cc:299] Negotiation successful
0809 13:02:42.308788 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260809 13:02:42.317983 31274 raft_consensus.cc:1261] T 4a076d63e32d409aaba3dcaea108af65 P aea98063dbf84d1cb1c6f455f2afba8f [term 1 FOLLOWER]: Refusing update from remote peer cd053217f1c84d43a496413b422b9ed1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:02:42.318017 31715 raft_consensus.cc:1261] T 4a076d63e32d409aaba3dcaea108af65 P 0473bbb7cf2d4c13bafb6bd19d529c11 [term 1 FOLLOWER]: Refusing update from remote peer cd053217f1c84d43a496413b422b9ed1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:02:42.319062 31812 consensus_queue.cc:1035] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:02:42.319474 31807 consensus_queue.cc:1035] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 13:02:42.336041 31347 tablet.cc:2369] T 4a076d63e32d409aaba3dcaea108af65 P aea98063dbf84d1cb1c6f455f2afba8f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:02:42.359975 31041 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38984:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:02:42.360301 31041 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38984:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:02:42.364459 31041 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4c6b37c34f834e44b0e4cc60b0aadf01: Sending DeleteTablet for 3 replicas of tablet 4a076d63e32d409aaba3dcaea108af65
I20260809 13:02:42.365927 31463 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a076d63e32d409aaba3dcaea108af65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:02:42 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:32876
I20260809 13:02:42.365921 31241 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a076d63e32d409aaba3dcaea108af65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:02:42 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:40052
I20260809 13:02:42.366106 31678 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a076d63e32d409aaba3dcaea108af65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:02:42 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:51020
I20260809 13:02:42.371225 31041 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38984:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 13:02:42.373407 31041 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:02:42.377261 31831 tablet_replica.cc:330] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1: stopping tablet replica
I20260809 13:02:42.378340 31837 tablet_replica.cc:330] T 4a076d63e32d409aaba3dcaea108af65 P 0473bbb7cf2d4c13bafb6bd19d529c11: stopping tablet replica
I20260809 13:02:42.378986 31837 raft_consensus.cc:2229] T 4a076d63e32d409aaba3dcaea108af65 P 0473bbb7cf2d4c13bafb6bd19d529c11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:02:42.379292 31831 raft_consensus.cc:2229] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1 [term 1 LEADER]: Raft consensus shutting down.
I20260809 13:02:42.379961 31837 raft_consensus.cc:2258] T 4a076d63e32d409aaba3dcaea108af65 P 0473bbb7cf2d4c13bafb6bd19d529c11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:02:42.380129 31831 raft_consensus.cc:2258] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:02:42.382972 31837 ts_tablet_manager.cc:1905] T 4a076d63e32d409aaba3dcaea108af65 P 0473bbb7cf2d4c13bafb6bd19d529c11: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:02:42.384572 31836 tablet_replica.cc:330] T 4a076d63e32d409aaba3dcaea108af65 P aea98063dbf84d1cb1c6f455f2afba8f: stopping tablet replica
I20260809 13:02:42.385062 31836 raft_consensus.cc:2229] T 4a076d63e32d409aaba3dcaea108af65 P aea98063dbf84d1cb1c6f455f2afba8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:02:42.385619 31836 raft_consensus.cc:2258] T 4a076d63e32d409aaba3dcaea108af65 P aea98063dbf84d1cb1c6f455f2afba8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:02:42.388674 31678 tablet_service.cc:1467] Processing CreateTablet for tablet 87c72f81b1bb4e53b875446954263bd8 (DEFAULT_TABLE table=test-table [id=457acb478954428796fac892f1723c0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:02:42.388904 31463 tablet_service.cc:1467] Processing CreateTablet for tablet 87c72f81b1bb4e53b875446954263bd8 (DEFAULT_TABLE table=test-table [id=457acb478954428796fac892f1723c0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:02:42.389176 31678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87c72f81b1bb4e53b875446954263bd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:42.389418 31463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87c72f81b1bb4e53b875446954263bd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:42.390959 31831 ts_tablet_manager.cc:1905] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:02:42.395895 31800 tablet_bootstrap.cc:492] T 87c72f81b1bb4e53b875446954263bd8 P 0473bbb7cf2d4c13bafb6bd19d529c11: Bootstrap starting.
I20260809 13:02:42.396667 31241 tablet_service.cc:1467] Processing CreateTablet for tablet 87c72f81b1bb4e53b875446954263bd8 (DEFAULT_TABLE table=test-table [id=457acb478954428796fac892f1723c0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:02:42.397248 31241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87c72f81b1bb4e53b875446954263bd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:42.397749 31800 tablet_bootstrap.cc:654] T 87c72f81b1bb4e53b875446954263bd8 P 0473bbb7cf2d4c13bafb6bd19d529c11: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:42.398217 31837 ts_tablet_manager.cc:1918] T 4a076d63e32d409aaba3dcaea108af65 P 0473bbb7cf2d4c13bafb6bd19d529c11: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:02:42.398499 31837 log.cc:1196] T 4a076d63e32d409aaba3dcaea108af65 P 0473bbb7cf2d4c13bafb6bd19d529c11: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-2/wal/wals/4a076d63e32d409aaba3dcaea108af65
I20260809 13:02:42.402608 31831 ts_tablet_manager.cc:1918] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:02:42.403352 31837 ts_tablet_manager.cc:1939] T 4a076d63e32d409aaba3dcaea108af65 P 0473bbb7cf2d4c13bafb6bd19d529c11: Deleting consensus metadata
I20260809 13:02:42.404198 31802 tablet_bootstrap.cc:492] T 87c72f81b1bb4e53b875446954263bd8 P aea98063dbf84d1cb1c6f455f2afba8f: Bootstrap starting.
I20260809 13:02:42.406046 31802 tablet_bootstrap.cc:654] T 87c72f81b1bb4e53b875446954263bd8 P aea98063dbf84d1cb1c6f455f2afba8f: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:42.406093 31020 catalog_manager.cc:4841] TS 0473bbb7cf2d4c13bafb6bd19d529c11 (127.28.155.195:44761): tablet 4a076d63e32d409aaba3dcaea108af65 (table test-table [id=daeb92d9341940b79c142b40d9af3005]) successfully deleted
I20260809 13:02:42.406790 31831 log.cc:1196] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-1/wal/wals/4a076d63e32d409aaba3dcaea108af65
I20260809 13:02:42.407168 31799 tablet_bootstrap.cc:492] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1: Bootstrap starting.
I20260809 13:02:42.407646 31831 ts_tablet_manager.cc:1939] T 4a076d63e32d409aaba3dcaea108af65 P cd053217f1c84d43a496413b422b9ed1: Deleting consensus metadata
I20260809 13:02:42.409200 31799 tablet_bootstrap.cc:654] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:42.409631 31802 tablet_bootstrap.cc:492] T 87c72f81b1bb4e53b875446954263bd8 P aea98063dbf84d1cb1c6f455f2afba8f: No bootstrap required, opened a new log
I20260809 13:02:42.409832 31802 ts_tablet_manager.cc:1397] T 87c72f81b1bb4e53b875446954263bd8 P aea98063dbf84d1cb1c6f455f2afba8f: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 13:02:42.410707 31836 ts_tablet_manager.cc:1905] T 4a076d63e32d409aaba3dcaea108af65 P aea98063dbf84d1cb1c6f455f2afba8f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:02:42.411038 31802 raft_consensus.cc:348] T 87c72f81b1bb4e53b875446954263bd8 P aea98063dbf84d1cb1c6f455f2afba8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } }
I20260809 13:02:42.411381 31802 raft_consensus.cc:374] T 87c72f81b1bb4e53b875446954263bd8 P aea98063dbf84d1cb1c6f455f2afba8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:42.411540 31802 raft_consensus.cc:729] T 87c72f81b1bb4e53b875446954263bd8 P aea98063dbf84d1cb1c6f455f2afba8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aea98063dbf84d1cb1c6f455f2afba8f, State: Initialized, Role: FOLLOWER
I20260809 13:02:42.411989 31802 consensus_queue.cc:260] T 87c72f81b1bb4e53b875446954263bd8 P aea98063dbf84d1cb1c6f455f2afba8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } }
I20260809 13:02:42.417132 31802 ts_tablet_manager.cc:1428] T 87c72f81b1bb4e53b875446954263bd8 P aea98063dbf84d1cb1c6f455f2afba8f: Time spent starting tablet: real 0.007s user 0.003s sys 0.001s
I20260809 13:02:42.419090 31800 tablet_bootstrap.cc:492] T 87c72f81b1bb4e53b875446954263bd8 P 0473bbb7cf2d4c13bafb6bd19d529c11: No bootstrap required, opened a new log
I20260809 13:02:42.419381 31800 ts_tablet_manager.cc:1397] T 87c72f81b1bb4e53b875446954263bd8 P 0473bbb7cf2d4c13bafb6bd19d529c11: Time spent bootstrapping tablet: real 0.024s user 0.007s sys 0.008s
I20260809 13:02:42.421053 31020 catalog_manager.cc:4841] TS cd053217f1c84d43a496413b422b9ed1 (127.28.155.194:35203): tablet 4a076d63e32d409aaba3dcaea108af65 (table test-table [id=daeb92d9341940b79c142b40d9af3005]) successfully deleted
I20260809 13:02:42.421564 31800 raft_consensus.cc:348] T 87c72f81b1bb4e53b875446954263bd8 P 0473bbb7cf2d4c13bafb6bd19d529c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } }
I20260809 13:02:42.421840 31800 raft_consensus.cc:374] T 87c72f81b1bb4e53b875446954263bd8 P 0473bbb7cf2d4c13bafb6bd19d529c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:42.421953 31800 raft_consensus.cc:729] T 87c72f81b1bb4e53b875446954263bd8 P 0473bbb7cf2d4c13bafb6bd19d529c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473bbb7cf2d4c13bafb6bd19d529c11, State: Initialized, Role: FOLLOWER
I20260809 13:02:42.422659 31799 tablet_bootstrap.cc:492] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1: No bootstrap required, opened a new log
I20260809 13:02:42.422880 31799 ts_tablet_manager.cc:1397] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.007s
I20260809 13:02:42.423916 31799 raft_consensus.cc:348] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } }
I20260809 13:02:42.424274 31799 raft_consensus.cc:374] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:42.424266 31800 consensus_queue.cc:260] T 87c72f81b1bb4e53b875446954263bd8 P 0473bbb7cf2d4c13bafb6bd19d529c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } }
I20260809 13:02:42.424435 31799 raft_consensus.cc:729] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd053217f1c84d43a496413b422b9ed1, State: Initialized, Role: FOLLOWER
I20260809 13:02:42.425014 31799 consensus_queue.cc:260] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } }
I20260809 13:02:42.426306 31836 ts_tablet_manager.cc:1918] T 4a076d63e32d409aaba3dcaea108af65 P aea98063dbf84d1cb1c6f455f2afba8f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:02:42.426527 31836 log.cc:1196] T 4a076d63e32d409aaba3dcaea108af65 P aea98063dbf84d1cb1c6f455f2afba8f: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-0/wal/wals/4a076d63e32d409aaba3dcaea108af65
I20260809 13:02:42.427134 31836 ts_tablet_manager.cc:1939] T 4a076d63e32d409aaba3dcaea108af65 P aea98063dbf84d1cb1c6f455f2afba8f: Deleting consensus metadata
I20260809 13:02:42.428537 31799 ts_tablet_manager.cc:1428] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260809 13:02:42.429175 31023 catalog_manager.cc:4841] TS aea98063dbf84d1cb1c6f455f2afba8f (127.28.155.193:46873): tablet 4a076d63e32d409aaba3dcaea108af65 (table test-table [id=daeb92d9341940b79c142b40d9af3005]) successfully deleted
I20260809 13:02:42.431324 31800 ts_tablet_manager.cc:1428] T 87c72f81b1bb4e53b875446954263bd8 P 0473bbb7cf2d4c13bafb6bd19d529c11: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260809 13:02:42.465404 31807 raft_consensus.cc:482] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:02:42.465654 31807 raft_consensus.cc:504] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } }
I20260809 13:02:42.466467 31807 leader_election.cc:288] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aea98063dbf84d1cb1c6f455f2afba8f (127.28.155.193:46873), 0473bbb7cf2d4c13bafb6bd19d529c11 (127.28.155.195:44761)
I20260809 13:02:42.467114 31715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87c72f81b1bb4e53b875446954263bd8" candidate_uuid: "cd053217f1c84d43a496413b422b9ed1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" is_pre_election: true
I20260809 13:02:42.467176 31274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87c72f81b1bb4e53b875446954263bd8" candidate_uuid: "cd053217f1c84d43a496413b422b9ed1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" is_pre_election: true
I20260809 13:02:42.467388 31715 raft_consensus.cc:2454] T 87c72f81b1bb4e53b875446954263bd8 P 0473bbb7cf2d4c13bafb6bd19d529c11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd053217f1c84d43a496413b422b9ed1 in term 0.
I20260809 13:02:42.467469 31274 raft_consensus.cc:2454] T 87c72f81b1bb4e53b875446954263bd8 P aea98063dbf84d1cb1c6f455f2afba8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd053217f1c84d43a496413b422b9ed1 in term 0.
I20260809 13:02:42.467952 31374 leader_election.cc:302] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473bbb7cf2d4c13bafb6bd19d529c11, cd053217f1c84d43a496413b422b9ed1; no voters:
I20260809 13:02:42.468282 31807 raft_consensus.cc:2781] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:02:42.468451 31807 raft_consensus.cc:482] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:02:42.468611 31807 raft_consensus.cc:3037] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:42.470922 31807 raft_consensus.cc:504] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } }
I20260809 13:02:42.471557 31807 leader_election.cc:288] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1 [CANDIDATE]: Term 1 election: Requested vote from peers aea98063dbf84d1cb1c6f455f2afba8f (127.28.155.193:46873), 0473bbb7cf2d4c13bafb6bd19d529c11 (127.28.155.195:44761)
I20260809 13:02:42.472107 31715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87c72f81b1bb4e53b875446954263bd8" candidate_uuid: "cd053217f1c84d43a496413b422b9ed1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11"
I20260809 13:02:42.472103 31274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87c72f81b1bb4e53b875446954263bd8" candidate_uuid: "cd053217f1c84d43a496413b422b9ed1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aea98063dbf84d1cb1c6f455f2afba8f"
I20260809 13:02:42.472328 31274 raft_consensus.cc:3037] T 87c72f81b1bb4e53b875446954263bd8 P aea98063dbf84d1cb1c6f455f2afba8f [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:42.472317 31715 raft_consensus.cc:3037] T 87c72f81b1bb4e53b875446954263bd8 P 0473bbb7cf2d4c13bafb6bd19d529c11 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:42.475323 31715 raft_consensus.cc:2454] T 87c72f81b1bb4e53b875446954263bd8 P 0473bbb7cf2d4c13bafb6bd19d529c11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd053217f1c84d43a496413b422b9ed1 in term 1.
I20260809 13:02:42.475323 31274 raft_consensus.cc:2454] T 87c72f81b1bb4e53b875446954263bd8 P aea98063dbf84d1cb1c6f455f2afba8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd053217f1c84d43a496413b422b9ed1 in term 1.
I20260809 13:02:42.475744 31374 leader_election.cc:302] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0473bbb7cf2d4c13bafb6bd19d529c11, cd053217f1c84d43a496413b422b9ed1; no voters:
I20260809 13:02:42.476092 31807 raft_consensus.cc:2781] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:02:42.476276 31807 raft_consensus.cc:686] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1 [term 1 LEADER]: Becoming Leader. State: Replica: cd053217f1c84d43a496413b422b9ed1, State: Running, Role: LEADER
I20260809 13:02:42.476608 31807 consensus_queue.cc:237] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } }
I20260809 13:02:42.479768 31042 catalog_manager.cc:5495] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd053217f1c84d43a496413b422b9ed1 (127.28.155.194). New cstate: current_term: 1 leader_uuid: "cd053217f1c84d43a496413b422b9ed1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } health_report { overall_health: UNKNOWN } } }
Aug 09 13:02:42 dist-test-slave-jq4t krb5kdc[30973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280560, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:02:42.540946 31853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:42.523603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:45179 (local address 127.0.0.1:38998)
0809 13:02:42.524358 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:42.524383 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:42.524585 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:42.524983 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:42.524987 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:42.525721 (+ 734us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:02:42.526019 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:42.526028 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.527647 (+ 1619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.527652 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:42.528915 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:42.528932 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.529996 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.530001 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:42.530124 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:42.530952 (+ 828us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:02:42.530971 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:02:42.533679 (+ 2708us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:02:42.537858 (+ 4179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:42.537873 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:42.537880 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:42.538383 (+ 503us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:42.538929 (+ 546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:42.538933 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:42.538936 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:42.539126 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:42.539815 (+ 689us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:02:42.539823 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:02:42.540034 (+ 211us) client_negotiation.cc:769] Sending connection context
0809 13:02:42.540194 (+ 160us) client_negotiation.cc:240] Negotiation successful
0809 13:02:42.540455 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":429,"threads_started":1}
I20260809 13:02:42.541050 31610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:42.523523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38998 (local address 127.28.155.254:45179)
0809 13:02:42.523758 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:42.523767 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:42.524508 (+ 741us) server_negotiation.cc:407] Connection header received
0809 13:02:42.524720 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:42.524726 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:42.524813 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:42.524934 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:42.526198 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.527459 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.529088 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.529783 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.529925 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:42.533893 (+ 3968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:42.533902 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:42.533908 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:42.533959 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:42.537703 (+ 3744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:42.538537 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:42.538544 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:42.538548 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:42.538729 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:42.539266 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:42.539272 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:42.539275 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:42.539675 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:42.539834 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:42.540351 (+ 517us) server_negotiation.cc:299] Negotiation successful
0809 13:02:42.540648 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 13:02:42.547818 31042 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:38998:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 13:02:42.549232 31042 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:02:42.557855 31241 tablet_service.cc:1467] Processing CreateTablet for tablet f351d5dfa8ff4163ad23666ee96d2ab4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=caf644b11f17432e88d468d58e3af8cf]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 13:02:42.557847 31463 tablet_service.cc:1467] Processing CreateTablet for tablet f351d5dfa8ff4163ad23666ee96d2ab4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=caf644b11f17432e88d468d58e3af8cf]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 13:02:42.558559 31463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f351d5dfa8ff4163ad23666ee96d2ab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:42.558557 31241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f351d5dfa8ff4163ad23666ee96d2ab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:42.558323 31678 tablet_service.cc:1467] Processing CreateTablet for tablet f351d5dfa8ff4163ad23666ee96d2ab4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=caf644b11f17432e88d468d58e3af8cf]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 13:02:42.558943 31678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f351d5dfa8ff4163ad23666ee96d2ab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:42.566491 31799 tablet_bootstrap.cc:492] T f351d5dfa8ff4163ad23666ee96d2ab4 P cd053217f1c84d43a496413b422b9ed1: Bootstrap starting.
I20260809 13:02:42.566478 31802 tablet_bootstrap.cc:492] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f: Bootstrap starting.
I20260809 13:02:42.568471 31799 tablet_bootstrap.cc:654] T f351d5dfa8ff4163ad23666ee96d2ab4 P cd053217f1c84d43a496413b422b9ed1: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:42.568470 31802 tablet_bootstrap.cc:654] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:42.568567 31800 tablet_bootstrap.cc:492] T f351d5dfa8ff4163ad23666ee96d2ab4 P 0473bbb7cf2d4c13bafb6bd19d529c11: Bootstrap starting.
I20260809 13:02:42.570431 31800 tablet_bootstrap.cc:654] T f351d5dfa8ff4163ad23666ee96d2ab4 P 0473bbb7cf2d4c13bafb6bd19d529c11: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:42.578250 31802 tablet_bootstrap.cc:492] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f: No bootstrap required, opened a new log
I20260809 13:02:42.578342 31800 tablet_bootstrap.cc:492] T f351d5dfa8ff4163ad23666ee96d2ab4 P 0473bbb7cf2d4c13bafb6bd19d529c11: No bootstrap required, opened a new log
I20260809 13:02:42.578610 31802 ts_tablet_manager.cc:1397] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260809 13:02:42.578608 31800 ts_tablet_manager.cc:1397] T f351d5dfa8ff4163ad23666ee96d2ab4 P 0473bbb7cf2d4c13bafb6bd19d529c11: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.002s
I20260809 13:02:42.579721 31800 raft_consensus.cc:348] T f351d5dfa8ff4163ad23666ee96d2ab4 P 0473bbb7cf2d4c13bafb6bd19d529c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } }
I20260809 13:02:42.580089 31800 raft_consensus.cc:374] T f351d5dfa8ff4163ad23666ee96d2ab4 P 0473bbb7cf2d4c13bafb6bd19d529c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:42.580199 31800 raft_consensus.cc:729] T f351d5dfa8ff4163ad23666ee96d2ab4 P 0473bbb7cf2d4c13bafb6bd19d529c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0473bbb7cf2d4c13bafb6bd19d529c11, State: Initialized, Role: FOLLOWER
I20260809 13:02:42.580623 31800 consensus_queue.cc:260] T f351d5dfa8ff4163ad23666ee96d2ab4 P 0473bbb7cf2d4c13bafb6bd19d529c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } }
I20260809 13:02:42.581019 31802 raft_consensus.cc:348] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } }
I20260809 13:02:42.581337 31802 raft_consensus.cc:374] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:42.581475 31802 raft_consensus.cc:729] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aea98063dbf84d1cb1c6f455f2afba8f, State: Initialized, Role: FOLLOWER
I20260809 13:02:42.581249 31808 tablet_replica.cc:439] T f351d5dfa8ff4163ad23666ee96d2ab4 P 0473bbb7cf2d4c13bafb6bd19d529c11: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } } }
I20260809 13:02:42.581655 31808 tablet_replica.cc:442] T f351d5dfa8ff4163ad23666ee96d2ab4 P 0473bbb7cf2d4c13bafb6bd19d529c11: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 13:02:42.581893 31802 consensus_queue.cc:260] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } }
I20260809 13:02:42.582434 31809 tablet_replica.cc:439] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } } }
I20260809 13:02:42.582779 31809 tablet_replica.cc:442] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 13:02:42.583029 31800 ts_tablet_manager.cc:1428] T f351d5dfa8ff4163ad23666ee96d2ab4 P 0473bbb7cf2d4c13bafb6bd19d529c11: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260809 13:02:42.584318 31802 ts_tablet_manager.cc:1428] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260809 13:02:42.586596 31799 tablet_bootstrap.cc:492] T f351d5dfa8ff4163ad23666ee96d2ab4 P cd053217f1c84d43a496413b422b9ed1: No bootstrap required, opened a new log
I20260809 13:02:42.586880 31799 ts_tablet_manager.cc:1397] T f351d5dfa8ff4163ad23666ee96d2ab4 P cd053217f1c84d43a496413b422b9ed1: Time spent bootstrapping tablet: real 0.020s user 0.014s sys 0.002s
I20260809 13:02:42.587779 31799 raft_consensus.cc:348] T f351d5dfa8ff4163ad23666ee96d2ab4 P cd053217f1c84d43a496413b422b9ed1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } }
I20260809 13:02:42.588127 31799 raft_consensus.cc:374] T f351d5dfa8ff4163ad23666ee96d2ab4 P cd053217f1c84d43a496413b422b9ed1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:42.588253 31799 raft_consensus.cc:729] T f351d5dfa8ff4163ad23666ee96d2ab4 P cd053217f1c84d43a496413b422b9ed1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd053217f1c84d43a496413b422b9ed1, State: Initialized, Role: FOLLOWER
I20260809 13:02:42.588559 31799 consensus_queue.cc:260] T f351d5dfa8ff4163ad23666ee96d2ab4 P cd053217f1c84d43a496413b422b9ed1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } }
I20260809 13:02:42.589205 31799 ts_tablet_manager.cc:1428] T f351d5dfa8ff4163ad23666ee96d2ab4 P cd053217f1c84d43a496413b422b9ed1: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260809 13:02:42.589113 31807 tablet_replica.cc:439] T f351d5dfa8ff4163ad23666ee96d2ab4 P cd053217f1c84d43a496413b422b9ed1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } } }
I20260809 13:02:42.589519 31807 tablet_replica.cc:442] T f351d5dfa8ff4163ad23666ee96d2ab4 P cd053217f1c84d43a496413b422b9ed1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 13:02:42.801889 31809 raft_consensus.cc:482] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:02:42.802192 31809 raft_consensus.cc:504] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } }
I20260809 13:02:42.804000 31809 leader_election.cc:288] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd053217f1c84d43a496413b422b9ed1 (127.28.155.194:35203), 0473bbb7cf2d4c13bafb6bd19d529c11 (127.28.155.195:44761)
I20260809 13:02:42.816545 31792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:42.804433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:44841 (local address 127.28.155.194:35203)
0809 13:02:42.804704 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:42.804713 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:42.805038 (+ 325us) server_negotiation.cc:407] Connection header received
0809 13:02:42.805350 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:42.805356 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:42.805467 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:42.805541 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:02:42.806612 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.808192 (+ 1580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.812638 (+ 4446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.814656 (+ 2018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.814852 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:42.814976 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:42.815801 (+ 825us) server_negotiation.cc:299] Negotiation successful
0809 13:02:42.816028 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 13:02:42.817871 31859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:42.804364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:35203 (local address 127.28.155.193:44841)
0809 13:02:42.804910 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:42.804927 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:42.805139 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:42.805861 (+ 722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:42.805869 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:42.805910 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:02:42.806383 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:42.806399 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.808466 (+ 2067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.808498 (+ 32us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:42.812316 (+ 3818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:42.812345 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.815216 (+ 2871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.815225 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:42.815538 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:42.815589 (+ 51us) client_negotiation.cc:769] Sending connection context
0809 13:02:42.817237 (+ 1648us) client_negotiation.cc:240] Negotiation successful
0809 13:02:42.817403 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":330,"threads_started":1}
I20260809 13:02:42.819073 31502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f351d5dfa8ff4163ad23666ee96d2ab4" candidate_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd053217f1c84d43a496413b422b9ed1" is_pre_election: true
I20260809 13:02:42.819648 31502 raft_consensus.cc:2454] T f351d5dfa8ff4163ad23666ee96d2ab4 P cd053217f1c84d43a496413b422b9ed1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aea98063dbf84d1cb1c6f455f2afba8f in term 0.
I20260809 13:02:42.820338 31168 leader_election.cc:302] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aea98063dbf84d1cb1c6f455f2afba8f, cd053217f1c84d43a496413b422b9ed1; no voters:
I20260809 13:02:42.820842 31809 raft_consensus.cc:2781] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:02:42.821010 31809 raft_consensus.cc:482] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:02:42.821164 31809 raft_consensus.cc:3037] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:42.824368 31809 raft_consensus.cc:504] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } }
I20260809 13:02:42.825246 31809 leader_election.cc:288] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f [CANDIDATE]: Term 1 election: Requested vote from peers cd053217f1c84d43a496413b422b9ed1 (127.28.155.194:35203), 0473bbb7cf2d4c13bafb6bd19d529c11 (127.28.155.195:44761)
I20260809 13:02:42.826033 31862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:42.805364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:42133 (local address 127.28.155.195:44761)
0809 13:02:42.817428 (+ 12064us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:42.817435 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:42.818161 (+ 726us) server_negotiation.cc:407] Connection header received
0809 13:02:42.818531 (+ 370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:42.818538 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:42.818631 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:42.818736 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:02:42.819454 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.820678 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.823389 (+ 2711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.824850 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.825025 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:42.825107 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:42.825518 (+ 411us) server_negotiation.cc:299] Negotiation successful
0809 13:02:42.825683 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11931,"thread_start_us":12069,"threads_started":1}
I20260809 13:02:42.826042 31502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f351d5dfa8ff4163ad23666ee96d2ab4" candidate_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd053217f1c84d43a496413b422b9ed1"
I20260809 13:02:42.826327 31502 raft_consensus.cc:3037] T f351d5dfa8ff4163ad23666ee96d2ab4 P cd053217f1c84d43a496413b422b9ed1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:42.828831 31502 raft_consensus.cc:2454] T f351d5dfa8ff4163ad23666ee96d2ab4 P cd053217f1c84d43a496413b422b9ed1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aea98063dbf84d1cb1c6f455f2afba8f in term 1.
I20260809 13:02:42.829469 31860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:42.805130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:44761 (local address 127.28.155.193:42133)
0809 13:02:42.818034 (+ 12904us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:42.818055 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:42.818330 (+ 275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:42.818799 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:42.818804 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:42.818836 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:02:42.819230 (+ 394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:42.819245 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.820871 (+ 1626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.820879 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:42.823204 (+ 2325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:42.823220 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.825100 (+ 1880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.825107 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:42.825323 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:42.825362 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 13:02:42.825471 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 13:02:42.825639 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12746,"thread_start_us":12566,"threads_started":1}
I20260809 13:02:42.829502 31168 leader_election.cc:302] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aea98063dbf84d1cb1c6f455f2afba8f, cd053217f1c84d43a496413b422b9ed1; no voters:
I20260809 13:02:42.829805 31809 raft_consensus.cc:2781] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:02:42.830381 31809 raft_consensus.cc:686] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f [term 1 LEADER]: Becoming Leader. State: Replica: aea98063dbf84d1cb1c6f455f2afba8f, State: Running, Role: LEADER
I20260809 13:02:42.830430 31715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f351d5dfa8ff4163ad23666ee96d2ab4" candidate_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" is_pre_election: true
I20260809 13:02:42.830705 31715 raft_consensus.cc:2454] T f351d5dfa8ff4163ad23666ee96d2ab4 P 0473bbb7cf2d4c13bafb6bd19d529c11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aea98063dbf84d1cb1c6f455f2afba8f in term 0.
I20260809 13:02:42.830838 31809 consensus_queue.cc:237] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } }
I20260809 13:02:42.831053 31713 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f351d5dfa8ff4163ad23666ee96d2ab4" candidate_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11"
I20260809 13:02:42.831274 31713 raft_consensus.cc:3037] T f351d5dfa8ff4163ad23666ee96d2ab4 P 0473bbb7cf2d4c13bafb6bd19d529c11 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:42.834383 31713 raft_consensus.cc:2454] T f351d5dfa8ff4163ad23666ee96d2ab4 P 0473bbb7cf2d4c13bafb6bd19d529c11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aea98063dbf84d1cb1c6f455f2afba8f in term 1.
I20260809 13:02:42.837884 31863 tablet_replica.cc:439] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f: TxnStatusTablet state changed. Reason: New leader aea98063dbf84d1cb1c6f455f2afba8f. Latest consensus state: current_term: 1 leader_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } } }
I20260809 13:02:42.838335 31863 tablet_replica.cc:442] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f: This TxnStatusTablet replica's current role is: LEADER
I20260809 13:02:42.839532 31041 catalog_manager.cc:5495] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f reported cstate change: term changed from 0 to 1, leader changed from <none> to aea98063dbf84d1cb1c6f455f2afba8f (127.28.155.193). New cstate: current_term: 1 leader_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } health_report { overall_health: UNKNOWN } } }
I20260809 13:02:42.846974 31868 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 13:02:42.847258 31868 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 13:02:42.864694 31807 consensus_queue.cc:1035] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:02:42.889267 31812 consensus_queue.cc:1035] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:02:42.898483 31853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:42.887097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:46873 (local address 127.0.0.1:40064)
0809 13:02:42.887482 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:42.887503 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:42.887684 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:42.889471 (+ 1787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:42.889478 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:42.889494 (+ 16us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 13:02:42.889738 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:42.889749 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.892289 (+ 2540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.892297 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:42.894123 (+ 1826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:42.894145 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.895318 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.895327 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:42.895534 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:42.895669 (+ 135us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 13:02:42.897809 (+ 2140us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 13:02:42.897841 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 13:02:42.897955 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 13:02:42.898160 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205}
I20260809 13:02:42.898509 31875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:42.887232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40064 (local address 127.28.155.193:46873)
0809 13:02:42.888604 (+ 1372us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:42.888611 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:42.888629 (+ 18us) server_negotiation.cc:407] Connection header received
0809 13:02:42.888730 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:42.888735 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:42.888847 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:42.889959 (+ 1112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:02:42.890269 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.892118 (+ 1849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.894364 (+ 2246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.895090 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.896631 (+ 1541us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:42.896814 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:02:42.897675 (+ 861us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:02:42.897841 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:42.897981 (+ 140us) server_negotiation.cc:299] Negotiation successful
0809 13:02:42.898071 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1190,"thread_start_us":1666,"threads_started":1}
I20260809 13:02:42.903961 31713 raft_consensus.cc:1261] T f351d5dfa8ff4163ad23666ee96d2ab4 P 0473bbb7cf2d4c13bafb6bd19d529c11 [term 1 FOLLOWER]: Refusing update from remote peer aea98063dbf84d1cb1c6f455f2afba8f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:02:42.904238 31502 raft_consensus.cc:1261] T f351d5dfa8ff4163ad23666ee96d2ab4 P cd053217f1c84d43a496413b422b9ed1 [term 1 FOLLOWER]: Refusing update from remote peer aea98063dbf84d1cb1c6f455f2afba8f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:02:42.904701 31809 consensus_queue.cc:1035] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:02:42.905092 31863 consensus_queue.cc:1035] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:02:42.909375 31808 tablet_replica.cc:439] T f351d5dfa8ff4163ad23666ee96d2ab4 P 0473bbb7cf2d4c13bafb6bd19d529c11: TxnStatusTablet state changed. Reason: New leader aea98063dbf84d1cb1c6f455f2afba8f. Latest consensus state: current_term: 1 leader_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } } }
I20260809 13:02:42.909709 31808 tablet_replica.cc:442] T f351d5dfa8ff4163ad23666ee96d2ab4 P 0473bbb7cf2d4c13bafb6bd19d529c11: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 13:02:42.911389 31812 tablet_replica.cc:439] T f351d5dfa8ff4163ad23666ee96d2ab4 P cd053217f1c84d43a496413b422b9ed1: TxnStatusTablet state changed. Reason: New leader aea98063dbf84d1cb1c6f455f2afba8f. Latest consensus state: current_term: 1 leader_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } } }
I20260809 13:02:42.911724 31812 tablet_replica.cc:442] T f351d5dfa8ff4163ad23666ee96d2ab4 P cd053217f1c84d43a496413b422b9ed1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 13:02:42.912282 31878 mvcc.cc:205] Tried to move back new op lower bound from 7316605185647390720 to 7316605185360125952. Current Snapshot: MvccSnapshot[applied={T|T < 7316605185647390720}]
I20260809 13:02:42.914507 31808 tablet_replica.cc:439] T f351d5dfa8ff4163ad23666ee96d2ab4 P 0473bbb7cf2d4c13bafb6bd19d529c11: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } } }
I20260809 13:02:42.914775 31808 tablet_replica.cc:442] T f351d5dfa8ff4163ad23666ee96d2ab4 P 0473bbb7cf2d4c13bafb6bd19d529c11: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 13:02:42.921123 31809 tablet_replica.cc:439] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } } }
I20260809 13:02:42.921468 31809 tablet_replica.cc:442] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f: This TxnStatusTablet replica's current role is: LEADER
I20260809 13:02:42.922040 31809 tablet_replica.cc:439] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } } }
I20260809 13:02:42.922293 31809 tablet_replica.cc:442] T f351d5dfa8ff4163ad23666ee96d2ab4 P aea98063dbf84d1cb1c6f455f2afba8f: This TxnStatusTablet replica's current role is: LEADER
I20260809 13:02:42.928524 31812 tablet_replica.cc:439] T f351d5dfa8ff4163ad23666ee96d2ab4 P cd053217f1c84d43a496413b422b9ed1: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aea98063dbf84d1cb1c6f455f2afba8f" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46873 } } peers { permanent_uuid: "cd053217f1c84d43a496413b422b9ed1" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35203 } } peers { permanent_uuid: "0473bbb7cf2d4c13bafb6bd19d529c11" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44761 } } }
I20260809 13:02:42.928807 31812 tablet_replica.cc:442] T f351d5dfa8ff4163ad23666ee96d2ab4 P cd053217f1c84d43a496413b422b9ed1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 13:02:42.947111 31875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:42.941229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:46119 (local address 127.28.155.193:46873)
0809 13:02:42.941491 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:42.941501 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:42.941959 (+ 458us) server_negotiation.cc:407] Connection header received
0809 13:02:42.942178 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:42.942182 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:42.942253 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:42.942402 (+ 149us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:02:42.943007 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.943800 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.945266 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.945720 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.945873 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:42.946314 (+ 441us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:02:42.946424 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:02:42.946536 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:42.946686 (+ 150us) server_negotiation.cc:299] Negotiation successful
0809 13:02:42.946773 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 13:02:42.947239 31900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:42.941160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:46873 (local address 127.28.155.194:46119)
0809 13:02:42.941846 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:42.941873 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:42.942030 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:42.942438 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:42.942443 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:42.942459 (+ 16us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 13:02:42.942775 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:42.942786 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.943949 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.943955 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:42.945118 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:42.945130 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.945908 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.945915 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:42.946060 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:42.946123 (+ 63us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 13:02:42.946549 (+ 426us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 13:02:42.946563 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 13:02:42.946661 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 13:02:42.946800 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":342,"threads_started":1}
I20260809 13:02:42.997462 31792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:42.989584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:47575 (local address 127.28.155.194:35203)
0809 13:02:42.989822 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:42.989828 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:42.989949 (+ 121us) server_negotiation.cc:407] Connection header received
0809 13:02:42.990344 (+ 395us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:42.990351 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:42.990457 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:42.990527 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:02:42.991638 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.992766 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.994927 (+ 2161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.995550 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.995658 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:42.996467 (+ 809us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:02:42.996641 (+ 174us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:02:42.996709 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:42.997041 (+ 332us) server_negotiation.cc:299] Negotiation successful
0809 13:02:42.997139 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260809 13:02:42.998284 31905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:42.989065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:35203 (local address 127.28.155.193:47575)
0809 13:02:42.989845 (+ 780us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:42.989867 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:42.990111 (+ 244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:42.990866 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:42.990870 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:42.990884 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 13:02:42.991383 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:42.991400 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.992969 (+ 1569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.992974 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:42.994733 (+ 1759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:42.994752 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:42.995897 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:42.995904 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:42.996095 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:42.996178 (+ 83us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 13:02:42.996857 (+ 679us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 13:02:42.996869 (+ 12us) client_negotiation.cc:769] Sending connection context
0809 13:02:42.997707 (+ 838us) client_negotiation.cc:240] Negotiation successful
0809 13:02:42.997928 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":2276,"threads_started":1}
I20260809 13:02:43.053687 31041 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38984:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:02:43.053922 31041 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38984:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:02:43.057375 31041 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4c6b37c34f834e44b0e4cc60b0aadf01: Sending DeleteTablet for 3 replicas of tablet 87c72f81b1bb4e53b875446954263bd8
I20260809 13:02:43.058350 31241 tablet_service.cc:1514] Processing DeleteTablet for tablet 87c72f81b1bb4e53b875446954263bd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:02:43 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:40052
I20260809 13:02:43.058382 31463 tablet_service.cc:1514] Processing DeleteTablet for tablet 87c72f81b1bb4e53b875446954263bd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:02:43 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:32876
I20260809 13:02:43.058562 31678 tablet_service.cc:1514] Processing DeleteTablet for tablet 87c72f81b1bb4e53b875446954263bd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:02:43 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:51020
I20260809 13:02:43.067231 31911 tablet_replica.cc:330] T 87c72f81b1bb4e53b875446954263bd8 P 0473bbb7cf2d4c13bafb6bd19d529c11: stopping tablet replica
I20260809 13:02:43.067553 31911 raft_consensus.cc:2229] T 87c72f81b1bb4e53b875446954263bd8 P 0473bbb7cf2d4c13bafb6bd19d529c11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:02:43.067909 31911 raft_consensus.cc:2258] T 87c72f81b1bb4e53b875446954263bd8 P 0473bbb7cf2d4c13bafb6bd19d529c11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:02:43.070524 31908 tablet_replica.cc:330] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1: stopping tablet replica
I20260809 13:02:43.070883 31908 raft_consensus.cc:2229] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1 [term 1 LEADER]: Raft consensus shutting down.
I20260809 13:02:43.071501 31908 raft_consensus.cc:2258] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:02:43.072181 31910 tablet_replica.cc:330] T 87c72f81b1bb4e53b875446954263bd8 P aea98063dbf84d1cb1c6f455f2afba8f: stopping tablet replica
I20260809 13:02:43.072398 31910 raft_consensus.cc:2229] T 87c72f81b1bb4e53b875446954263bd8 P aea98063dbf84d1cb1c6f455f2afba8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:02:43.072412 31911 ts_tablet_manager.cc:1905] T 87c72f81b1bb4e53b875446954263bd8 P 0473bbb7cf2d4c13bafb6bd19d529c11: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:02:43.072750 31910 raft_consensus.cc:2258] T 87c72f81b1bb4e53b875446954263bd8 P aea98063dbf84d1cb1c6f455f2afba8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:02:43.072992 31908 ts_tablet_manager.cc:1905] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:02:43.073938 31910 ts_tablet_manager.cc:1905] T 87c72f81b1bb4e53b875446954263bd8 P aea98063dbf84d1cb1c6f455f2afba8f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:02:43.081362 31910 ts_tablet_manager.cc:1918] T 87c72f81b1bb4e53b875446954263bd8 P aea98063dbf84d1cb1c6f455f2afba8f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 13:02:43.081374 31908 ts_tablet_manager.cc:1918] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 13:02:43.081511 31910 log.cc:1196] T 87c72f81b1bb4e53b875446954263bd8 P aea98063dbf84d1cb1c6f455f2afba8f: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-0/wal/wals/87c72f81b1bb4e53b875446954263bd8
I20260809 13:02:43.081697 31908 log.cc:1196] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-1/wal/wals/87c72f81b1bb4e53b875446954263bd8
I20260809 13:02:43.082038 31910 ts_tablet_manager.cc:1939] T 87c72f81b1bb4e53b875446954263bd8 P aea98063dbf84d1cb1c6f455f2afba8f: Deleting consensus metadata
I20260809 13:02:43.082334 31908 ts_tablet_manager.cc:1939] T 87c72f81b1bb4e53b875446954263bd8 P cd053217f1c84d43a496413b422b9ed1: Deleting consensus metadata
I20260809 13:02:43.083374 31023 catalog_manager.cc:4841] TS aea98063dbf84d1cb1c6f455f2afba8f (127.28.155.193:46873): tablet 87c72f81b1bb4e53b875446954263bd8 (table test-table [id=457acb478954428796fac892f1723c0f]) successfully deleted
I20260809 13:02:43.083519 31020 catalog_manager.cc:4841] TS cd053217f1c84d43a496413b422b9ed1 (127.28.155.194:35203): tablet 87c72f81b1bb4e53b875446954263bd8 (table test-table [id=457acb478954428796fac892f1723c0f]) successfully deleted
I20260809 13:02:43.086282 31911 ts_tablet_manager.cc:1918] T 87c72f81b1bb4e53b875446954263bd8 P 0473bbb7cf2d4c13bafb6bd19d529c11: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 13:02:43.086452 31911 log.cc:1196] T 87c72f81b1bb4e53b875446954263bd8 P 0473bbb7cf2d4c13bafb6bd19d529c11: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786280548611909-29295-0/minicluster-data/ts-2/wal/wals/87c72f81b1bb4e53b875446954263bd8
I20260809 13:02:43.086885 31911 ts_tablet_manager.cc:1939] T 87c72f81b1bb4e53b875446954263bd8 P 0473bbb7cf2d4c13bafb6bd19d529c11: Deleting consensus metadata
Aug 09 13:02:43 dist-test-slave-jq4t krb5kdc[30973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280562, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.28.155.193@KRBTEST.COM
I20260809 13:02:43.088182 31020 catalog_manager.cc:4841] TS 0473bbb7cf2d4c13bafb6bd19d529c11 (127.28.155.195:44761): tablet 87c72f81b1bb4e53b875446954263bd8 (table test-table [id=457acb478954428796fac892f1723c0f]) successfully deleted
I20260809 13:02:43.096029 31875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:43.070519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40080 (local address 127.28.155.193:46873)
0809 13:02:43.070742 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:43.070749 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:43.071336 (+ 587us) server_negotiation.cc:407] Connection header received
0809 13:02:43.071556 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:43.071564 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:43.071711 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:43.071853 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:43.079888 (+ 8035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:43.081160 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:43.083125 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:43.083813 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:43.083931 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:43.089231 (+ 5300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:43.089244 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:43.089260 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:43.089299 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:43.092800 (+ 3501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:43.093658 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:43.093666 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:43.093668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:43.093817 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:43.094215 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:43.094219 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:43.094220 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:43.094627 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:43.094915 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:43.095326 (+ 411us) server_negotiation.cc:299] Negotiation successful
0809 13:02:43.095586 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
W20260809 13:02:43.096926 31338 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40080
I20260809 13:02:43.119274 31918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:43.100841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39004 (local address 127.28.155.254:45179)
0809 13:02:43.104957 (+ 4116us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:43.104962 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:43.104980 (+ 18us) server_negotiation.cc:407] Connection header received
0809 13:02:43.105036 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:43.105039 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:43.105103 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:43.105195 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:43.107095 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:43.107902 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:43.109865 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:43.110297 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:43.110394 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:43.113522 (+ 3128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:43.113528 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:43.113531 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:43.113565 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:43.116427 (+ 2862us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:43.117272 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:43.117276 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:43.117278 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:43.117406 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:43.117797 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:43.117801 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:43.117803 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:43.118097 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:43.118272 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:43.118642 (+ 370us) server_negotiation.cc:299] Negotiation successful
0809 13:02:43.118880 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3993,"thread_start_us":3828,"threads_started":1}
W20260809 13:02:43.120080 31041 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39004
I20260809 13:02:43.122356 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 31146
I20260809 13:02:43.144562 31875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:43.123255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40086 (local address 127.28.155.193:46873)
0809 13:02:43.123464 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:43.123470 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:43.130113 (+ 6643us) server_negotiation.cc:407] Connection header received
0809 13:02:43.130235 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:43.130241 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:43.130332 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:43.130456 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:43.131711 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:43.132891 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:43.134357 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:43.135073 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:43.135195 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:43.137837 (+ 2642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:43.137844 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:43.137848 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:43.137891 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:43.141415 (+ 3524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:43.142221 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:43.142227 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:43.142230 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:43.142431 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:43.142890 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:43.142895 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:43.142898 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:43.143221 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:43.143532 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:43.143808 (+ 276us) server_negotiation.cc:299] Negotiation successful
0809 13:02:43.144059 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260809 13:02:43.147519 31338 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40086
W20260809 13:02:43.148159 29295 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 31146: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 13:02:43.148399 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 31146
I20260809 13:02:43.179988 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 31352
Aug 09 13:02:43 dist-test-slave-jq4t krb5kdc[30973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280562, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.28.155.194@KRBTEST.COM
I20260809 13:02:43.195065 31792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:43.180842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32888 (local address 127.28.155.194:35203)
0809 13:02:43.181039 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:43.181044 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:43.181062 (+ 18us) server_negotiation.cc:407] Connection header received
0809 13:02:43.181234 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:43.181238 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:43.181303 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:43.181388 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:43.182545 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:43.183244 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:43.184448 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:43.184939 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:43.185041 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:43.189486 (+ 4445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:43.189503 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:43.189520 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:43.189563 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:43.192452 (+ 2889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:43.193234 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:43.193242 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:43.193244 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:43.193386 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:43.193706 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:43.193709 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:43.193711 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:43.194073 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:43.194326 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:43.194516 (+ 190us) server_negotiation.cc:299] Negotiation successful
0809 13:02:43.194697 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
W20260809 13:02:43.195859 31565 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:32888
W20260809 13:02:43.196635 29295 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 31352: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 13:02:43.196866 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 31352
I20260809 13:02:43.230223 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 31579
Aug 09 13:02:43 dist-test-slave-jq4t krb5kdc[30973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280562, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.28.155.195@KRBTEST.COM
I20260809 13:02:43.245708 31862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:43.231024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51022 (local address 127.28.155.195:44761)
0809 13:02:43.231220 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:43.231225 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:43.231246 (+ 21us) server_negotiation.cc:407] Connection header received
0809 13:02:43.231438 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:43.231442 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:43.231508 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:43.231603 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:43.232945 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:43.233642 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:43.234861 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:43.235337 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:43.235430 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:43.239788 (+ 4358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:43.239807 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:43.239826 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:43.239866 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:43.242967 (+ 3101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:43.243624 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:43.243632 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:43.243634 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:43.243777 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:43.244125 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:43.244129 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:43.244131 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:43.244632 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:43.244884 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:43.245129 (+ 245us) server_negotiation.cc:299] Negotiation successful
0809 13:02:43.245305 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260809 13:02:43.246461 31769 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51022
W20260809 13:02:43.247121 29295 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 31579: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 13:02:43.247267 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 31579
I20260809 13:02:43.271890 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 30996
I20260809 13:02:43.273195 31099 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:02:43.400178 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 30996
2026-08-09T13:02:43Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (5262 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:02:43 dist-test-slave-jq4t krb5kdc[31925](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:02:43 dist-test-slave-jq4t krb5kdc[31925](info): set up 2 sockets
Aug 09 13:02:43 dist-test-slave-jq4t krb5kdc[31925](info): commencing operation
krb5kdc: starting...
W20260809 13:02:44.704784 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.252s user 0.000s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:02:44 dist-test-slave-jq4t krb5kdc[31925](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:02:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:02:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
I20260809 13:02:44.932448 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:43923
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:43733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:43923
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:02:45.294827 31941 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:02:45.295167 31941 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:02:45.295347 31941 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:02:45.302817 31941 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:02:45.302939 31941 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 13:02:45.303040 31941 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:02:45.303172 31941 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:02:45.303256 31941 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:02:45.303375 31941 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:02:45.313687 31941 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:43733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:43923
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:43923
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:02:45.315104 31941 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:02:45.316594 31941 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:02:45.329203 31946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:45.329175 31947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:45.329242 31953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:02:45.330133 31941 server_base.cc:1034] running on GCE node
I20260809 13:02:45.331091 31941 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:02:45.332648 31941 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:02:45.333926 31941 hybrid_clock.cc:648] HybridClock initialized: now 1786280565333863 us; error 61 us; skew 500 ppm
I20260809 13:02:45.334291 31941 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:02:45 dist-test-slave-jq4t krb5kdc[31925](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280565, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:02:45.337752 31941 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:02:45.339277 31941 webserver.cc:460] Webserver started at http://127.28.155.254:46631/ using document root <none> and password file <none>
I20260809 13:02:45.340034 31941 fs_manager.cc:359] Metadata directory not provided
I20260809 13:02:45.340173 31941 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:02:45.340572 31941 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:02:45.343663 31941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "0fa6fd2d58be42e19db3d470886fb6fc"
format_stamp: "Formatted at 2026-08-09 13:02:45 on dist-test-slave-jq4t"
server_key: "30a234ad573d66a142be2f6c51acaad0"
server_key_iv: "9db59e0057261e5d70e345ad764d7153"
server_key_version: "encryptionkey@0"
I20260809 13:02:45.344543 31941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "0fa6fd2d58be42e19db3d470886fb6fc"
format_stamp: "Formatted at 2026-08-09 13:02:45 on dist-test-slave-jq4t"
server_key: "30a234ad573d66a142be2f6c51acaad0"
server_key_iv: "9db59e0057261e5d70e345ad764d7153"
server_key_version: "encryptionkey@0"
I20260809 13:02:45.350090 31941 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 13:02:45.354190 31962 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:45.356034 31941 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 13:02:45.356185 31941 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "0fa6fd2d58be42e19db3d470886fb6fc"
format_stamp: "Formatted at 2026-08-09 13:02:45 on dist-test-slave-jq4t"
server_key: "30a234ad573d66a142be2f6c51acaad0"
server_key_iv: "9db59e0057261e5d70e345ad764d7153"
server_key_version: "encryptionkey@0"
I20260809 13:02:45.356385 31941 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:02:45.384511 31941 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:02:45.390946 31941 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:02:45.391274 31941 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:02:45.415619 31941 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:43923
I20260809 13:02:45.415661 32055 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:43923 every 8 connection(s)
I20260809 13:02:45.417286 31941 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:02:45.418493 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 31941
I20260809 13:02:45.418717 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:02:45.419415 29295 external_mini_cluster.cc:1428] Setting key 1a881e877d174c8b689405467b8680fa
I20260809 13:02:45.422056 32056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 13:02:45 dist-test-slave-jq4t krb5kdc[31925](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:02:45.436110 32056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fa6fd2d58be42e19db3d470886fb6fc: Bootstrap starting.
I20260809 13:02:45.439577 32056 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0fa6fd2d58be42e19db3d470886fb6fc: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:45.441082 32056 log.cc:824] T 00000000000000000000000000000000 P 0fa6fd2d58be42e19db3d470886fb6fc: Log is configured to *not* fsync() on all Append() calls
I20260809 13:02:45.444260 32065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:45.421546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46174 (local address 127.28.155.254:43923)
0809 13:02:45.422412 (+ 866us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:45.422425 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:45.422467 (+ 42us) server_negotiation.cc:407] Connection header received
0809 13:02:45.424195 (+ 1728us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:45.424218 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:45.424699 (+ 481us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:45.425062 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:45.426989 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:45.428441 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:45.430351 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:45.431055 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:45.431185 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:45.436212 (+ 5027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:45.436221 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:45.436236 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:45.436308 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:45.439636 (+ 3328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:45.440583 (+ 947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:45.440590 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:45.440596 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:45.440779 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:45.441276 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:45.441281 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:45.441284 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:45.442105 (+ 821us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:45.442451 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:45.442800 (+ 349us) server_negotiation.cc:299] Negotiation successful
0809 13:02:45.443203 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":643,"thread_start_us":419,"threads_started":1}
I20260809 13:02:45.444509 32056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fa6fd2d58be42e19db3d470886fb6fc: No bootstrap required, opened a new log
I20260809 13:02:45.452942 32056 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0fa6fd2d58be42e19db3d470886fb6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa6fd2d58be42e19db3d470886fb6fc" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 43923 } }
I20260809 13:02:45.453341 32056 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0fa6fd2d58be42e19db3d470886fb6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:45.453423 32056 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0fa6fd2d58be42e19db3d470886fb6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa6fd2d58be42e19db3d470886fb6fc, State: Initialized, Role: FOLLOWER
I20260809 13:02:45.453965 32056 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0fa6fd2d58be42e19db3d470886fb6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa6fd2d58be42e19db3d470886fb6fc" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 43923 } }
I20260809 13:02:45.454175 32056 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0fa6fd2d58be42e19db3d470886fb6fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:02:45.454281 32056 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0fa6fd2d58be42e19db3d470886fb6fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:02:45.454407 32056 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0fa6fd2d58be42e19db3d470886fb6fc [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:45.456717 32056 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0fa6fd2d58be42e19db3d470886fb6fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa6fd2d58be42e19db3d470886fb6fc" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 43923 } }
I20260809 13:02:45.457194 32056 leader_election.cc:302] T 00000000000000000000000000000000 P 0fa6fd2d58be42e19db3d470886fb6fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0fa6fd2d58be42e19db3d470886fb6fc; no voters:
I20260809 13:02:45.457926 32056 leader_election.cc:288] T 00000000000000000000000000000000 P 0fa6fd2d58be42e19db3d470886fb6fc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:02:45.458119 32067 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0fa6fd2d58be42e19db3d470886fb6fc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:02:45.458966 32067 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0fa6fd2d58be42e19db3d470886fb6fc [term 1 LEADER]: Becoming Leader. State: Replica: 0fa6fd2d58be42e19db3d470886fb6fc, State: Running, Role: LEADER
I20260809 13:02:45.459594 32067 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0fa6fd2d58be42e19db3d470886fb6fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa6fd2d58be42e19db3d470886fb6fc" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 43923 } }
I20260809 13:02:45.460350 32056 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0fa6fd2d58be42e19db3d470886fb6fc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:02:45.463065 32069 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fa6fd2d58be42e19db3d470886fb6fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0fa6fd2d58be42e19db3d470886fb6fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa6fd2d58be42e19db3d470886fb6fc" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 43923 } } }
I20260809 13:02:45.463058 32072 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fa6fd2d58be42e19db3d470886fb6fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0fa6fd2d58be42e19db3d470886fb6fc. Latest consensus state: current_term: 1 leader_uuid: "0fa6fd2d58be42e19db3d470886fb6fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa6fd2d58be42e19db3d470886fb6fc" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 43923 } } }
I20260809 13:02:45.463593 32069 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fa6fd2d58be42e19db3d470886fb6fc [sys.catalog]: This master's current role is: LEADER
I20260809 13:02:45.463624 32072 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fa6fd2d58be42e19db3d470886fb6fc [sys.catalog]: This master's current role is: LEADER
I20260809 13:02:45.469801 32079 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:02:45.474363 32079 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:02:45.484362 32079 catalog_manager.cc:1347] Generated new cluster ID: d3c35cb4557e441b924c13b2980b4983
I20260809 13:02:45.484522 32079 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:02:45.502722 32079 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:02:45.504215 32079 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:02:45.520977 32079 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0fa6fd2d58be42e19db3d470886fb6fc: Generated new TSK 0
I20260809 13:02:45.521963 32079 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
I20260809 13:02:45.588882 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:0
--local_ip_for_outbound_sockets=127.28.155.193
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:43923
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:43733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:02:45.943554 32107 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:02:45.943940 32107 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:02:45.944142 32107 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:02:45.951958 32107 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:02:45.952127 32107 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:02:45.952271 32107 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 13:02:45.952364 32107 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 13:02:45.952515 32107 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:02:45.963860 32107 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:43733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.28.155.254:43923
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:02:45.965499 32107 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:02:45.967135 32107 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:02:45.982317 32115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:45.982271 32117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:45.982328 32114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:02:45.983246 32107 server_base.cc:1034] running on GCE node
I20260809 13:02:45.983927 32107 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:02:45.985059 32107 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:02:45.986294 32107 hybrid_clock.cc:648] HybridClock initialized: now 1786280565986249 us; error 30 us; skew 500 ppm
I20260809 13:02:45.986673 32107 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:02:45 dist-test-slave-jq4t krb5kdc[31925](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280565, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:02:45.994529 32107 init.cc:377] Logged in from keytab as kudu/127.28.155.193@KRBTEST.COM (short username kudu)
I20260809 13:02:45.996408 32107 webserver.cc:460] Webserver started at http://127.28.155.193:38507/ using document root <none> and password file <none>
I20260809 13:02:45.997210 32107 fs_manager.cc:359] Metadata directory not provided
I20260809 13:02:45.997336 32107 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:02:45.997645 32107 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:02:46.000986 32107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-0/data/instance:
uuid: "19a60815b9dd4c59bb655d000f25245b"
format_stamp: "Formatted at 2026-08-09 13:02:45 on dist-test-slave-jq4t"
server_key: "1e90fa8d3ff20958d0a776493ed30034"
server_key_iv: "2f387e44f17f665979ce059dfd5d0c39"
server_key_version: "encryptionkey@0"
I20260809 13:02:46.001850 32107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance:
uuid: "19a60815b9dd4c59bb655d000f25245b"
format_stamp: "Formatted at 2026-08-09 13:02:45 on dist-test-slave-jq4t"
server_key: "1e90fa8d3ff20958d0a776493ed30034"
server_key_iv: "2f387e44f17f665979ce059dfd5d0c39"
server_key_version: "encryptionkey@0"
I20260809 13:02:46.007704 32107 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 13:02:46.011931 32132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:46.013578 32107 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:02:46.013795 32107 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "19a60815b9dd4c59bb655d000f25245b"
format_stamp: "Formatted at 2026-08-09 13:02:45 on dist-test-slave-jq4t"
server_key: "1e90fa8d3ff20958d0a776493ed30034"
server_key_iv: "2f387e44f17f665979ce059dfd5d0c39"
server_key_version: "encryptionkey@0"
I20260809 13:02:46.014065 32107 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:02:46.059093 32107 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:02:46.064356 32107 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:02:46.064759 32107 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:02:46.067770 32107 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:02:46.067916 32107 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:46.068084 32107 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:02:46.068193 32107 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 13:02:46 dist-test-slave-jq4t krb5kdc[31925](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280565, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:02:46.094332 32145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:46.068721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:53307 (local address 127.28.155.254:43923)
0809 13:02:46.071189 (+ 2468us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:46.071195 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:46.071220 (+ 25us) server_negotiation.cc:407] Connection header received
0809 13:02:46.072874 (+ 1654us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:46.072879 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:46.072988 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:46.073113 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:46.075685 (+ 2572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:46.076627 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:46.079433 (+ 2806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:46.079880 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:46.080030 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:46.086026 (+ 5996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:46.086033 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:46.086036 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:46.086075 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:46.089071 (+ 2996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:46.090686 (+ 1615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:46.090696 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:46.090703 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:46.090913 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:46.091617 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:46.091625 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:46.091631 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:46.092022 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:46.092202 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:46.093360 (+ 1158us) server_negotiation.cc:299] Negotiation successful
0809 13:02:46.093736 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2321,"thread_start_us":2194,"threads_started":1}
I20260809 13:02:46.094998 32147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:46.069373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:43923 (local address 127.28.155.193:53307)
0809 13:02:46.070300 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:46.070355 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:46.072565 (+ 2210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:46.073364 (+ 799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:46.073376 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:46.074200 (+ 824us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:02:46.075460 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:46.075499 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:46.076816 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:46.076820 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:46.079257 (+ 2437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:46.079271 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:46.080164 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:46.080172 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:46.080386 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:46.081355 (+ 969us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:02:46.081414 (+ 59us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:02:46.085719 (+ 4305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:02:46.089291 (+ 3572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:46.089309 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:46.089336 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:46.090440 (+ 1104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:46.091097 (+ 657us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:46.091102 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:46.091105 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:46.091445 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:46.092177 (+ 732us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:02:46.092193 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:02:46.092846 (+ 653us) client_negotiation.cc:769] Sending connection context
0809 13:02:46.093241 (+ 395us) client_negotiation.cc:240] Negotiation successful
0809 13:02:46.093726 (+ 485us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":410,"threads_started":1}
I20260809 13:02:46.116541 32145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:46.101099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:46755 (local address 127.28.155.254:43923)
0809 13:02:46.101335 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:46.101343 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:46.102354 (+ 1011us) server_negotiation.cc:407] Connection header received
0809 13:02:46.102556 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:46.102560 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:46.102622 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:46.102725 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:46.103680 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:46.104394 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:46.106607 (+ 2213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:46.107439 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:46.107621 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:46.110139 (+ 2518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:46.110148 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:46.110155 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:46.110207 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:46.113730 (+ 3523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:46.114435 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:46.114442 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:46.114446 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:46.114589 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:46.114981 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:46.114987 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:46.114995 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:46.115275 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:46.115448 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:46.115865 (+ 417us) server_negotiation.cc:299] Negotiation successful
0809 13:02:46.116123 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 13:02:46.116683 32232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:46.101553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:43923 (local address 127.28.155.193:46755)
0809 13:02:46.102247 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:46.102266 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:46.102424 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:46.102755 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:46.102760 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:46.103235 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:02:46.103535 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:46.103545 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:46.104585 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:46.104595 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:46.106351 (+ 1756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:46.106364 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:46.107695 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:46.107704 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:46.107902 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:46.108737 (+ 835us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:02:46.108773 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:02:46.109913 (+ 1140us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:02:46.113870 (+ 3957us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:46.113876 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:46.113879 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:46.114307 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:46.114710 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:46.114715 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:46.114719 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:46.114858 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:46.115401 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:02:46.115406 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:02:46.115607 (+ 201us) client_negotiation.cc:769] Sending connection context
0809 13:02:46.115758 (+ 151us) client_negotiation.cc:240] Negotiation successful
0809 13:02:46.116106 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":433,"threads_started":1}
I20260809 13:02:46.129287 32107 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:33043
I20260809 13:02:46.129336 32326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:33043 every 8 connection(s)
I20260809 13:02:46.130643 32107 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:02:46.132973 32327 heartbeater.cc:347] Connected to a master server at 127.28.155.254:43923
I20260809 13:02:46.133219 32327 heartbeater.cc:464] Registering TS with master...
I20260809 13:02:46.133880 32327 heartbeater.cc:511] Master 127.28.155.254:43923 requested a full tablet report, sending...
I20260809 13:02:46.135887 31985 ts_manager.cc:194] Registered new tserver with Master: 19a60815b9dd4c59bb655d000f25245b (127.28.155.193:33043)
I20260809 13:02:46.136943 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 32107
I20260809 13:02:46.137166 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance
I20260809 13:02:46.137609 31985 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.193@KRBTEST.COM'} at 127.28.155.193:53307
I20260809 13:02:46.137888 29295 external_mini_cluster.cc:1428] Setting key 34bad0a715d82372fa8d5c6314f92a1e
WARNING: no policy specified for kudu/127.28.155.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
I20260809 13:02:46.187371 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:0
--local_ip_for_outbound_sockets=127.28.155.194
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:43923
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:43733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:02:46.537533 32334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:02:46.537868 32334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:02:46.538061 32334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:02:46.545581 32334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:02:46.545732 32334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:02:46.545897 32334 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 13:02:46.545995 32334 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 13:02:46.546128 32334 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:02:46.556041 32334 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:43733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.28.155.254:43923
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:02:46.557467 32334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:02:46.558976 32334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:02:46.573165 32348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:46.573213 32344 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:46.573266 32342 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:02:46.579404 32334 server_base.cc:1034] running on GCE node
I20260809 13:02:46.580101 32334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:02:46.581183 32334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:02:46.582423 32334 hybrid_clock.cc:648] HybridClock initialized: now 1786280566582383 us; error 55 us; skew 500 ppm
I20260809 13:02:46.582764 32334 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:02:46 dist-test-slave-jq4t krb5kdc[31925](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280566, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:02:46.586066 32334 init.cc:377] Logged in from keytab as kudu/127.28.155.194@KRBTEST.COM (short username kudu)
I20260809 13:02:46.587610 32334 webserver.cc:460] Webserver started at http://127.28.155.194:41499/ using document root <none> and password file <none>
I20260809 13:02:46.588353 32334 fs_manager.cc:359] Metadata directory not provided
I20260809 13:02:46.588549 32334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:02:46.588891 32334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:02:46.592015 32334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-1/data/instance:
uuid: "bb337635cce249879ce6ed345aae48de"
format_stamp: "Formatted at 2026-08-09 13:02:46 on dist-test-slave-jq4t"
server_key: "47153771d5b05662601b2c0ca03c3c81"
server_key_iv: "9d6891168dce5ffcf8fbad0fe674d706"
server_key_version: "encryptionkey@0"
I20260809 13:02:46.592902 32334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance:
uuid: "bb337635cce249879ce6ed345aae48de"
format_stamp: "Formatted at 2026-08-09 13:02:46 on dist-test-slave-jq4t"
server_key: "47153771d5b05662601b2c0ca03c3c81"
server_key_iv: "9d6891168dce5ffcf8fbad0fe674d706"
server_key_version: "encryptionkey@0"
I20260809 13:02:46.598351 32334 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260809 13:02:46.601861 32361 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:46.603219 32334 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:02:46.603395 32334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "bb337635cce249879ce6ed345aae48de"
format_stamp: "Formatted at 2026-08-09 13:02:46 on dist-test-slave-jq4t"
server_key: "47153771d5b05662601b2c0ca03c3c81"
server_key_iv: "9d6891168dce5ffcf8fbad0fe674d706"
server_key_version: "encryptionkey@0"
I20260809 13:02:46.603633 32334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:02:46.623881 32334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:02:46.628834 32334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:02:46.629159 32334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:02:46.632097 32334 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:02:46.632277 32334 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:46.632412 32334 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:02:46.632550 32334 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
Aug 09 13:02:46 dist-test-slave-jq4t krb5kdc[31925](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280566, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:02:46.661013 32378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:46.632598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:37689 (local address 127.28.155.254:43923)
0809 13:02:46.633200 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:46.633207 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:46.634584 (+ 1377us) server_negotiation.cc:407] Connection header received
0809 13:02:46.637864 (+ 3280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:46.637869 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:46.637972 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:46.638095 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:46.640812 (+ 2717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:46.641974 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:46.644602 (+ 2628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:46.645311 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:46.645482 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:46.650739 (+ 5257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:46.650746 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:46.650751 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:46.650801 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:46.654814 (+ 4013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:46.655962 (+ 1148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:46.655970 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:46.655978 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:46.656131 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:46.656690 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:46.656699 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:46.656701 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:46.657116 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:46.657285 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:46.660216 (+ 2931us) server_negotiation.cc:299] Negotiation successful
0809 13:02:46.660481 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":263,"threads_started":1}
I20260809 13:02:46.662221 32380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:46.633337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:43923 (local address 127.28.155.194:37689)
0809 13:02:46.634379 (+ 1042us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:46.634443 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:46.637465 (+ 3022us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:46.638549 (+ 1084us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:46.638561 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:46.639434 (+ 873us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:02:46.640546 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:46.640588 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:46.642160 (+ 1572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:46.642169 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:46.644363 (+ 2194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:46.644404 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:46.645664 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:46.645679 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:46.646080 (+ 401us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:46.647077 (+ 997us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:02:46.647129 (+ 52us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:02:46.650453 (+ 3324us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:02:46.655030 (+ 4577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:46.655039 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:46.655060 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:46.655792 (+ 732us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:46.656272 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:46.656277 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:46.656281 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:46.656544 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:46.657407 (+ 863us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:02:46.657414 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:02:46.658029 (+ 615us) client_negotiation.cc:769] Sending connection context
0809 13:02:46.658454 (+ 425us) client_negotiation.cc:240] Negotiation successful
0809 13:02:46.659173 (+ 719us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":712,"thread_start_us":405,"threads_started":1}
I20260809 13:02:46.684866 32378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:46.668646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:45595 (local address 127.28.155.254:43923)
0809 13:02:46.668885 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:46.668894 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:46.669552 (+ 658us) server_negotiation.cc:407] Connection header received
0809 13:02:46.669750 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:46.669754 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:46.669819 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:46.669899 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:46.671438 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:46.672386 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:46.674605 (+ 2219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:46.675328 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:46.675478 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:46.677671 (+ 2193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:46.677677 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:46.677683 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:46.677724 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:46.681590 (+ 3866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:46.682702 (+ 1112us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:46.682706 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:46.682709 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:46.682832 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:46.683236 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:46.683242 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:46.683250 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:46.683604 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:46.683772 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:46.684217 (+ 445us) server_negotiation.cc:299] Negotiation successful
0809 13:02:46.684461 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 13:02:46.685030 32502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:46.668654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:43923 (local address 127.28.155.194:45595)
0809 13:02:46.669424 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:46.669450 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:46.669625 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:46.669989 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:46.669997 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:46.670735 (+ 738us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:02:46.671251 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:46.671269 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:46.672579 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:46.672584 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:46.674395 (+ 1811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:46.674421 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:46.675530 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:46.675535 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:46.675740 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:46.676634 (+ 894us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:02:46.676652 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:02:46.677423 (+ 771us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:02:46.681805 (+ 4382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:46.681814 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:46.681819 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:46.682484 (+ 665us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:46.682956 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:46.682961 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:46.682965 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:46.683112 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:46.683734 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:02:46.683739 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:02:46.683940 (+ 201us) client_negotiation.cc:769] Sending connection context
0809 13:02:46.684105 (+ 165us) client_negotiation.cc:240] Negotiation successful
0809 13:02:46.684473 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":395,"threads_started":1}
I20260809 13:02:46.687142 32334 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:35145
I20260809 13:02:46.687170 32551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:35145 every 8 connection(s)
I20260809 13:02:46.688771 32334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:02:46.691151 32552 heartbeater.cc:347] Connected to a master server at 127.28.155.254:43923
I20260809 13:02:46.691366 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 32334
I20260809 13:02:46.691408 32552 heartbeater.cc:464] Registering TS with master...
I20260809 13:02:46.691524 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance
I20260809 13:02:46.691946 29295 external_mini_cluster.cc:1428] Setting key 6d3f1d5bff9a7c484a3106268a1616ab
I20260809 13:02:46.692230 32552 heartbeater.cc:511] Master 127.28.155.254:43923 requested a full tablet report, sending...
I20260809 13:02:46.693917 31984 ts_manager.cc:194] Registered new tserver with Master: bb337635cce249879ce6ed345aae48de (127.28.155.194:35145)
I20260809 13:02:46.694870 31984 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.194@KRBTEST.COM'} at 127.28.155.194:37689
WARNING: no policy specified for kudu/127.28.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
I20260809 13:02:46.742054 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:0
--local_ip_for_outbound_sockets=127.28.155.195
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:43923
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:43733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:02:47.090958 32556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:02:47.091327 32556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:02:47.091524 32556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:02:47.099320 32556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:02:47.099498 32556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:02:47.099665 32556 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 13:02:47.099761 32556 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 13:02:47.099905 32556 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:02:47.110476 32556 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:43733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.28.155.254:43923
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:02:47.111955 32556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:02:47.113584 32556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:02:47.127518 32572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:47.127532 32569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:47.127580 32566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:02:47.133934 32556 server_base.cc:1034] running on GCE node
I20260809 13:02:47.134631 32556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:02:47.135643 32556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:02:47.136885 32556 hybrid_clock.cc:648] HybridClock initialized: now 1786280567136831 us; error 65 us; skew 500 ppm
I20260809 13:02:47.137238 32556 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:02:47 dist-test-slave-jq4t krb5kdc[31925](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280567, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:02:47.140796 32556 init.cc:377] Logged in from keytab as kudu/127.28.155.195@KRBTEST.COM (short username kudu)
I20260809 13:02:47.141034 32327 heartbeater.cc:503] Master 127.28.155.254:43923 was elected leader, sending a full tablet report...
I20260809 13:02:47.143335 32556 webserver.cc:460] Webserver started at http://127.28.155.195:41625/ using document root <none> and password file <none>
I20260809 13:02:47.144214 32556 fs_manager.cc:359] Metadata directory not provided
I20260809 13:02:47.144367 32556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:02:47.144766 32556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:02:47.147835 32556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-2/data/instance:
uuid: "d755e0183b41471da12c8866559fd650"
format_stamp: "Formatted at 2026-08-09 13:02:47 on dist-test-slave-jq4t"
server_key: "148bc6258009e24c04e18335e8b65592"
server_key_iv: "7b675524df774e231d956bd8be450560"
server_key_version: "encryptionkey@0"
I20260809 13:02:47.148725 32556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance:
uuid: "d755e0183b41471da12c8866559fd650"
format_stamp: "Formatted at 2026-08-09 13:02:47 on dist-test-slave-jq4t"
server_key: "148bc6258009e24c04e18335e8b65592"
server_key_iv: "7b675524df774e231d956bd8be450560"
server_key_version: "encryptionkey@0"
I20260809 13:02:47.154402 32556 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 13:02:47.158043 32582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:47.159334 32556 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 13:02:47.159526 32556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "d755e0183b41471da12c8866559fd650"
format_stamp: "Formatted at 2026-08-09 13:02:47 on dist-test-slave-jq4t"
server_key: "148bc6258009e24c04e18335e8b65592"
server_key_iv: "7b675524df774e231d956bd8be450560"
server_key_version: "encryptionkey@0"
I20260809 13:02:47.159767 32556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:02:47.175781 32556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:02:47.180841 32556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:02:47.181111 32556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:02:47.184162 32556 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:02:47.184305 32556 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:47.184435 32556 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:02:47.184618 32556 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
Aug 09 13:02:47 dist-test-slave-jq4t krb5kdc[31925](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280567, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:02:47.209035 32378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:47.184780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:40599 (local address 127.28.155.254:43923)
0809 13:02:47.185018 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:47.185027 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:47.186467 (+ 1440us) server_negotiation.cc:407] Connection header received
0809 13:02:47.188716 (+ 2249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:47.188723 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:47.188819 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:47.188940 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:47.191367 (+ 2427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.192547 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.194911 (+ 2364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.195573 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.195716 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:47.201240 (+ 5524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:47.201245 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:47.201249 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:47.201284 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:47.204183 (+ 2899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:47.205419 (+ 1236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:47.205425 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:47.205429 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:47.205609 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:47.206277 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:47.206286 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:47.206292 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:47.206851 (+ 559us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:47.207070 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:47.208271 (+ 1201us) server_negotiation.cc:299] Negotiation successful
0809 13:02:47.208642 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 13:02:47.210577 32592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:47.185401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:43923 (local address 127.28.155.195:40599)
0809 13:02:47.186279 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:47.186325 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:47.188292 (+ 1967us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:47.189184 (+ 892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:47.189192 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:47.190066 (+ 874us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:02:47.191161 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:47.191193 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.192708 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.192713 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:47.194712 (+ 1999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:47.194730 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.195834 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.195842 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:47.196109 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:47.196993 (+ 884us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:02:47.197035 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:02:47.200952 (+ 3917us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:02:47.204345 (+ 3393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:47.204358 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:47.204381 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:47.205250 (+ 869us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:47.205746 (+ 496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:47.205751 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:47.205756 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:47.206097 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:47.207025 (+ 928us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:02:47.207032 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:02:47.207697 (+ 665us) client_negotiation.cc:769] Sending connection context
0809 13:02:47.208124 (+ 427us) client_negotiation.cc:240] Negotiation successful
0809 13:02:47.208819 (+ 695us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":614,"thread_start_us":365,"threads_started":1}
I20260809 13:02:47.240245 32378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:47.223486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:50301 (local address 127.28.155.254:43923)
0809 13:02:47.223894 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:47.223904 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:47.224626 (+ 722us) server_negotiation.cc:407] Connection header received
0809 13:02:47.224910 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:47.224919 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:47.225037 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:47.225162 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:47.226772 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.227915 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.229702 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.230509 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.230663 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:47.234039 (+ 3376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:47.234043 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:47.234047 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:47.234084 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:47.237398 (+ 3314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:47.238132 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:47.238139 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:47.238147 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:47.238303 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:47.238700 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:47.238707 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:47.238710 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:47.239014 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:47.239178 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:47.239605 (+ 427us) server_negotiation.cc:299] Negotiation successful
0809 13:02:47.239852 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209}
I20260809 13:02:47.240358 32687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:47.223474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:43923 (local address 127.28.155.195:50301)
0809 13:02:47.224429 (+ 955us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:47.224463 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:47.224700 (+ 237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:47.225250 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:47.225264 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:47.225979 (+ 715us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:02:47.226605 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:47.226619 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.228073 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.228083 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:47.229486 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:47.229525 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.231035 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.231046 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:47.231304 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:47.232280 (+ 976us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:02:47.232315 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:02:47.233816 (+ 1501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:02:47.237555 (+ 3739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:47.237561 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:47.237566 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:47.237992 (+ 426us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:47.238420 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:47.238425 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:47.238429 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:47.238574 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:47.239137 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:02:47.239142 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:02:47.239343 (+ 201us) client_negotiation.cc:769] Sending connection context
0809 13:02:47.239493 (+ 150us) client_negotiation.cc:240] Negotiation successful
0809 13:02:47.239865 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":799,"thread_start_us":614,"threads_started":1}
I20260809 13:02:47.250634 32556 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:37653
I20260809 13:02:47.250638 32764 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:37653 every 8 connection(s)
I20260809 13:02:47.251993 32556 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:02:47.254408 32765 heartbeater.cc:347] Connected to a master server at 127.28.155.254:43923
I20260809 13:02:47.254666 32765 heartbeater.cc:464] Registering TS with master...
I20260809 13:02:47.255378 32765 heartbeater.cc:511] Master 127.28.155.254:43923 requested a full tablet report, sending...
I20260809 13:02:47.256258 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 32556
I20260809 13:02:47.256476 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance
I20260809 13:02:47.257009 29295 external_mini_cluster.cc:1428] Setting key 3ea1ec0faa23c8662ecba91fc29c7fb8
I20260809 13:02:47.257035 31984 ts_manager.cc:194] Registered new tserver with Master: d755e0183b41471da12c8866559fd650 (127.28.155.195:37653)
I20260809 13:02:47.258183 31984 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.195@KRBTEST.COM'} at 127.28.155.195:40599
I20260809 13:02:47.260669 29295 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 13:02:47 dist-test-slave-jq4t krb5kdc[31925](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280567, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 13:02:47 dist-test-slave-jq4t krb5kdc[31925](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280567, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:02:47.317109 32378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:47.302406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46188 (local address 127.28.155.254:43923)
0809 13:02:47.302666 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:47.302674 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:47.302893 (+ 219us) server_negotiation.cc:407] Connection header received
0809 13:02:47.303135 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:47.303139 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:47.303210 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:47.303322 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:47.304932 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.305712 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.306973 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.307422 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.307570 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:47.311537 (+ 3967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:47.311542 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:47.311546 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:47.311582 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:47.314269 (+ 2687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:47.314960 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:47.314966 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:47.314971 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:47.315117 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:47.315517 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:47.315522 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:47.315527 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:47.315846 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:47.316147 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:47.316462 (+ 315us) server_negotiation.cc:299] Negotiation successful
0809 13:02:47.316745 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 13:02:47.321636 31984 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46188:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 13:02:47.328852 31984 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:02:47.354813 324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:47.345295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34342 (local address 127.28.155.195:37653)
0809 13:02:47.346289 (+ 994us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:47.346296 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:47.347032 (+ 736us) server_negotiation.cc:407] Connection header received
0809 13:02:47.347223 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:47.347233 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:47.347428 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:47.347610 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:02:47.348202 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.349728 (+ 1526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.351798 (+ 2070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.353252 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.353459 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:47.353648 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:47.354281 (+ 633us) server_negotiation.cc:299] Negotiation successful
0809 13:02:47.354470 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":817,"thread_start_us":628,"threads_started":1}
I20260809 13:02:47.354875 326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:47.345677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:37653 (local address 127.0.0.1:34342)
0809 13:02:47.346888 (+ 1211us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:47.346910 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:47.347053 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:47.347601 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:47.347605 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:47.347628 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:02:47.348014 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:47.348024 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.349914 (+ 1890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.349921 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:47.351648 (+ 1727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:47.351660 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.353789 (+ 2129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.353795 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:47.354006 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:47.354065 (+ 59us) client_negotiation.cc:769] Sending connection context
0809 13:02:47.354214 (+ 149us) client_negotiation.cc:240] Negotiation successful
0809 13:02:47.354421 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1052,"mutex_wait_us":5,"thread_start_us":833,"threads_started":1}
I20260809 13:02:47.354943 321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:47.342260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48770 (local address 127.28.155.194:35145)
0809 13:02:47.343945 (+ 1685us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:47.343955 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:47.344582 (+ 627us) server_negotiation.cc:407] Connection header received
0809 13:02:47.345049 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:47.345056 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:47.345341 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:47.345580 (+ 239us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:02:47.347173 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.348813 (+ 1640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.352258 (+ 3445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.353540 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.353711 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:47.353895 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:47.354491 (+ 596us) server_negotiation.cc:299] Negotiation successful
0809 13:02:47.354667 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1478,"thread_start_us":1324,"threads_started":1}
I20260809 13:02:47.355049 322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:47.342960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:33043 (local address 127.0.0.1:42904)
0809 13:02:47.345201 (+ 2241us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:47.345228 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:47.345456 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:47.346486 (+ 1030us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:47.346494 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:47.346530 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:02:47.347093 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:47.347132 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.349011 (+ 1879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.349017 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:47.352056 (+ 3039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:47.352072 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.354218 (+ 2146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.354225 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:47.354403 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:47.354431 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 13:02:47.354514 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 13:02:47.354652 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1799,"mutex_wait_us":155,"thread_start_us":1618,"threads_started":1}
I20260809 13:02:47.355728 323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:47.343605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42904 (local address 127.28.155.193:33043)
0809 13:02:47.344391 (+ 786us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:47.344400 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:47.345322 (+ 922us) server_negotiation.cc:407] Connection header received
0809 13:02:47.345672 (+ 350us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:47.345680 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:47.345925 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:47.346123 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:02:47.347327 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.348826 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.352227 (+ 3401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.353685 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.353883 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:47.354048 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:47.355260 (+ 1212us) server_negotiation.cc:299] Negotiation successful
0809 13:02:47.355419 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":613,"thread_start_us":482,"threads_started":1}
I20260809 13:02:47.356416 315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:47.342099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:35145 (local address 127.0.0.1:48770)
0809 13:02:47.344323 (+ 2224us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:47.344395 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:47.344768 (+ 373us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:47.346338 (+ 1570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:47.346354 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:47.346394 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:02:47.346943 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:47.346965 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.349011 (+ 2046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.349017 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:47.352056 (+ 3039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:47.352072 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.354058 (+ 1986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.354065 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:47.354261 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:47.354294 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 13:02:47.355340 (+ 1046us) client_negotiation.cc:240] Negotiation successful
0809 13:02:47.355488 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1955,"mutex_wait_us":207,"thread_start_us":1775,"threads_started":1}
I20260809 13:02:47.359452 32215 tablet_service.cc:1467] Processing CreateTablet for tablet 331689645f884d3484d1ed3a7b148d1a (DEFAULT_TABLE table=test-table [id=0eaa9430f4d946009a728019f234e938]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:02:47.359443 32656 tablet_service.cc:1467] Processing CreateTablet for tablet 331689645f884d3484d1ed3a7b148d1a (DEFAULT_TABLE table=test-table [id=0eaa9430f4d946009a728019f234e938]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:02:47.359552 32444 tablet_service.cc:1467] Processing CreateTablet for tablet 331689645f884d3484d1ed3a7b148d1a (DEFAULT_TABLE table=test-table [id=0eaa9430f4d946009a728019f234e938]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:02:47.360996 32444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 331689645f884d3484d1ed3a7b148d1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:47.361043 32656 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 331689645f884d3484d1ed3a7b148d1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:47.361070 32215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 331689645f884d3484d1ed3a7b148d1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:47.373884 327 tablet_bootstrap.cc:492] T 331689645f884d3484d1ed3a7b148d1a P bb337635cce249879ce6ed345aae48de: Bootstrap starting.
I20260809 13:02:47.376082 330 tablet_bootstrap.cc:492] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650: Bootstrap starting.
I20260809 13:02:47.377957 327 tablet_bootstrap.cc:654] T 331689645f884d3484d1ed3a7b148d1a P bb337635cce249879ce6ed345aae48de: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:47.380035 330 tablet_bootstrap.cc:654] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:47.381433 330 log.cc:824] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650: Log is configured to *not* fsync() on all Append() calls
I20260809 13:02:47.379853 327 log.cc:824] T 331689645f884d3484d1ed3a7b148d1a P bb337635cce249879ce6ed345aae48de: Log is configured to *not* fsync() on all Append() calls
I20260809 13:02:47.382112 328 tablet_bootstrap.cc:492] T 331689645f884d3484d1ed3a7b148d1a P 19a60815b9dd4c59bb655d000f25245b: Bootstrap starting.
I20260809 13:02:47.388531 327 tablet_bootstrap.cc:492] T 331689645f884d3484d1ed3a7b148d1a P bb337635cce249879ce6ed345aae48de: No bootstrap required, opened a new log
I20260809 13:02:47.388762 328 tablet_bootstrap.cc:654] T 331689645f884d3484d1ed3a7b148d1a P 19a60815b9dd4c59bb655d000f25245b: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:47.388895 330 tablet_bootstrap.cc:492] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650: No bootstrap required, opened a new log
I20260809 13:02:47.388955 327 ts_tablet_manager.cc:1397] T 331689645f884d3484d1ed3a7b148d1a P bb337635cce249879ce6ed345aae48de: Time spent bootstrapping tablet: real 0.015s user 0.011s sys 0.000s
I20260809 13:02:47.389432 330 ts_tablet_manager.cc:1397] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.003s
I20260809 13:02:47.390233 328 log.cc:824] T 331689645f884d3484d1ed3a7b148d1a P 19a60815b9dd4c59bb655d000f25245b: Log is configured to *not* fsync() on all Append() calls
I20260809 13:02:47.393652 328 tablet_bootstrap.cc:492] T 331689645f884d3484d1ed3a7b148d1a P 19a60815b9dd4c59bb655d000f25245b: No bootstrap required, opened a new log
I20260809 13:02:47.393944 328 ts_tablet_manager.cc:1397] T 331689645f884d3484d1ed3a7b148d1a P 19a60815b9dd4c59bb655d000f25245b: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.006s
I20260809 13:02:47.398751 330 raft_consensus.cc:348] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } } peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } }
I20260809 13:02:47.399156 330 raft_consensus.cc:374] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:47.399255 330 raft_consensus.cc:729] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d755e0183b41471da12c8866559fd650, State: Initialized, Role: FOLLOWER
I20260809 13:02:47.399940 330 consensus_queue.cc:260] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } } peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } }
I20260809 13:02:47.400058 327 raft_consensus.cc:348] T 331689645f884d3484d1ed3a7b148d1a P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } } peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } }
I20260809 13:02:47.400533 327 raft_consensus.cc:374] T 331689645f884d3484d1ed3a7b148d1a P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:47.400650 327 raft_consensus.cc:729] T 331689645f884d3484d1ed3a7b148d1a P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb337635cce249879ce6ed345aae48de, State: Initialized, Role: FOLLOWER
I20260809 13:02:47.401352 32765 heartbeater.cc:503] Master 127.28.155.254:43923 was elected leader, sending a full tablet report...
I20260809 13:02:47.401377 327 consensus_queue.cc:260] T 331689645f884d3484d1ed3a7b148d1a P bb337635cce249879ce6ed345aae48de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } } peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } }
I20260809 13:02:47.402113 330 ts_tablet_manager.cc:1428] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650: Time spent starting tablet: real 0.012s user 0.007s sys 0.003s
I20260809 13:02:47.403539 32552 heartbeater.cc:503] Master 127.28.155.254:43923 was elected leader, sending a full tablet report...
I20260809 13:02:47.404220 327 ts_tablet_manager.cc:1428] T 331689645f884d3484d1ed3a7b148d1a P bb337635cce249879ce6ed345aae48de: Time spent starting tablet: real 0.015s user 0.010s sys 0.004s
I20260809 13:02:47.406770 328 raft_consensus.cc:348] T 331689645f884d3484d1ed3a7b148d1a P 19a60815b9dd4c59bb655d000f25245b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } } peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } }
I20260809 13:02:47.407209 328 raft_consensus.cc:374] T 331689645f884d3484d1ed3a7b148d1a P 19a60815b9dd4c59bb655d000f25245b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:47.407333 328 raft_consensus.cc:729] T 331689645f884d3484d1ed3a7b148d1a P 19a60815b9dd4c59bb655d000f25245b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a60815b9dd4c59bb655d000f25245b, State: Initialized, Role: FOLLOWER
I20260809 13:02:47.408246 339 raft_consensus.cc:482] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:02:47.408157 328 consensus_queue.cc:260] T 331689645f884d3484d1ed3a7b148d1a P 19a60815b9dd4c59bb655d000f25245b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } } peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } }
I20260809 13:02:47.408624 339 raft_consensus.cc:504] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } } peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } }
I20260809 13:02:47.410048 328 ts_tablet_manager.cc:1428] T 331689645f884d3484d1ed3a7b148d1a P 19a60815b9dd4c59bb655d000f25245b: Time spent starting tablet: real 0.016s user 0.007s sys 0.008s
I20260809 13:02:47.410717 339 leader_election.cc:288] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb337635cce249879ce6ed345aae48de (127.28.155.194:35145), 19a60815b9dd4c59bb655d000f25245b (127.28.155.193:33043)
I20260809 13:02:47.419400 323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:47.412202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:42627 (local address 127.28.155.193:33043)
0809 13:02:47.412448 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:47.412454 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:47.412500 (+ 46us) server_negotiation.cc:407] Connection header received
0809 13:02:47.412567 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:47.412572 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:47.412658 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:47.412780 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:02:47.413368 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.414479 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.417046 (+ 2567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.418247 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.418379 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:47.418450 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:47.418992 (+ 542us) server_negotiation.cc:299] Negotiation successful
0809 13:02:47.419147 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 13:02:47.419504 342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:47.411193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:33043 (local address 127.28.155.195:42627)
0809 13:02:47.411837 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:47.411856 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:47.411961 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:47.412784 (+ 823us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:47.412789 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:47.412815 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:02:47.413206 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:47.413216 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.414618 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.414622 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:47.416843 (+ 2221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:47.416860 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.418639 (+ 1779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.418644 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:47.418817 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:47.418850 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 13:02:47.418952 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 13:02:47.419085 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":1152,"threads_started":1}
I20260809 13:02:47.419986 32592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:47.410892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:35145 (local address 127.28.155.195:42305)
0809 13:02:47.411571 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:47.411593 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:47.411720 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:47.413199 (+ 1479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:47.413206 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:47.413241 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:02:47.413529 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:47.413548 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.416616 (+ 3068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.416620 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:47.417831 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:47.417843 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.419222 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.419228 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:47.419453 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:47.419496 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 13:02:47.419591 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 13:02:47.419711 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485}
I20260809 13:02:47.421118 321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:47.412096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:42305 (local address 127.28.155.194:35145)
0809 13:02:47.412729 (+ 633us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:47.412737 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:47.412755 (+ 18us) server_negotiation.cc:407] Connection header received
0809 13:02:47.412821 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:47.412825 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:47.412906 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:47.413004 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:02:47.413737 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.414748 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.417993 (+ 3245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.418868 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.419046 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:47.419129 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:47.420412 (+ 1283us) server_negotiation.cc:299] Negotiation successful
0809 13:02:47.420588 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480}
I20260809 13:02:47.421223 32257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "331689645f884d3484d1ed3a7b148d1a" candidate_uuid: "d755e0183b41471da12c8866559fd650" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a60815b9dd4c59bb655d000f25245b" is_pre_election: true
I20260809 13:02:47.421764 32257 raft_consensus.cc:2454] T 331689645f884d3484d1ed3a7b148d1a P 19a60815b9dd4c59bb655d000f25245b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d755e0183b41471da12c8866559fd650 in term 0.
I20260809 13:02:47.421991 32476 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "331689645f884d3484d1ed3a7b148d1a" candidate_uuid: "d755e0183b41471da12c8866559fd650" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb337635cce249879ce6ed345aae48de" is_pre_election: true
I20260809 13:02:47.422595 32476 raft_consensus.cc:2454] T 331689645f884d3484d1ed3a7b148d1a P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d755e0183b41471da12c8866559fd650 in term 0.
I20260809 13:02:47.422576 32584 leader_election.cc:302] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19a60815b9dd4c59bb655d000f25245b, d755e0183b41471da12c8866559fd650; no voters:
I20260809 13:02:47.423048 339 raft_consensus.cc:2781] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:02:47.423194 339 raft_consensus.cc:482] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:02:47.423280 339 raft_consensus.cc:3037] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:47.426679 339 raft_consensus.cc:504] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } } peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } }
I20260809 13:02:47.427737 339 leader_election.cc:288] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650 [CANDIDATE]: Term 1 election: Requested vote from peers bb337635cce249879ce6ed345aae48de (127.28.155.194:35145), 19a60815b9dd4c59bb655d000f25245b (127.28.155.193:33043)
I20260809 13:02:47.427843 32476 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "331689645f884d3484d1ed3a7b148d1a" candidate_uuid: "d755e0183b41471da12c8866559fd650" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb337635cce249879ce6ed345aae48de"
I20260809 13:02:47.427914 32257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "331689645f884d3484d1ed3a7b148d1a" candidate_uuid: "d755e0183b41471da12c8866559fd650" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a60815b9dd4c59bb655d000f25245b"
I20260809 13:02:47.428068 32476 raft_consensus.cc:3037] T 331689645f884d3484d1ed3a7b148d1a P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:47.428123 32257 raft_consensus.cc:3037] T 331689645f884d3484d1ed3a7b148d1a P 19a60815b9dd4c59bb655d000f25245b [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:47.431529 32257 raft_consensus.cc:2454] T 331689645f884d3484d1ed3a7b148d1a P 19a60815b9dd4c59bb655d000f25245b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d755e0183b41471da12c8866559fd650 in term 1.
I20260809 13:02:47.431529 32476 raft_consensus.cc:2454] T 331689645f884d3484d1ed3a7b148d1a P bb337635cce249879ce6ed345aae48de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d755e0183b41471da12c8866559fd650 in term 1.
I20260809 13:02:47.432065 32585 leader_election.cc:302] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb337635cce249879ce6ed345aae48de, d755e0183b41471da12c8866559fd650; no voters:
I20260809 13:02:47.432464 339 raft_consensus.cc:2781] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:02:47.433004 339 raft_consensus.cc:686] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650 [term 1 LEADER]: Becoming Leader. State: Replica: d755e0183b41471da12c8866559fd650, State: Running, Role: LEADER
I20260809 13:02:47.433508 339 consensus_queue.cc:237] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } } peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } }
I20260809 13:02:47.438277 31984 catalog_manager.cc:5495] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650 reported cstate change: term changed from 0 to 1, leader changed from <none> to d755e0183b41471da12c8866559fd650 (127.28.155.195). New cstate: current_term: 1 leader_uuid: "d755e0183b41471da12c8866559fd650" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } health_report { overall_health: UNKNOWN } } }
W20260809 13:02:47.441159 32553 tablet.cc:2369] T 331689645f884d3484d1ed3a7b148d1a P bb337635cce249879ce6ed345aae48de: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 13:02:47.503908 32766 tablet.cc:2369] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 13:02:47 dist-test-slave-jq4t krb5kdc[31925](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280565, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:02:47.521967 360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:47.507459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:43923 (local address 127.0.0.1:46204)
0809 13:02:47.508074 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:47.508090 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:47.508241 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:47.508631 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:47.508635 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:47.509348 (+ 713us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:02:47.509648 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:47.509658 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.510686 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.510690 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:47.511696 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:47.511707 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.512582 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.512588 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:47.512730 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:47.513512 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:02:47.513531 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:02:47.515968 (+ 2437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:02:47.519200 (+ 3232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:47.519213 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:47.519219 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:47.519726 (+ 507us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:47.520101 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:47.520105 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:47.520108 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:47.520255 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:47.520928 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:02:47.520935 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:02:47.521116 (+ 181us) client_negotiation.cc:769] Sending connection context
0809 13:02:47.521266 (+ 150us) client_negotiation.cc:240] Negotiation successful
0809 13:02:47.521526 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":323,"threads_started":1}
I20260809 13:02:47.521973 32378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:47.507266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46204 (local address 127.28.155.254:43923)
0809 13:02:47.507490 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:47.507495 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:47.508218 (+ 723us) server_negotiation.cc:407] Connection header received
0809 13:02:47.508356 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:47.508361 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:47.508470 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:47.508593 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:47.509800 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.510562 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.511873 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.512336 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.512444 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:47.516159 (+ 3715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:47.516164 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:47.516168 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:47.516198 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:47.519015 (+ 2817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:47.519849 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:47.519854 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:47.519856 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:47.519995 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:47.520395 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:47.520400 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:47.520405 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:47.520800 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:47.520967 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:47.521381 (+ 414us) server_negotiation.cc:299] Negotiation successful
0809 13:02:47.521664 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":69,"server-negotiator.queue_time_us":79}
I20260809 13:02:47.527660 31984 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:46204:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 13:02:47.528983 31984 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:02:47.536460 32215 tablet_service.cc:1467] Processing CreateTablet for tablet 8b283cd2455e43e48647b9cad0d0de4f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7b55b5e1f0804e118f3a1afdf9bbd34c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 13:02:47.536667 32444 tablet_service.cc:1467] Processing CreateTablet for tablet 8b283cd2455e43e48647b9cad0d0de4f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7b55b5e1f0804e118f3a1afdf9bbd34c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 13:02:47.537038 32656 tablet_service.cc:1467] Processing CreateTablet for tablet 8b283cd2455e43e48647b9cad0d0de4f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7b55b5e1f0804e118f3a1afdf9bbd34c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 13:02:47.537663 32215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b283cd2455e43e48647b9cad0d0de4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:47.537673 32444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b283cd2455e43e48647b9cad0d0de4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:47.537884 32656 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b283cd2455e43e48647b9cad0d0de4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:47.544627 327 tablet_bootstrap.cc:492] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de: Bootstrap starting.
I20260809 13:02:47.545614 328 tablet_bootstrap.cc:492] T 8b283cd2455e43e48647b9cad0d0de4f P 19a60815b9dd4c59bb655d000f25245b: Bootstrap starting.
I20260809 13:02:47.546188 330 tablet_bootstrap.cc:492] T 8b283cd2455e43e48647b9cad0d0de4f P d755e0183b41471da12c8866559fd650: Bootstrap starting.
I20260809 13:02:47.546648 327 tablet_bootstrap.cc:654] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:47.547554 328 tablet_bootstrap.cc:654] T 8b283cd2455e43e48647b9cad0d0de4f P 19a60815b9dd4c59bb655d000f25245b: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:47.547981 330 tablet_bootstrap.cc:654] T 8b283cd2455e43e48647b9cad0d0de4f P d755e0183b41471da12c8866559fd650: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:47.549548 327 tablet_bootstrap.cc:492] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de: No bootstrap required, opened a new log
I20260809 13:02:47.549728 327 ts_tablet_manager.cc:1397] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 13:02:47.550246 328 tablet_bootstrap.cc:492] T 8b283cd2455e43e48647b9cad0d0de4f P 19a60815b9dd4c59bb655d000f25245b: No bootstrap required, opened a new log
I20260809 13:02:47.550417 328 ts_tablet_manager.cc:1397] T 8b283cd2455e43e48647b9cad0d0de4f P 19a60815b9dd4c59bb655d000f25245b: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260809 13:02:47.550655 330 tablet_bootstrap.cc:492] T 8b283cd2455e43e48647b9cad0d0de4f P d755e0183b41471da12c8866559fd650: No bootstrap required, opened a new log
I20260809 13:02:47.550845 330 ts_tablet_manager.cc:1397] T 8b283cd2455e43e48647b9cad0d0de4f P d755e0183b41471da12c8866559fd650: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 13:02:47.551342 328 raft_consensus.cc:348] T 8b283cd2455e43e48647b9cad0d0de4f P 19a60815b9dd4c59bb655d000f25245b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:47.551671 328 raft_consensus.cc:374] T 8b283cd2455e43e48647b9cad0d0de4f P 19a60815b9dd4c59bb655d000f25245b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:47.551510 327 raft_consensus.cc:348] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:47.551770 327 raft_consensus.cc:374] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:47.551777 328 raft_consensus.cc:729] T 8b283cd2455e43e48647b9cad0d0de4f P 19a60815b9dd4c59bb655d000f25245b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a60815b9dd4c59bb655d000f25245b, State: Initialized, Role: FOLLOWER
I20260809 13:02:47.551878 327 raft_consensus.cc:729] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb337635cce249879ce6ed345aae48de, State: Initialized, Role: FOLLOWER
I20260809 13:02:47.551740 330 raft_consensus.cc:348] T 8b283cd2455e43e48647b9cad0d0de4f P d755e0183b41471da12c8866559fd650 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:47.552009 330 raft_consensus.cc:374] T 8b283cd2455e43e48647b9cad0d0de4f P d755e0183b41471da12c8866559fd650 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:47.552121 330 raft_consensus.cc:729] T 8b283cd2455e43e48647b9cad0d0de4f P d755e0183b41471da12c8866559fd650 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d755e0183b41471da12c8866559fd650, State: Initialized, Role: FOLLOWER
I20260809 13:02:47.552037 328 consensus_queue.cc:260] T 8b283cd2455e43e48647b9cad0d0de4f P 19a60815b9dd4c59bb655d000f25245b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:47.552165 327 consensus_queue.cc:260] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:47.552397 330 consensus_queue.cc:260] T 8b283cd2455e43e48647b9cad0d0de4f P d755e0183b41471da12c8866559fd650 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:47.552639 341 tablet_replica.cc:439] T 8b283cd2455e43e48647b9cad0d0de4f P 19a60815b9dd4c59bb655d000f25245b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } } }
I20260809 13:02:47.552882 339 tablet_replica.cc:439] T 8b283cd2455e43e48647b9cad0d0de4f P d755e0183b41471da12c8866559fd650: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } } }
I20260809 13:02:47.552784 340 tablet_replica.cc:439] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } } }
I20260809 13:02:47.553109 341 tablet_replica.cc:442] T 8b283cd2455e43e48647b9cad0d0de4f P 19a60815b9dd4c59bb655d000f25245b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 13:02:47.553135 339 tablet_replica.cc:442] T 8b283cd2455e43e48647b9cad0d0de4f P d755e0183b41471da12c8866559fd650: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 13:02:47.553155 340 tablet_replica.cc:442] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 13:02:47.553606 328 ts_tablet_manager.cc:1428] T 8b283cd2455e43e48647b9cad0d0de4f P 19a60815b9dd4c59bb655d000f25245b: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 13:02:47.554195 327 ts_tablet_manager.cc:1428] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260809 13:02:47.554778 330 ts_tablet_manager.cc:1428] T 8b283cd2455e43e48647b9cad0d0de4f P d755e0183b41471da12c8866559fd650: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
W20260809 13:02:47.633425 32328 tablet.cc:2369] T 331689645f884d3484d1ed3a7b148d1a P 19a60815b9dd4c59bb655d000f25245b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:02:47.683223 340 raft_consensus.cc:482] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:02:47.683475 340 raft_consensus.cc:504] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:47.685318 340 leader_election.cc:288] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19a60815b9dd4c59bb655d000f25245b (127.28.155.193:33043), d755e0183b41471da12c8866559fd650 (127.28.155.195:37653)
I20260809 13:02:47.694064 323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:47.685826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:53979 (local address 127.28.155.193:33043)
0809 13:02:47.686062 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:47.686071 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:47.687194 (+ 1123us) server_negotiation.cc:407] Connection header received
0809 13:02:47.687488 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:47.687497 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:47.687580 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:47.687677 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:02:47.688441 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.689577 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.691977 (+ 2400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.692998 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.693108 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:47.693164 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:47.693619 (+ 455us) server_negotiation.cc:299] Negotiation successful
0809 13:02:47.693752 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260809 13:02:47.694388 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:47.685783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:33043 (local address 127.28.155.194:53979)
0809 13:02:47.687099 (+ 1316us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:47.687115 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:47.687294 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:47.687732 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:47.687737 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:47.687780 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:02:47.688259 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:47.688270 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.689717 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.689722 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:47.691780 (+ 2058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:47.691797 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.693327 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.693331 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:47.693457 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:47.693480 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 13:02:47.693589 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 13:02:47.693719 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1164,"mutex_wait_us":25,"thread_start_us":483,"threads_started":1}
I20260809 13:02:47.694633 324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:47.685838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:56221 (local address 127.28.155.195:37653)
0809 13:02:47.686115 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:47.686123 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:47.686924 (+ 801us) server_negotiation.cc:407] Connection header received
0809 13:02:47.687279 (+ 355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:47.687287 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:47.687387 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:47.687518 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:02:47.688260 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.689434 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.692204 (+ 2770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.693456 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.693586 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:47.693655 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:47.694233 (+ 578us) server_negotiation.cc:299] Negotiation successful
0809 13:02:47.694374 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260809 13:02:47.695093 32257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b283cd2455e43e48647b9cad0d0de4f" candidate_uuid: "bb337635cce249879ce6ed345aae48de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a60815b9dd4c59bb655d000f25245b" is_pre_election: true
I20260809 13:02:47.695356 375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:47.685682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:37653 (local address 127.28.155.194:56221)
0809 13:02:47.686770 (+ 1088us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:47.686796 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:47.687080 (+ 284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:47.687544 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:47.687549 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:47.687573 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:02:47.688078 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:47.688089 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.689588 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.689594 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:47.692018 (+ 2424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:47.692033 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.693873 (+ 1840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.693879 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:47.694055 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:47.694086 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 13:02:47.694820 (+ 734us) client_negotiation.cc:240] Negotiation successful
0809 13:02:47.694958 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":911,"mutex_wait_us":51,"spinlock_wait_cycles":21760,"thread_start_us":1039,"threads_started":1}
I20260809 13:02:47.695377 32257 raft_consensus.cc:2454] T 8b283cd2455e43e48647b9cad0d0de4f P 19a60815b9dd4c59bb655d000f25245b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb337635cce249879ce6ed345aae48de in term 0.
I20260809 13:02:47.695899 32368 leader_election.cc:302] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19a60815b9dd4c59bb655d000f25245b, bb337635cce249879ce6ed345aae48de; no voters:
I20260809 13:02:47.696367 340 raft_consensus.cc:2781] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:02:47.696272 32693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b283cd2455e43e48647b9cad0d0de4f" candidate_uuid: "bb337635cce249879ce6ed345aae48de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d755e0183b41471da12c8866559fd650" is_pre_election: true
I20260809 13:02:47.696548 340 raft_consensus.cc:482] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:02:47.696676 340 raft_consensus.cc:3037] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:47.696758 32693 raft_consensus.cc:2454] T 8b283cd2455e43e48647b9cad0d0de4f P d755e0183b41471da12c8866559fd650 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb337635cce249879ce6ed345aae48de in term 0.
I20260809 13:02:47.699319 340 raft_consensus.cc:504] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:47.699960 340 leader_election.cc:288] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de [CANDIDATE]: Term 1 election: Requested vote from peers 19a60815b9dd4c59bb655d000f25245b (127.28.155.193:33043), d755e0183b41471da12c8866559fd650 (127.28.155.195:37653)
I20260809 13:02:47.700516 32693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b283cd2455e43e48647b9cad0d0de4f" candidate_uuid: "bb337635cce249879ce6ed345aae48de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d755e0183b41471da12c8866559fd650"
I20260809 13:02:47.700469 32257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b283cd2455e43e48647b9cad0d0de4f" candidate_uuid: "bb337635cce249879ce6ed345aae48de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a60815b9dd4c59bb655d000f25245b"
I20260809 13:02:47.700716 32693 raft_consensus.cc:3037] T 8b283cd2455e43e48647b9cad0d0de4f P d755e0183b41471da12c8866559fd650 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:47.700744 32257 raft_consensus.cc:3037] T 8b283cd2455e43e48647b9cad0d0de4f P 19a60815b9dd4c59bb655d000f25245b [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:47.702862 32693 raft_consensus.cc:2454] T 8b283cd2455e43e48647b9cad0d0de4f P d755e0183b41471da12c8866559fd650 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb337635cce249879ce6ed345aae48de in term 1.
I20260809 13:02:47.703260 32371 leader_election.cc:302] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb337635cce249879ce6ed345aae48de, d755e0183b41471da12c8866559fd650; no voters:
I20260809 13:02:47.703572 340 raft_consensus.cc:2781] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:02:47.703724 32257 raft_consensus.cc:2454] T 8b283cd2455e43e48647b9cad0d0de4f P 19a60815b9dd4c59bb655d000f25245b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb337635cce249879ce6ed345aae48de in term 1.
I20260809 13:02:47.704167 340 raft_consensus.cc:686] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de [term 1 LEADER]: Becoming Leader. State: Replica: bb337635cce249879ce6ed345aae48de, State: Running, Role: LEADER
I20260809 13:02:47.704749 340 consensus_queue.cc:237] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:47.708915 377 tablet_replica.cc:439] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de: TxnStatusTablet state changed. Reason: New leader bb337635cce249879ce6ed345aae48de. Latest consensus state: current_term: 1 leader_uuid: "bb337635cce249879ce6ed345aae48de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } } }
I20260809 13:02:47.709272 377 tablet_replica.cc:442] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de: This TxnStatusTablet replica's current role is: LEADER
I20260809 13:02:47.709960 379 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 13:02:47.710219 379 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 13:02:47.709961 31984 catalog_manager.cc:5495] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de reported cstate change: term changed from 0 to 1, leader changed from <none> to bb337635cce249879ce6ed345aae48de (127.28.155.194). New cstate: current_term: 1 leader_uuid: "bb337635cce249879ce6ed345aae48de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } health_report { overall_health: UNKNOWN } } }
I20260809 13:02:47.743559 360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:47.737478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:35145 (local address 127.0.0.1:48774)
0809 13:02:47.737726 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:47.737744 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:47.737899 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:47.738405 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:47.738410 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:47.738423 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 13:02:47.738631 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:47.738646 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.739883 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.739889 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:47.741007 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:47.741020 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.741759 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.741765 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:47.741960 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:47.742015 (+ 55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 13:02:47.742958 (+ 943us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 13:02:47.742982 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 13:02:47.743075 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 13:02:47.743231 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 13:02:47.743561 321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:47.737762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48774 (local address 127.28.155.194:35145)
0809 13:02:47.737989 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:47.737997 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:47.738033 (+ 36us) server_negotiation.cc:407] Connection header received
0809 13:02:47.738144 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:47.738147 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:47.738226 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:47.738374 (+ 148us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:02:47.738790 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.739636 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.741164 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.741588 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.741745 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:47.742221 (+ 476us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:02:47.742837 (+ 616us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:02:47.743004 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:47.743114 (+ 110us) server_negotiation.cc:299] Negotiation successful
0809 13:02:47.743203 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 13:02:47.752942 32693 raft_consensus.cc:1261] T 8b283cd2455e43e48647b9cad0d0de4f P d755e0183b41471da12c8866559fd650 [term 1 FOLLOWER]: Refusing update from remote peer bb337635cce249879ce6ed345aae48de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:02:47.752977 32257 raft_consensus.cc:1261] T 8b283cd2455e43e48647b9cad0d0de4f P 19a60815b9dd4c59bb655d000f25245b [term 1 FOLLOWER]: Refusing update from remote peer bb337635cce249879ce6ed345aae48de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:02:47.754082 340 consensus_queue.cc:1035] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de [LEADER]: Connected to new peer: Peer: permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:02:47.754473 377 consensus_queue.cc:1035] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de [LEADER]: Connected to new peer: Peer: permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:02:47.762509 339 tablet_replica.cc:439] T 8b283cd2455e43e48647b9cad0d0de4f P d755e0183b41471da12c8866559fd650: TxnStatusTablet state changed. Reason: New leader bb337635cce249879ce6ed345aae48de. Latest consensus state: current_term: 1 leader_uuid: "bb337635cce249879ce6ed345aae48de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } } }
I20260809 13:02:47.762917 339 tablet_replica.cc:442] T 8b283cd2455e43e48647b9cad0d0de4f P d755e0183b41471da12c8866559fd650: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 13:02:47.769106 341 tablet_replica.cc:439] T 8b283cd2455e43e48647b9cad0d0de4f P 19a60815b9dd4c59bb655d000f25245b: TxnStatusTablet state changed. Reason: New leader bb337635cce249879ce6ed345aae48de. Latest consensus state: current_term: 1 leader_uuid: "bb337635cce249879ce6ed345aae48de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } } }
I20260809 13:02:47.769443 341 tablet_replica.cc:442] T 8b283cd2455e43e48647b9cad0d0de4f P 19a60815b9dd4c59bb655d000f25245b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 13:02:47.771899 389 mvcc.cc:205] Tried to move back new op lower bound from 7316605205504933888 to 7316605205322645504. Current Snapshot: MvccSnapshot[applied={T|T < 7316605205504933888}]
I20260809 13:02:47.780784 339 tablet_replica.cc:439] T 8b283cd2455e43e48647b9cad0d0de4f P d755e0183b41471da12c8866559fd650: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bb337635cce249879ce6ed345aae48de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } } }
I20260809 13:02:47.780941 340 tablet_replica.cc:439] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bb337635cce249879ce6ed345aae48de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } } }
I20260809 13:02:47.781253 340 tablet_replica.cc:442] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de: This TxnStatusTablet replica's current role is: LEADER
I20260809 13:02:47.783224 339 tablet_replica.cc:442] T 8b283cd2455e43e48647b9cad0d0de4f P d755e0183b41471da12c8866559fd650: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 13:02:47.783699 340 tablet_replica.cc:439] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bb337635cce249879ce6ed345aae48de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } } }
I20260809 13:02:47.783996 340 tablet_replica.cc:442] T 8b283cd2455e43e48647b9cad0d0de4f P bb337635cce249879ce6ed345aae48de: This TxnStatusTablet replica's current role is: LEADER
I20260809 13:02:47.789723 341 tablet_replica.cc:439] T 8b283cd2455e43e48647b9cad0d0de4f P 19a60815b9dd4c59bb655d000f25245b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bb337635cce249879ce6ed345aae48de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } } }
I20260809 13:02:47.790026 341 tablet_replica.cc:442] T 8b283cd2455e43e48647b9cad0d0de4f P 19a60815b9dd4c59bb655d000f25245b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 13:02:47.800868 324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:47.793907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34350 (local address 127.28.155.195:37653)
0809 13:02:47.794100 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:47.794107 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:47.794519 (+ 412us) server_negotiation.cc:407] Connection header received
0809 13:02:47.794731 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:47.794738 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:47.794861 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:47.795036 (+ 175us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:02:47.795363 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.796603 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.798073 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.798767 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.798919 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:47.799385 (+ 466us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:02:47.800160 (+ 775us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:02:47.800324 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:47.800388 (+ 64us) server_negotiation.cc:299] Negotiation successful
0809 13:02:47.800517 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 13:02:47.819159 321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:47.812600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:47569 (local address 127.28.155.194:35145)
0809 13:02:47.812809 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:47.812816 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:47.813211 (+ 395us) server_negotiation.cc:407] Connection header received
0809 13:02:47.813442 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:47.813446 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:47.813517 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:47.813594 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:02:47.814234 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.815013 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.817123 (+ 2110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.817609 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.817712 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:47.818350 (+ 638us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:02:47.818479 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:02:47.818567 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:47.818771 (+ 204us) server_negotiation.cc:299] Negotiation successful
0809 13:02:47.818849 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260809 13:02:47.819283 406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:47.812203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:35145 (local address 127.28.155.195:47569)
0809 13:02:47.813096 (+ 893us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:47.813117 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:47.813287 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:47.813667 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:47.813675 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:47.813693 (+ 18us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 13:02:47.814064 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:47.814078 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.815158 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.815165 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:47.816938 (+ 1773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:47.816956 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.817809 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.817816 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:47.818015 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:47.818095 (+ 80us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 13:02:47.818595 (+ 500us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 13:02:47.818608 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 13:02:47.818700 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 13:02:47.818856 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":681,"thread_start_us":493,"threads_started":1}
I20260809 13:02:47.830116 32257 raft_consensus.cc:1261] T 331689645f884d3484d1ed3a7b148d1a P 19a60815b9dd4c59bb655d000f25245b [term 1 FOLLOWER]: Refusing update from remote peer d755e0183b41471da12c8866559fd650: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:02:47.830448 32476 raft_consensus.cc:1261] T 331689645f884d3484d1ed3a7b148d1a P bb337635cce249879ce6ed345aae48de [term 1 FOLLOWER]: Refusing update from remote peer d755e0183b41471da12c8866559fd650: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:02:47.830884 343 consensus_queue.cc:1035] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:02:47.831288 339 consensus_queue.cc:1035] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:02:47.842289 390 mvcc.cc:205] Tried to move back new op lower bound from 7316605205825101824 to 7316605204211781632. Current Snapshot: MvccSnapshot[applied={T|T < 7316605205825101824}]
I20260809 13:02:47.871723 324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:47.864183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:53059 (local address 127.28.155.195:37653)
0809 13:02:47.864365 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:47.864370 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:47.865245 (+ 875us) server_negotiation.cc:407] Connection header received
0809 13:02:47.865463 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:47.865468 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:47.865548 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:47.865653 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:02:47.866323 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.867412 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.869730 (+ 2318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.870238 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.870382 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:47.870960 (+ 578us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:02:47.871113 (+ 153us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:02:47.871217 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:47.871324 (+ 107us) server_negotiation.cc:299] Negotiation successful
0809 13:02:47.871409 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 13:02:47.871723 413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:47.864117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:37653 (local address 127.28.155.194:53059)
0809 13:02:47.865143 (+ 1026us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:47.865159 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:47.865325 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:47.865675 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:47.865680 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:47.865694 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 13:02:47.866145 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:47.866159 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.867542 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.867548 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:47.869577 (+ 2029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:47.869594 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:47.870476 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:47.870483 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:47.870658 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:47.870737 (+ 79us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 13:02:47.871215 (+ 478us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 13:02:47.871235 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 13:02:47.871304 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 13:02:47.871411 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":834,"thread_start_us":608,"threads_started":1}
I20260809 13:02:47.920172 31984 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46188:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:02:47.920557 31984 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46188:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:02:47.925004 31984 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0fa6fd2d58be42e19db3d470886fb6fc: Sending DeleteTablet for 3 replicas of tablet 331689645f884d3484d1ed3a7b148d1a
I20260809 13:02:47.926398 32215 tablet_service.cc:1514] Processing DeleteTablet for tablet 331689645f884d3484d1ed3a7b148d1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:02:47 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:42904
I20260809 13:02:47.927228 32444 tablet_service.cc:1514] Processing DeleteTablet for tablet 331689645f884d3484d1ed3a7b148d1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:02:47 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:48770
I20260809 13:02:47.927338 416 tablet_replica.cc:330] T 331689645f884d3484d1ed3a7b148d1a P 19a60815b9dd4c59bb655d000f25245b: stopping tablet replica
I20260809 13:02:47.927939 416 raft_consensus.cc:2229] T 331689645f884d3484d1ed3a7b148d1a P 19a60815b9dd4c59bb655d000f25245b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:02:47.928220 32656 tablet_service.cc:1514] Processing DeleteTablet for tablet 331689645f884d3484d1ed3a7b148d1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:02:47 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:34342
I20260809 13:02:47.928506 416 raft_consensus.cc:2258] T 331689645f884d3484d1ed3a7b148d1a P 19a60815b9dd4c59bb655d000f25245b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:02:47.930734 416 ts_tablet_manager.cc:1905] T 331689645f884d3484d1ed3a7b148d1a P 19a60815b9dd4c59bb655d000f25245b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:02:47.933024 418 tablet_replica.cc:330] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650: stopping tablet replica
I20260809 13:02:47.932942 31984 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46188:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 13:02:47.933460 418 raft_consensus.cc:2229] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650 [term 1 LEADER]: Raft consensus shutting down.
W20260809 13:02:47.933681 31984 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:02:47.934154 418 raft_consensus.cc:2258] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:02:47.940968 416 ts_tablet_manager.cc:1918] T 331689645f884d3484d1ed3a7b148d1a P 19a60815b9dd4c59bb655d000f25245b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 13:02:47.941275 416 log.cc:1196] T 331689645f884d3484d1ed3a7b148d1a P 19a60815b9dd4c59bb655d000f25245b: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-0/wal/wals/331689645f884d3484d1ed3a7b148d1a
I20260809 13:02:47.941958 416 ts_tablet_manager.cc:1939] T 331689645f884d3484d1ed3a7b148d1a P 19a60815b9dd4c59bb655d000f25245b: Deleting consensus metadata
I20260809 13:02:47.942857 32443 tablet_service.cc:1467] Processing CreateTablet for tablet bfb43cde89c948649d5e048c570eb30f (DEFAULT_TABLE table=test-table [id=436064c857a4442eaa867bb4a16e835d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:02:47.943495 32443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfb43cde89c948649d5e048c570eb30f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:47.948892 31964 catalog_manager.cc:4841] TS 19a60815b9dd4c59bb655d000f25245b (127.28.155.193:33043): tablet 331689645f884d3484d1ed3a7b148d1a (table test-table [id=0eaa9430f4d946009a728019f234e938]) successfully deleted
I20260809 13:02:47.949589 32215 tablet_service.cc:1467] Processing CreateTablet for tablet bfb43cde89c948649d5e048c570eb30f (DEFAULT_TABLE table=test-table [id=436064c857a4442eaa867bb4a16e835d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:02:47.950074 32215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfb43cde89c948649d5e048c570eb30f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:47.956511 418 ts_tablet_manager.cc:1905] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:02:47.959059 417 tablet_replica.cc:330] T 331689645f884d3484d1ed3a7b148d1a P bb337635cce249879ce6ed345aae48de: stopping tablet replica
I20260809 13:02:47.956916 32656 tablet_service.cc:1467] Processing CreateTablet for tablet bfb43cde89c948649d5e048c570eb30f (DEFAULT_TABLE table=test-table [id=436064c857a4442eaa867bb4a16e835d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:02:47.959821 32656 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfb43cde89c948649d5e048c570eb30f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:47.961042 417 raft_consensus.cc:2229] T 331689645f884d3484d1ed3a7b148d1a P bb337635cce249879ce6ed345aae48de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:02:47.961934 417 raft_consensus.cc:2258] T 331689645f884d3484d1ed3a7b148d1a P bb337635cce249879ce6ed345aae48de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:02:47.966001 417 ts_tablet_manager.cc:1905] T 331689645f884d3484d1ed3a7b148d1a P bb337635cce249879ce6ed345aae48de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:02:47.967521 328 tablet_bootstrap.cc:492] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b: Bootstrap starting.
I20260809 13:02:47.969499 328 tablet_bootstrap.cc:654] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:47.974424 327 tablet_bootstrap.cc:492] T bfb43cde89c948649d5e048c570eb30f P bb337635cce249879ce6ed345aae48de: Bootstrap starting.
I20260809 13:02:47.976967 418 ts_tablet_manager.cc:1918] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 13:02:47.977241 327 tablet_bootstrap.cc:654] T bfb43cde89c948649d5e048c570eb30f P bb337635cce249879ce6ed345aae48de: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:47.979560 328 tablet_bootstrap.cc:492] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b: No bootstrap required, opened a new log
I20260809 13:02:47.979761 328 ts_tablet_manager.cc:1397] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.001s
I20260809 13:02:47.980666 328 raft_consensus.cc:348] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:47.980952 328 raft_consensus.cc:374] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:47.981045 328 raft_consensus.cc:729] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a60815b9dd4c59bb655d000f25245b, State: Initialized, Role: FOLLOWER
I20260809 13:02:47.983326 417 ts_tablet_manager.cc:1918] T 331689645f884d3484d1ed3a7b148d1a P bb337635cce249879ce6ed345aae48de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 13:02:47.983556 417 log.cc:1196] T 331689645f884d3484d1ed3a7b148d1a P bb337635cce249879ce6ed345aae48de: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-1/wal/wals/331689645f884d3484d1ed3a7b148d1a
I20260809 13:02:47.984208 417 ts_tablet_manager.cc:1939] T 331689645f884d3484d1ed3a7b148d1a P bb337635cce249879ce6ed345aae48de: Deleting consensus metadata
I20260809 13:02:47.977278 330 tablet_bootstrap.cc:492] T bfb43cde89c948649d5e048c570eb30f P d755e0183b41471da12c8866559fd650: Bootstrap starting.
I20260809 13:02:47.986351 31965 catalog_manager.cc:4841] TS bb337635cce249879ce6ed345aae48de (127.28.155.194:35145): tablet 331689645f884d3484d1ed3a7b148d1a (table test-table [id=0eaa9430f4d946009a728019f234e938]) successfully deleted
I20260809 13:02:47.988078 330 tablet_bootstrap.cc:654] T bfb43cde89c948649d5e048c570eb30f P d755e0183b41471da12c8866559fd650: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:47.990024 418 log.cc:1196] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-2/wal/wals/331689645f884d3484d1ed3a7b148d1a
I20260809 13:02:47.990703 418 ts_tablet_manager.cc:1939] T 331689645f884d3484d1ed3a7b148d1a P d755e0183b41471da12c8866559fd650: Deleting consensus metadata
I20260809 13:02:47.992326 330 tablet_bootstrap.cc:492] T bfb43cde89c948649d5e048c570eb30f P d755e0183b41471da12c8866559fd650: No bootstrap required, opened a new log
I20260809 13:02:47.992614 330 ts_tablet_manager.cc:1397] T bfb43cde89c948649d5e048c570eb30f P d755e0183b41471da12c8866559fd650: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.000s
I20260809 13:02:47.992722 31965 catalog_manager.cc:4841] TS d755e0183b41471da12c8866559fd650 (127.28.155.195:37653): tablet 331689645f884d3484d1ed3a7b148d1a (table test-table [id=0eaa9430f4d946009a728019f234e938]) successfully deleted
I20260809 13:02:47.992863 328 consensus_queue.cc:260] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:47.993639 328 ts_tablet_manager.cc:1428] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260809 13:02:47.994853 330 raft_consensus.cc:348] T bfb43cde89c948649d5e048c570eb30f P d755e0183b41471da12c8866559fd650 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:47.995136 330 raft_consensus.cc:374] T bfb43cde89c948649d5e048c570eb30f P d755e0183b41471da12c8866559fd650 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:47.995226 330 raft_consensus.cc:729] T bfb43cde89c948649d5e048c570eb30f P d755e0183b41471da12c8866559fd650 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d755e0183b41471da12c8866559fd650, State: Initialized, Role: FOLLOWER
I20260809 13:02:47.995517 330 consensus_queue.cc:260] T bfb43cde89c948649d5e048c570eb30f P d755e0183b41471da12c8866559fd650 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:47.996213 330 ts_tablet_manager.cc:1428] T bfb43cde89c948649d5e048c570eb30f P d755e0183b41471da12c8866559fd650: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260809 13:02:47.997671 327 tablet_bootstrap.cc:492] T bfb43cde89c948649d5e048c570eb30f P bb337635cce249879ce6ed345aae48de: No bootstrap required, opened a new log
I20260809 13:02:47.997885 327 ts_tablet_manager.cc:1397] T bfb43cde89c948649d5e048c570eb30f P bb337635cce249879ce6ed345aae48de: Time spent bootstrapping tablet: real 0.024s user 0.007s sys 0.009s
I20260809 13:02:47.998682 327 raft_consensus.cc:348] T bfb43cde89c948649d5e048c570eb30f P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:47.998986 327 raft_consensus.cc:374] T bfb43cde89c948649d5e048c570eb30f P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:47.999091 327 raft_consensus.cc:729] T bfb43cde89c948649d5e048c570eb30f P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb337635cce249879ce6ed345aae48de, State: Initialized, Role: FOLLOWER
I20260809 13:02:47.999339 327 consensus_queue.cc:260] T bfb43cde89c948649d5e048c570eb30f P bb337635cce249879ce6ed345aae48de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:47.999943 327 ts_tablet_manager.cc:1428] T bfb43cde89c948649d5e048c570eb30f P bb337635cce249879ce6ed345aae48de: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260809 13:02:48.045028 341 raft_consensus.cc:482] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:02:48.045324 341 raft_consensus.cc:504] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:48.047318 341 leader_election.cc:288] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb337635cce249879ce6ed345aae48de (127.28.155.194:35145), d755e0183b41471da12c8866559fd650 (127.28.155.195:37653)
I20260809 13:02:48.056787 321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:48.047873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:39743 (local address 127.28.155.194:35145)
0809 13:02:48.048109 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:48.048115 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:48.048724 (+ 609us) server_negotiation.cc:407] Connection header received
0809 13:02:48.049028 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:48.049035 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:48.049121 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:48.049186 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:02:48.050272 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:48.051392 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:48.054035 (+ 2643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:48.055425 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:48.055572 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:48.055654 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:48.056260 (+ 606us) server_negotiation.cc:299] Negotiation successful
0809 13:02:48.056417 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 13:02:48.057888 422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:48.047538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:35145 (local address 127.28.155.193:39743)
0809 13:02:48.048611 (+ 1073us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:48.048633 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:48.048848 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:48.049690 (+ 842us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:48.049697 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:48.049730 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:02:48.050089 (+ 359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:48.050102 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:48.051598 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:48.051604 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:48.053824 (+ 2220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:48.053839 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:48.055869 (+ 2030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:48.055875 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:48.056057 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:48.056096 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 13:02:48.057356 (+ 1260us) client_negotiation.cc:240] Negotiation successful
0809 13:02:48.057520 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":907,"thread_start_us":719,"threads_started":1}
I20260809 13:02:48.060307 32476 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfb43cde89c948649d5e048c570eb30f" candidate_uuid: "19a60815b9dd4c59bb655d000f25245b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb337635cce249879ce6ed345aae48de" is_pre_election: true
I20260809 13:02:48.060639 32476 raft_consensus.cc:2454] T bfb43cde89c948649d5e048c570eb30f P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19a60815b9dd4c59bb655d000f25245b in term 0.
I20260809 13:02:48.061385 32135 leader_election.cc:302] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19a60815b9dd4c59bb655d000f25245b, bb337635cce249879ce6ed345aae48de; no voters:
I20260809 13:02:48.061867 341 raft_consensus.cc:2781] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:02:48.062000 341 raft_consensus.cc:482] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:02:48.062096 341 raft_consensus.cc:3037] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:48.065455 341 raft_consensus.cc:504] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:48.066191 341 leader_election.cc:288] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b [CANDIDATE]: Term 1 election: Requested vote from peers bb337635cce249879ce6ed345aae48de (127.28.155.194:35145), d755e0183b41471da12c8866559fd650 (127.28.155.195:37653)
I20260809 13:02:48.066754 32476 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfb43cde89c948649d5e048c570eb30f" candidate_uuid: "19a60815b9dd4c59bb655d000f25245b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb337635cce249879ce6ed345aae48de"
I20260809 13:02:48.067045 32476 raft_consensus.cc:3037] T bfb43cde89c948649d5e048c570eb30f P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:48.070612 32476 raft_consensus.cc:2454] T bfb43cde89c948649d5e048c570eb30f P bb337635cce249879ce6ed345aae48de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19a60815b9dd4c59bb655d000f25245b in term 1.
I20260809 13:02:48.071430 32135 leader_election.cc:302] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19a60815b9dd4c59bb655d000f25245b, bb337635cce249879ce6ed345aae48de; no voters:
I20260809 13:02:48.071866 341 raft_consensus.cc:2781] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:02:48.072368 341 raft_consensus.cc:686] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b [term 1 LEADER]: Becoming Leader. State: Replica: 19a60815b9dd4c59bb655d000f25245b, State: Running, Role: LEADER
I20260809 13:02:48.073189 341 consensus_queue.cc:237] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:48.077381 324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:48.049181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:38065 (local address 127.28.155.195:37653)
0809 13:02:48.049409 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:48.049415 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:48.058384 (+ 8969us) server_negotiation.cc:407] Connection header received
0809 13:02:48.058681 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:48.058688 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:48.058770 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:48.058839 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:02:48.059525 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:48.060815 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:48.069557 (+ 8742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:48.071033 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:48.071172 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:48.071260 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:48.076846 (+ 5586us) server_negotiation.cc:299] Negotiation successful
0809 13:02:48.077035 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 13:02:48.077374 31985 catalog_manager.cc:5495] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b reported cstate change: term changed from 0 to 1, leader changed from <none> to 19a60815b9dd4c59bb655d000f25245b (127.28.155.193). New cstate: current_term: 1 leader_uuid: "19a60815b9dd4c59bb655d000f25245b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } health_report { overall_health: UNKNOWN } } }
I20260809 13:02:48.078100 422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:48.048747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:37653 (local address 127.28.155.193:38065)
0809 13:02:48.058285 (+ 9538us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:48.058305 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:48.058512 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:48.059042 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:48.059046 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:48.059073 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:02:48.059325 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:48.059340 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:48.061213 (+ 1873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:48.061219 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:48.069303 (+ 8084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:48.069325 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:48.071532 (+ 2207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:48.071539 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:48.076626 (+ 5087us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:48.076666 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 13:02:48.077587 (+ 921us) client_negotiation.cc:240] Negotiation successful
0809 13:02:48.077763 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9439,"thread_start_us":10693,"threads_started":1}
I20260809 13:02:48.079270 32692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfb43cde89c948649d5e048c570eb30f" candidate_uuid: "19a60815b9dd4c59bb655d000f25245b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d755e0183b41471da12c8866559fd650"
I20260809 13:02:48.079620 32692 raft_consensus.cc:3037] T bfb43cde89c948649d5e048c570eb30f P d755e0183b41471da12c8866559fd650 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:48.079617 32693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfb43cde89c948649d5e048c570eb30f" candidate_uuid: "19a60815b9dd4c59bb655d000f25245b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d755e0183b41471da12c8866559fd650" is_pre_election: true
I20260809 13:02:48.083138 32692 raft_consensus.cc:2454] T bfb43cde89c948649d5e048c570eb30f P d755e0183b41471da12c8866559fd650 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19a60815b9dd4c59bb655d000f25245b in term 1.
I20260809 13:02:48.116039 323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:48.108840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42910 (local address 127.28.155.193:33043)
0809 13:02:48.109027 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:48.109034 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:48.109054 (+ 20us) server_negotiation.cc:407] Connection header received
0809 13:02:48.109167 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:48.109174 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:48.109298 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:48.109489 (+ 191us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:02:48.109934 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:48.111109 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:48.113130 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:48.113811 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:48.113953 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:48.114541 (+ 588us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:02:48.115333 (+ 792us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:02:48.115532 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:48.115593 (+ 61us) server_negotiation.cc:299] Negotiation successful
0809 13:02:48.115691 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 13:02:48.157052 321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:48.129026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:35519 (local address 127.28.155.194:35145)
0809 13:02:48.129327 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:48.129334 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:48.149330 (+ 19996us) server_negotiation.cc:407] Connection header received
0809 13:02:48.149612 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:48.149623 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:48.149742 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:48.149823 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:02:48.150796 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:48.152074 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:48.154415 (+ 2341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:48.155131 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:48.155254 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:48.156055 (+ 801us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:02:48.156217 (+ 162us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:02:48.156302 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:48.156602 (+ 300us) server_negotiation.cc:299] Negotiation successful
0809 13:02:48.156712 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143}
I20260809 13:02:48.158038 436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:48.129508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:35145 (local address 127.28.155.193:35519)
0809 13:02:48.149161 (+ 19653us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:48.149183 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:48.149403 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:48.150087 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:48.150093 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:48.150108 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 13:02:48.150549 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:48.150569 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:48.152342 (+ 1773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:48.152348 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:48.154234 (+ 1886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:48.154252 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:48.155479 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:48.155487 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:48.155685 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:48.155775 (+ 90us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 13:02:48.156401 (+ 626us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 13:02:48.156420 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 13:02:48.157396 (+ 976us) client_negotiation.cc:240] Negotiation successful
0809 13:02:48.157573 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19455,"thread_start_us":19201,"threads_started":1}
I20260809 13:02:48.170387 32476 raft_consensus.cc:1261] T bfb43cde89c948649d5e048c570eb30f P bb337635cce249879ce6ed345aae48de [term 1 FOLLOWER]: Refusing update from remote peer 19a60815b9dd4c59bb655d000f25245b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:02:48.171269 427 consensus_queue.cc:1035] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:02:48.174561 32692 raft_consensus.cc:1261] T bfb43cde89c948649d5e048c570eb30f P d755e0183b41471da12c8866559fd650 [term 1 FOLLOWER]: Refusing update from remote peer 19a60815b9dd4c59bb655d000f25245b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:02:48.175323 427 consensus_queue.cc:1035] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:02:48.188112 391 mvcc.cc:205] Tried to move back new op lower bound from 7316605207216230400 to 7316605206832619520. Current Snapshot: MvccSnapshot[applied={T|T < 7316605207216230400}]
I20260809 13:02:48.222851 413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:48.215769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:33043 (local address 127.28.155.194:48687)
0809 13:02:48.216157 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:48.216179 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:48.216307 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:48.217086 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:48.217091 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:48.217105 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 13:02:48.217330 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:48.217350 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:48.218728 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:48.218736 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:48.220445 (+ 1709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:48.220459 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:48.221491 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:48.221498 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:48.221709 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:48.221762 (+ 53us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 13:02:48.222275 (+ 513us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 13:02:48.222289 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 13:02:48.222367 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 13:02:48.222513 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220}
I20260809 13:02:48.223511 323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:48.216406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:48687 (local address 127.28.155.193:33043)
0809 13:02:48.216609 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:48.216615 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:48.216634 (+ 19us) server_negotiation.cc:407] Connection header received
0809 13:02:48.216724 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:48.216729 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:48.216817 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:48.216907 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:02:48.217526 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:48.218565 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:48.220646 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:48.221231 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:48.221357 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:48.221991 (+ 634us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:02:48.222132 (+ 141us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:02:48.222220 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:48.223116 (+ 896us) server_negotiation.cc:299] Negotiation successful
0809 13:02:48.223193 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260809 13:02:48.224799 391 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 13:02:49.848290 31985 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46188:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:02:49.848636 31985 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46188:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:02:49.853086 31985 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0fa6fd2d58be42e19db3d470886fb6fc: Sending DeleteTablet for 3 replicas of tablet bfb43cde89c948649d5e048c570eb30f
I20260809 13:02:49.854071 32215 tablet_service.cc:1514] Processing DeleteTablet for tablet bfb43cde89c948649d5e048c570eb30f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:02:49 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:42904
I20260809 13:02:49.854146 32444 tablet_service.cc:1514] Processing DeleteTablet for tablet bfb43cde89c948649d5e048c570eb30f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:02:49 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:48770
I20260809 13:02:49.854303 32656 tablet_service.cc:1514] Processing DeleteTablet for tablet bfb43cde89c948649d5e048c570eb30f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:02:49 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:34342
I20260809 13:02:49.865314 476 tablet_replica.cc:330] T bfb43cde89c948649d5e048c570eb30f P bb337635cce249879ce6ed345aae48de: stopping tablet replica
I20260809 13:02:49.865598 476 raft_consensus.cc:2229] T bfb43cde89c948649d5e048c570eb30f P bb337635cce249879ce6ed345aae48de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:02:49.865830 475 tablet_replica.cc:330] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b: stopping tablet replica
I20260809 13:02:49.865885 476 raft_consensus.cc:2258] T bfb43cde89c948649d5e048c570eb30f P bb337635cce249879ce6ed345aae48de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:02:49.865913 479 tablet_replica.cc:330] T bfb43cde89c948649d5e048c570eb30f P d755e0183b41471da12c8866559fd650: stopping tablet replica
I20260809 13:02:49.866199 475 raft_consensus.cc:2229] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b [term 1 LEADER]: Raft consensus shutting down.
I20260809 13:02:49.866480 479 raft_consensus.cc:2229] T bfb43cde89c948649d5e048c570eb30f P d755e0183b41471da12c8866559fd650 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:02:49.866777 479 raft_consensus.cc:2258] T bfb43cde89c948649d5e048c570eb30f P d755e0183b41471da12c8866559fd650 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:02:49.867043 475 raft_consensus.cc:2258] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:02:49.867874 476 ts_tablet_manager.cc:1905] T bfb43cde89c948649d5e048c570eb30f P bb337635cce249879ce6ed345aae48de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:02:49.868150 475 ts_tablet_manager.cc:1905] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:02:49.868178 479 ts_tablet_manager.cc:1905] T bfb43cde89c948649d5e048c570eb30f P d755e0183b41471da12c8866559fd650: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:02:49.875360 475 ts_tablet_manager.cc:1918] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 13:02:49.875360 479 ts_tablet_manager.cc:1918] T bfb43cde89c948649d5e048c570eb30f P d755e0183b41471da12c8866559fd650: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 13:02:49.875523 479 log.cc:1196] T bfb43cde89c948649d5e048c570eb30f P d755e0183b41471da12c8866559fd650: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-2/wal/wals/bfb43cde89c948649d5e048c570eb30f
I20260809 13:02:49.875641 476 ts_tablet_manager.cc:1918] T bfb43cde89c948649d5e048c570eb30f P bb337635cce249879ce6ed345aae48de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 13:02:49.875675 475 log.cc:1196] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-0/wal/wals/bfb43cde89c948649d5e048c570eb30f
I20260809 13:02:49.875824 476 log.cc:1196] T bfb43cde89c948649d5e048c570eb30f P bb337635cce249879ce6ed345aae48de: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-1/wal/wals/bfb43cde89c948649d5e048c570eb30f
I20260809 13:02:49.876242 479 ts_tablet_manager.cc:1939] T bfb43cde89c948649d5e048c570eb30f P d755e0183b41471da12c8866559fd650: Deleting consensus metadata
I20260809 13:02:49.876332 476 ts_tablet_manager.cc:1939] T bfb43cde89c948649d5e048c570eb30f P bb337635cce249879ce6ed345aae48de: Deleting consensus metadata
I20260809 13:02:49.876602 475 ts_tablet_manager.cc:1939] T bfb43cde89c948649d5e048c570eb30f P 19a60815b9dd4c59bb655d000f25245b: Deleting consensus metadata
I20260809 13:02:49.877688 31965 catalog_manager.cc:4841] TS bb337635cce249879ce6ed345aae48de (127.28.155.194:35145): tablet bfb43cde89c948649d5e048c570eb30f (table test-table [id=436064c857a4442eaa867bb4a16e835d]) successfully deleted
I20260809 13:02:49.877789 31964 catalog_manager.cc:4841] TS 19a60815b9dd4c59bb655d000f25245b (127.28.155.193:33043): tablet bfb43cde89c948649d5e048c570eb30f (table test-table [id=436064c857a4442eaa867bb4a16e835d]) successfully deleted
I20260809 13:02:49.878010 31965 catalog_manager.cc:4841] TS d755e0183b41471da12c8866559fd650 (127.28.155.195:37653): tablet bfb43cde89c948649d5e048c570eb30f (table test-table [id=436064c857a4442eaa867bb4a16e835d]) successfully deleted
Aug 09 13:02:49 dist-test-slave-jq4t krb5kdc[31925](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280569, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 13:02:49 dist-test-slave-jq4t krb5kdc[31925](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280569, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:02:49.922941 494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:49.907810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46214 (local address 127.28.155.254:43923)
0809 13:02:49.908451 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:49.908456 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:49.908543 (+ 87us) server_negotiation.cc:407] Connection header received
0809 13:02:49.908683 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:49.908687 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:49.908757 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:49.908870 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:49.910234 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:49.911141 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:49.912400 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:49.912911 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:49.913037 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:49.917344 (+ 4307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:49.917350 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:49.917353 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:49.917392 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:49.920442 (+ 3050us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:49.921243 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:49.921247 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:49.921249 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:49.921387 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:49.921729 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:49.921732 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:49.921734 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:49.922021 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:49.922221 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:49.922486 (+ 265us) server_negotiation.cc:299] Negotiation successful
0809 13:02:49.922665 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":519,"thread_start_us":350,"threads_started":1}
I20260809 13:02:49.927009 31985 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46214:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 13:02:49.927731 31985 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:02:49.935510 32215 tablet_service.cc:1467] Processing CreateTablet for tablet d36cb2aaaedf4852bf1c6b5b41e38d10 (DEFAULT_TABLE table=test-table [id=72b61152b68f47a08f4bfe870e407efe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:02:49.935510 32444 tablet_service.cc:1467] Processing CreateTablet for tablet d36cb2aaaedf4852bf1c6b5b41e38d10 (DEFAULT_TABLE table=test-table [id=72b61152b68f47a08f4bfe870e407efe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:02:49.935731 32656 tablet_service.cc:1467] Processing CreateTablet for tablet d36cb2aaaedf4852bf1c6b5b41e38d10 (DEFAULT_TABLE table=test-table [id=72b61152b68f47a08f4bfe870e407efe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:02:49.936028 32215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d36cb2aaaedf4852bf1c6b5b41e38d10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:49.936028 32444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d36cb2aaaedf4852bf1c6b5b41e38d10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:49.936149 32656 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d36cb2aaaedf4852bf1c6b5b41e38d10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:49.942256 495 tablet_bootstrap.cc:492] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650: Bootstrap starting.
I20260809 13:02:49.943271 499 tablet_bootstrap.cc:492] T d36cb2aaaedf4852bf1c6b5b41e38d10 P 19a60815b9dd4c59bb655d000f25245b: Bootstrap starting.
I20260809 13:02:49.944362 495 tablet_bootstrap.cc:654] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:49.944995 497 tablet_bootstrap.cc:492] T d36cb2aaaedf4852bf1c6b5b41e38d10 P bb337635cce249879ce6ed345aae48de: Bootstrap starting.
I20260809 13:02:49.946823 499 tablet_bootstrap.cc:654] T d36cb2aaaedf4852bf1c6b5b41e38d10 P 19a60815b9dd4c59bb655d000f25245b: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:49.946885 497 tablet_bootstrap.cc:654] T d36cb2aaaedf4852bf1c6b5b41e38d10 P bb337635cce249879ce6ed345aae48de: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:49.946973 495 tablet_bootstrap.cc:492] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650: No bootstrap required, opened a new log
I20260809 13:02:49.947131 495 ts_tablet_manager.cc:1397] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 13:02:49.947855 495 raft_consensus.cc:348] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:49.948160 495 raft_consensus.cc:374] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:49.948259 495 raft_consensus.cc:729] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d755e0183b41471da12c8866559fd650, State: Initialized, Role: FOLLOWER
I20260809 13:02:49.948573 495 consensus_queue.cc:260] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:49.949498 497 tablet_bootstrap.cc:492] T d36cb2aaaedf4852bf1c6b5b41e38d10 P bb337635cce249879ce6ed345aae48de: No bootstrap required, opened a new log
I20260809 13:02:49.949651 497 ts_tablet_manager.cc:1397] T d36cb2aaaedf4852bf1c6b5b41e38d10 P bb337635cce249879ce6ed345aae48de: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 13:02:49.949695 499 tablet_bootstrap.cc:492] T d36cb2aaaedf4852bf1c6b5b41e38d10 P 19a60815b9dd4c59bb655d000f25245b: No bootstrap required, opened a new log
I20260809 13:02:49.949869 499 ts_tablet_manager.cc:1397] T d36cb2aaaedf4852bf1c6b5b41e38d10 P 19a60815b9dd4c59bb655d000f25245b: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260809 13:02:49.950675 495 ts_tablet_manager.cc:1428] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260809 13:02:49.950551 497 raft_consensus.cc:348] T d36cb2aaaedf4852bf1c6b5b41e38d10 P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:49.950843 497 raft_consensus.cc:374] T d36cb2aaaedf4852bf1c6b5b41e38d10 P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:49.950758 499 raft_consensus.cc:348] T d36cb2aaaedf4852bf1c6b5b41e38d10 P 19a60815b9dd4c59bb655d000f25245b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:49.950964 497 raft_consensus.cc:729] T d36cb2aaaedf4852bf1c6b5b41e38d10 P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb337635cce249879ce6ed345aae48de, State: Initialized, Role: FOLLOWER
I20260809 13:02:49.951061 499 raft_consensus.cc:374] T d36cb2aaaedf4852bf1c6b5b41e38d10 P 19a60815b9dd4c59bb655d000f25245b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:49.951174 499 raft_consensus.cc:729] T d36cb2aaaedf4852bf1c6b5b41e38d10 P 19a60815b9dd4c59bb655d000f25245b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a60815b9dd4c59bb655d000f25245b, State: Initialized, Role: FOLLOWER
I20260809 13:02:49.951272 497 consensus_queue.cc:260] T d36cb2aaaedf4852bf1c6b5b41e38d10 P bb337635cce249879ce6ed345aae48de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:49.951449 499 consensus_queue.cc:260] T d36cb2aaaedf4852bf1c6b5b41e38d10 P 19a60815b9dd4c59bb655d000f25245b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:49.951869 497 ts_tablet_manager.cc:1428] T d36cb2aaaedf4852bf1c6b5b41e38d10 P bb337635cce249879ce6ed345aae48de: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 13:02:49.952033 499 ts_tablet_manager.cc:1428] T d36cb2aaaedf4852bf1c6b5b41e38d10 P 19a60815b9dd4c59bb655d000f25245b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260809 13:02:50.165620 503 raft_consensus.cc:482] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:02:50.165946 503 raft_consensus.cc:504] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:50.166764 503 leader_election.cc:288] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19a60815b9dd4c59bb655d000f25245b (127.28.155.193:33043), bb337635cce249879ce6ed345aae48de (127.28.155.194:35145)
I20260809 13:02:50.167400 32476 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36cb2aaaedf4852bf1c6b5b41e38d10" candidate_uuid: "d755e0183b41471da12c8866559fd650" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb337635cce249879ce6ed345aae48de" is_pre_election: true
I20260809 13:02:50.167390 32251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36cb2aaaedf4852bf1c6b5b41e38d10" candidate_uuid: "d755e0183b41471da12c8866559fd650" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a60815b9dd4c59bb655d000f25245b" is_pre_election: true
I20260809 13:02:50.167665 32476 raft_consensus.cc:2454] T d36cb2aaaedf4852bf1c6b5b41e38d10 P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d755e0183b41471da12c8866559fd650 in term 0.
I20260809 13:02:50.167698 32251 raft_consensus.cc:2454] T d36cb2aaaedf4852bf1c6b5b41e38d10 P 19a60815b9dd4c59bb655d000f25245b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d755e0183b41471da12c8866559fd650 in term 0.
I20260809 13:02:50.168241 32584 leader_election.cc:302] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19a60815b9dd4c59bb655d000f25245b, d755e0183b41471da12c8866559fd650; no voters:
I20260809 13:02:50.168598 503 raft_consensus.cc:2781] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:02:50.168736 503 raft_consensus.cc:482] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:02:50.168851 503 raft_consensus.cc:3037] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:50.171097 503 raft_consensus.cc:504] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:50.171871 503 leader_election.cc:288] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650 [CANDIDATE]: Term 1 election: Requested vote from peers 19a60815b9dd4c59bb655d000f25245b (127.28.155.193:33043), bb337635cce249879ce6ed345aae48de (127.28.155.194:35145)
I20260809 13:02:50.172588 32251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36cb2aaaedf4852bf1c6b5b41e38d10" candidate_uuid: "d755e0183b41471da12c8866559fd650" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a60815b9dd4c59bb655d000f25245b"
I20260809 13:02:50.172614 32476 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36cb2aaaedf4852bf1c6b5b41e38d10" candidate_uuid: "d755e0183b41471da12c8866559fd650" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb337635cce249879ce6ed345aae48de"
I20260809 13:02:50.172837 32251 raft_consensus.cc:3037] T d36cb2aaaedf4852bf1c6b5b41e38d10 P 19a60815b9dd4c59bb655d000f25245b [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:50.172915 32476 raft_consensus.cc:3037] T d36cb2aaaedf4852bf1c6b5b41e38d10 P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:50.175215 32251 raft_consensus.cc:2454] T d36cb2aaaedf4852bf1c6b5b41e38d10 P 19a60815b9dd4c59bb655d000f25245b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d755e0183b41471da12c8866559fd650 in term 1.
I20260809 13:02:50.175372 32476 raft_consensus.cc:2454] T d36cb2aaaedf4852bf1c6b5b41e38d10 P bb337635cce249879ce6ed345aae48de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d755e0183b41471da12c8866559fd650 in term 1.
I20260809 13:02:50.175858 32584 leader_election.cc:302] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 19a60815b9dd4c59bb655d000f25245b, bb337635cce249879ce6ed345aae48de, d755e0183b41471da12c8866559fd650; no voters:
I20260809 13:02:50.176246 503 raft_consensus.cc:2781] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:02:50.176805 503 raft_consensus.cc:686] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650 [term 1 LEADER]: Becoming Leader. State: Replica: d755e0183b41471da12c8866559fd650, State: Running, Role: LEADER
I20260809 13:02:50.177142 503 consensus_queue.cc:237] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:50.179963 31983 catalog_manager.cc:5495] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650 reported cstate change: term changed from 0 to 1, leader changed from <none> to d755e0183b41471da12c8866559fd650 (127.28.155.195). New cstate: current_term: 1 leader_uuid: "d755e0183b41471da12c8866559fd650" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } health_report { overall_health: HEALTHY } } }
I20260809 13:02:50.255182 509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:50.249017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34352 (local address 127.28.155.195:37653)
0809 13:02:50.249638 (+ 621us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:50.249642 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:50.249662 (+ 20us) server_negotiation.cc:407] Connection header received
0809 13:02:50.249716 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:50.249719 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:50.249781 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:50.249866 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:02:50.250364 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:50.251202 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:50.253191 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:50.253650 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:50.253747 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:50.254308 (+ 561us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:02:50.254432 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:02:50.254501 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:50.254679 (+ 178us) server_negotiation.cc:299] Negotiation successful
0809 13:02:50.254749 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":495,"thread_start_us":376,"threads_started":1}
I20260809 13:02:50.266294 32251 raft_consensus.cc:1261] T d36cb2aaaedf4852bf1c6b5b41e38d10 P 19a60815b9dd4c59bb655d000f25245b [term 1 FOLLOWER]: Refusing update from remote peer d755e0183b41471da12c8866559fd650: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:02:50.266330 32476 raft_consensus.cc:1261] T d36cb2aaaedf4852bf1c6b5b41e38d10 P bb337635cce249879ce6ed345aae48de [term 1 FOLLOWER]: Refusing update from remote peer d755e0183b41471da12c8866559fd650: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:02:50.266997 503 consensus_queue.cc:1035] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:02:50.267339 505 consensus_queue.cc:1035] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:02:50.317246 31983 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46214:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:02:50.317574 31983 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46214:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:02:50.320910 31983 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0fa6fd2d58be42e19db3d470886fb6fc: Sending DeleteTablet for 3 replicas of tablet d36cb2aaaedf4852bf1c6b5b41e38d10
I20260809 13:02:50.321826 32215 tablet_service.cc:1514] Processing DeleteTablet for tablet d36cb2aaaedf4852bf1c6b5b41e38d10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:02:50 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:42904
I20260809 13:02:50.321995 32444 tablet_service.cc:1514] Processing DeleteTablet for tablet d36cb2aaaedf4852bf1c6b5b41e38d10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:02:50 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:48770
I20260809 13:02:50.322034 32656 tablet_service.cc:1514] Processing DeleteTablet for tablet d36cb2aaaedf4852bf1c6b5b41e38d10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:02:50 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:34342
I20260809 13:02:50.322260 475 tablet_replica.cc:330] T d36cb2aaaedf4852bf1c6b5b41e38d10 P 19a60815b9dd4c59bb655d000f25245b: stopping tablet replica
I20260809 13:02:50.322438 475 raft_consensus.cc:2229] T d36cb2aaaedf4852bf1c6b5b41e38d10 P 19a60815b9dd4c59bb655d000f25245b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:02:50.322639 475 raft_consensus.cc:2258] T d36cb2aaaedf4852bf1c6b5b41e38d10 P 19a60815b9dd4c59bb655d000f25245b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:02:50.322715 476 tablet_replica.cc:330] T d36cb2aaaedf4852bf1c6b5b41e38d10 P bb337635cce249879ce6ed345aae48de: stopping tablet replica
I20260809 13:02:50.322953 476 raft_consensus.cc:2229] T d36cb2aaaedf4852bf1c6b5b41e38d10 P bb337635cce249879ce6ed345aae48de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:02:50.323210 476 raft_consensus.cc:2258] T d36cb2aaaedf4852bf1c6b5b41e38d10 P bb337635cce249879ce6ed345aae48de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:02:50.323531 479 tablet_replica.cc:330] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650: stopping tablet replica
I20260809 13:02:50.323287 31983 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46214:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 13:02:50.323760 479 raft_consensus.cc:2229] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650 [term 1 LEADER]: Raft consensus shutting down.
W20260809 13:02:50.323974 31983 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:02:50.324139 479 raft_consensus.cc:2258] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:02:50.324533 476 ts_tablet_manager.cc:1905] T d36cb2aaaedf4852bf1c6b5b41e38d10 P bb337635cce249879ce6ed345aae48de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:02:50.325327 479 ts_tablet_manager.cc:1905] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:02:50.326287 475 ts_tablet_manager.cc:1905] T d36cb2aaaedf4852bf1c6b5b41e38d10 P 19a60815b9dd4c59bb655d000f25245b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:02:50.331343 475 ts_tablet_manager.cc:1918] T d36cb2aaaedf4852bf1c6b5b41e38d10 P 19a60815b9dd4c59bb655d000f25245b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 13:02:50.331413 476 ts_tablet_manager.cc:1918] T d36cb2aaaedf4852bf1c6b5b41e38d10 P bb337635cce249879ce6ed345aae48de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 13:02:50.331462 475 log.cc:1196] T d36cb2aaaedf4852bf1c6b5b41e38d10 P 19a60815b9dd4c59bb655d000f25245b: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-0/wal/wals/d36cb2aaaedf4852bf1c6b5b41e38d10
I20260809 13:02:50.331589 476 log.cc:1196] T d36cb2aaaedf4852bf1c6b5b41e38d10 P bb337635cce249879ce6ed345aae48de: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-1/wal/wals/d36cb2aaaedf4852bf1c6b5b41e38d10
I20260809 13:02:50.331841 475 ts_tablet_manager.cc:1939] T d36cb2aaaedf4852bf1c6b5b41e38d10 P 19a60815b9dd4c59bb655d000f25245b: Deleting consensus metadata
I20260809 13:02:50.332054 476 ts_tablet_manager.cc:1939] T d36cb2aaaedf4852bf1c6b5b41e38d10 P bb337635cce249879ce6ed345aae48de: Deleting consensus metadata
I20260809 13:02:50.332032 479 ts_tablet_manager.cc:1918] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 13:02:50.332201 479 log.cc:1196] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-2/wal/wals/d36cb2aaaedf4852bf1c6b5b41e38d10
I20260809 13:02:50.332664 479 ts_tablet_manager.cc:1939] T d36cb2aaaedf4852bf1c6b5b41e38d10 P d755e0183b41471da12c8866559fd650: Deleting consensus metadata
I20260809 13:02:50.333151 31964 catalog_manager.cc:4841] TS 19a60815b9dd4c59bb655d000f25245b (127.28.155.193:33043): tablet d36cb2aaaedf4852bf1c6b5b41e38d10 (table test-table [id=72b61152b68f47a08f4bfe870e407efe]) successfully deleted
I20260809 13:02:50.333607 31965 catalog_manager.cc:4841] TS bb337635cce249879ce6ed345aae48de (127.28.155.194:35145): tablet d36cb2aaaedf4852bf1c6b5b41e38d10 (table test-table [id=72b61152b68f47a08f4bfe870e407efe]) successfully deleted
I20260809 13:02:50.333843 31965 catalog_manager.cc:4841] TS d755e0183b41471da12c8866559fd650 (127.28.155.195:37653): tablet d36cb2aaaedf4852bf1c6b5b41e38d10 (table test-table [id=72b61152b68f47a08f4bfe870e407efe]) successfully deleted
I20260809 13:02:50.337631 32215 tablet_service.cc:1467] Processing CreateTablet for tablet 0e62444235644855968a74dc19711e9f (DEFAULT_TABLE table=test-table [id=c8ad2c42cab5431886005870d48659e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:02:50.338104 32215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e62444235644855968a74dc19711e9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:50.338088 32444 tablet_service.cc:1467] Processing CreateTablet for tablet 0e62444235644855968a74dc19711e9f (DEFAULT_TABLE table=test-table [id=c8ad2c42cab5431886005870d48659e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:02:50.338117 32656 tablet_service.cc:1467] Processing CreateTablet for tablet 0e62444235644855968a74dc19711e9f (DEFAULT_TABLE table=test-table [id=c8ad2c42cab5431886005870d48659e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:02:50.338555 32656 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e62444235644855968a74dc19711e9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:50.338555 32444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e62444235644855968a74dc19711e9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:50.342654 499 tablet_bootstrap.cc:492] T 0e62444235644855968a74dc19711e9f P 19a60815b9dd4c59bb655d000f25245b: Bootstrap starting.
I20260809 13:02:50.344192 499 tablet_bootstrap.cc:654] T 0e62444235644855968a74dc19711e9f P 19a60815b9dd4c59bb655d000f25245b: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:50.345096 497 tablet_bootstrap.cc:492] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de: Bootstrap starting.
I20260809 13:02:50.346139 495 tablet_bootstrap.cc:492] T 0e62444235644855968a74dc19711e9f P d755e0183b41471da12c8866559fd650: Bootstrap starting.
I20260809 13:02:50.346851 497 tablet_bootstrap.cc:654] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:50.347700 495 tablet_bootstrap.cc:654] T 0e62444235644855968a74dc19711e9f P d755e0183b41471da12c8866559fd650: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:50.350353 499 tablet_bootstrap.cc:492] T 0e62444235644855968a74dc19711e9f P 19a60815b9dd4c59bb655d000f25245b: No bootstrap required, opened a new log
I20260809 13:02:50.350554 499 ts_tablet_manager.cc:1397] T 0e62444235644855968a74dc19711e9f P 19a60815b9dd4c59bb655d000f25245b: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260809 13:02:50.351361 499 raft_consensus.cc:348] T 0e62444235644855968a74dc19711e9f P 19a60815b9dd4c59bb655d000f25245b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:50.351609 499 raft_consensus.cc:374] T 0e62444235644855968a74dc19711e9f P 19a60815b9dd4c59bb655d000f25245b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:50.351706 499 raft_consensus.cc:729] T 0e62444235644855968a74dc19711e9f P 19a60815b9dd4c59bb655d000f25245b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a60815b9dd4c59bb655d000f25245b, State: Initialized, Role: FOLLOWER
I20260809 13:02:50.351998 499 consensus_queue.cc:260] T 0e62444235644855968a74dc19711e9f P 19a60815b9dd4c59bb655d000f25245b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:50.352576 499 ts_tablet_manager.cc:1428] T 0e62444235644855968a74dc19711e9f P 19a60815b9dd4c59bb655d000f25245b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 13:02:50.354099 495 tablet_bootstrap.cc:492] T 0e62444235644855968a74dc19711e9f P d755e0183b41471da12c8866559fd650: No bootstrap required, opened a new log
I20260809 13:02:50.354292 495 ts_tablet_manager.cc:1397] T 0e62444235644855968a74dc19711e9f P d755e0183b41471da12c8866559fd650: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.004s
I20260809 13:02:50.355149 495 raft_consensus.cc:348] T 0e62444235644855968a74dc19711e9f P d755e0183b41471da12c8866559fd650 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:50.355446 495 raft_consensus.cc:374] T 0e62444235644855968a74dc19711e9f P d755e0183b41471da12c8866559fd650 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:50.355557 495 raft_consensus.cc:729] T 0e62444235644855968a74dc19711e9f P d755e0183b41471da12c8866559fd650 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d755e0183b41471da12c8866559fd650, State: Initialized, Role: FOLLOWER
I20260809 13:02:50.355832 495 consensus_queue.cc:260] T 0e62444235644855968a74dc19711e9f P d755e0183b41471da12c8866559fd650 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:50.356375 495 ts_tablet_manager.cc:1428] T 0e62444235644855968a74dc19711e9f P d755e0183b41471da12c8866559fd650: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260809 13:02:50.358390 497 tablet_bootstrap.cc:492] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de: No bootstrap required, opened a new log
I20260809 13:02:50.358593 497 ts_tablet_manager.cc:1397] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.011s
I20260809 13:02:50.359463 497 raft_consensus.cc:348] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:50.359736 497 raft_consensus.cc:374] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:50.359856 497 raft_consensus.cc:729] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb337635cce249879ce6ed345aae48de, State: Initialized, Role: FOLLOWER
I20260809 13:02:50.360173 497 consensus_queue.cc:260] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:50.360860 497 ts_tablet_manager.cc:1428] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260809 13:02:50.452136 448 raft_consensus.cc:482] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:02:50.452369 448 raft_consensus.cc:504] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:50.453228 448 leader_election.cc:288] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19a60815b9dd4c59bb655d000f25245b (127.28.155.193:33043), d755e0183b41471da12c8866559fd650 (127.28.155.195:37653)
I20260809 13:02:50.453962 32251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e62444235644855968a74dc19711e9f" candidate_uuid: "bb337635cce249879ce6ed345aae48de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a60815b9dd4c59bb655d000f25245b" is_pre_election: true
I20260809 13:02:50.454095 32693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e62444235644855968a74dc19711e9f" candidate_uuid: "bb337635cce249879ce6ed345aae48de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d755e0183b41471da12c8866559fd650" is_pre_election: true
I20260809 13:02:50.454237 32251 raft_consensus.cc:2454] T 0e62444235644855968a74dc19711e9f P 19a60815b9dd4c59bb655d000f25245b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb337635cce249879ce6ed345aae48de in term 0.
I20260809 13:02:50.454434 32693 raft_consensus.cc:2454] T 0e62444235644855968a74dc19711e9f P d755e0183b41471da12c8866559fd650 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb337635cce249879ce6ed345aae48de in term 0.
I20260809 13:02:50.454761 32368 leader_election.cc:302] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19a60815b9dd4c59bb655d000f25245b, bb337635cce249879ce6ed345aae48de; no voters:
I20260809 13:02:50.455070 448 raft_consensus.cc:2781] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:02:50.455176 448 raft_consensus.cc:482] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:02:50.455246 448 raft_consensus.cc:3037] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:50.457445 448 raft_consensus.cc:504] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:50.458087 448 leader_election.cc:288] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de [CANDIDATE]: Term 1 election: Requested vote from peers 19a60815b9dd4c59bb655d000f25245b (127.28.155.193:33043), d755e0183b41471da12c8866559fd650 (127.28.155.195:37653)
I20260809 13:02:50.458616 32251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e62444235644855968a74dc19711e9f" candidate_uuid: "bb337635cce249879ce6ed345aae48de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a60815b9dd4c59bb655d000f25245b"
I20260809 13:02:50.458734 32693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e62444235644855968a74dc19711e9f" candidate_uuid: "bb337635cce249879ce6ed345aae48de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d755e0183b41471da12c8866559fd650"
I20260809 13:02:50.458868 32251 raft_consensus.cc:3037] T 0e62444235644855968a74dc19711e9f P 19a60815b9dd4c59bb655d000f25245b [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:50.459038 32693 raft_consensus.cc:3037] T 0e62444235644855968a74dc19711e9f P d755e0183b41471da12c8866559fd650 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:50.461436 32251 raft_consensus.cc:2454] T 0e62444235644855968a74dc19711e9f P 19a60815b9dd4c59bb655d000f25245b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb337635cce249879ce6ed345aae48de in term 1.
I20260809 13:02:50.461536 32693 raft_consensus.cc:2454] T 0e62444235644855968a74dc19711e9f P d755e0183b41471da12c8866559fd650 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb337635cce249879ce6ed345aae48de in term 1.
I20260809 13:02:50.461933 32368 leader_election.cc:302] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19a60815b9dd4c59bb655d000f25245b, bb337635cce249879ce6ed345aae48de; no voters:
I20260809 13:02:50.462275 448 raft_consensus.cc:2781] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:02:50.462438 448 raft_consensus.cc:686] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de [term 1 LEADER]: Becoming Leader. State: Replica: bb337635cce249879ce6ed345aae48de, State: Running, Role: LEADER
I20260809 13:02:50.462735 448 consensus_queue.cc:237] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } }
I20260809 13:02:50.465927 31983 catalog_manager.cc:5495] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de reported cstate change: term changed from 0 to 1, leader changed from <none> to bb337635cce249879ce6ed345aae48de (127.28.155.194). New cstate: current_term: 1 leader_uuid: "bb337635cce249879ce6ed345aae48de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb337635cce249879ce6ed345aae48de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 } health_report { overall_health: UNKNOWN } } }
I20260809 13:02:50.490242 525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:50.485288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48788 (local address 127.28.155.194:35145)
0809 13:02:50.485943 (+ 655us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:50.485947 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:50.485966 (+ 19us) server_negotiation.cc:407] Connection header received
0809 13:02:50.486021 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:50.486024 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:50.486087 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:50.486172 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:02:50.486501 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:50.487284 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:50.488570 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:50.488997 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:50.489092 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:50.489523 (+ 431us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:02:50.489645 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:02:50.489727 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:50.489880 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 13:02:50.489947 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":392,"threads_started":1}
I20260809 13:02:50.504276 525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:50.499405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:59513 (local address 127.28.155.194:35145)
0809 13:02:50.499582 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:50.499586 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:50.499950 (+ 364us) server_negotiation.cc:407] Connection header received
0809 13:02:50.500094 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:50.500098 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:50.500162 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:50.500239 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:02:50.500762 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:50.501479 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:50.502772 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:50.503196 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:50.503290 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:50.503635 (+ 345us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:02:50.503732 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:02:50.503799 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:50.503941 (+ 142us) server_negotiation.cc:299] Negotiation successful
0809 13:02:50.504003 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":18,"server-negotiator.queue_time_us":59}
I20260809 13:02:50.504345 529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:50.499145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:35145 (local address 127.28.155.194:59513)
0809 13:02:50.499859 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:50.499875 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:50.499992 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:50.500270 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:50.500273 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:50.500283 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 13:02:50.500610 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:50.500619 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:50.501598 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:50.501602 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:50.502648 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:50.502659 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:50.503331 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:50.503335 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:50.503463 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:50.503496 (+ 33us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 13:02:50.503818 (+ 322us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 13:02:50.503826 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 13:02:50.503886 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 13:02:50.503986 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":557,"mutex_wait_us":2,"thread_start_us":408,"threads_started":1}
I20260809 13:02:50.512750 32693 raft_consensus.cc:1261] T 0e62444235644855968a74dc19711e9f P d755e0183b41471da12c8866559fd650 [term 1 FOLLOWER]: Refusing update from remote peer bb337635cce249879ce6ed345aae48de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:02:50.512713 32251 raft_consensus.cc:1261] T 0e62444235644855968a74dc19711e9f P 19a60815b9dd4c59bb655d000f25245b [term 1 FOLLOWER]: Refusing update from remote peer bb337635cce249879ce6ed345aae48de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:02:50.513351 454 consensus_queue.cc:1035] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de [LEADER]: Connected to new peer: Peer: permanent_uuid: "d755e0183b41471da12c8866559fd650" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 37653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:02:50.513772 448 consensus_queue.cc:1035] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de [LEADER]: Connected to new peer: Peer: permanent_uuid: "19a60815b9dd4c59bb655d000f25245b" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 13:02:50.535923 445 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 13:02:52.140413 31982 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46214:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:02:52.140744 31982 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46214:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:02:52.145792 31982 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0fa6fd2d58be42e19db3d470886fb6fc: Sending DeleteTablet for 3 replicas of tablet 0e62444235644855968a74dc19711e9f
I20260809 13:02:52.146664 32215 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e62444235644855968a74dc19711e9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:02:52 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:42904
I20260809 13:02:52.146770 32443 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e62444235644855968a74dc19711e9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:02:52 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:48770
I20260809 13:02:52.146965 32656 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e62444235644855968a74dc19711e9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:02:52 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:34342
I20260809 13:02:52.148430 565 tablet_replica.cc:330] T 0e62444235644855968a74dc19711e9f P 19a60815b9dd4c59bb655d000f25245b: stopping tablet replica
I20260809 13:02:52.148669 565 raft_consensus.cc:2229] T 0e62444235644855968a74dc19711e9f P 19a60815b9dd4c59bb655d000f25245b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:02:52.148952 565 raft_consensus.cc:2258] T 0e62444235644855968a74dc19711e9f P 19a60815b9dd4c59bb655d000f25245b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:02:52.149204 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 32107
I20260809 13:02:52.150118 565 ts_tablet_manager.cc:1905] T 0e62444235644855968a74dc19711e9f P 19a60815b9dd4c59bb655d000f25245b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:02:52.150323 570 tablet_replica.cc:330] T 0e62444235644855968a74dc19711e9f P d755e0183b41471da12c8866559fd650: stopping tablet replica
I20260809 13:02:52.150539 570 raft_consensus.cc:2229] T 0e62444235644855968a74dc19711e9f P d755e0183b41471da12c8866559fd650 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:02:52.150811 570 raft_consensus.cc:2258] T 0e62444235644855968a74dc19711e9f P d755e0183b41471da12c8866559fd650 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:02:52.151470 569 tablet_replica.cc:330] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de: stopping tablet replica
I20260809 13:02:52.151712 569 raft_consensus.cc:2229] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de [term 1 LEADER]: Raft consensus shutting down.
I20260809 13:02:52.152359 569 raft_consensus.cc:2258] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:02:52.152431 570 ts_tablet_manager.cc:1905] T 0e62444235644855968a74dc19711e9f P d755e0183b41471da12c8866559fd650: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:02:52.153741 569 ts_tablet_manager.cc:1905] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:02:52.159116 570 ts_tablet_manager.cc:1918] T 0e62444235644855968a74dc19711e9f P d755e0183b41471da12c8866559fd650: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 13:02:52.159277 570 log.cc:1196] T 0e62444235644855968a74dc19711e9f P d755e0183b41471da12c8866559fd650: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-2/wal/wals/0e62444235644855968a74dc19711e9f
I20260809 13:02:52.159512 565 ts_tablet_manager.cc:1918] T 0e62444235644855968a74dc19711e9f P 19a60815b9dd4c59bb655d000f25245b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 13:02:52.159668 565 log.cc:1196] T 0e62444235644855968a74dc19711e9f P 19a60815b9dd4c59bb655d000f25245b: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-0/wal/wals/0e62444235644855968a74dc19711e9f
I20260809 13:02:52.159780 570 ts_tablet_manager.cc:1939] T 0e62444235644855968a74dc19711e9f P d755e0183b41471da12c8866559fd650: Deleting consensus metadata
I20260809 13:02:52.160221 565 ts_tablet_manager.cc:1939] T 0e62444235644855968a74dc19711e9f P 19a60815b9dd4c59bb655d000f25245b: Deleting consensus metadata
I20260809 13:02:52.161273 31965 catalog_manager.cc:4841] TS d755e0183b41471da12c8866559fd650 (127.28.155.195:37653): tablet 0e62444235644855968a74dc19711e9f (table test-table [id=c8ad2c42cab5431886005870d48659e7]) successfully deleted
I20260809 13:02:52.162359 31964 catalog_manager.cc:4841] TS 19a60815b9dd4c59bb655d000f25245b (127.28.155.193:33043): tablet 0e62444235644855968a74dc19711e9f (table test-table [id=c8ad2c42cab5431886005870d48659e7]) successfully deleted
I20260809 13:02:52.162890 569 ts_tablet_manager.cc:1918] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 13:02:52.163067 569 log.cc:1196] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786280548611909-29295-0/minicluster-data/ts-1/wal/wals/0e62444235644855968a74dc19711e9f
I20260809 13:02:52.163586 569 ts_tablet_manager.cc:1939] T 0e62444235644855968a74dc19711e9f P bb337635cce249879ce6ed345aae48de: Deleting consensus metadata
I20260809 13:02:52.164812 31965 catalog_manager.cc:4841] TS bb337635cce249879ce6ed345aae48de (127.28.155.194:35145): tablet 0e62444235644855968a74dc19711e9f (table test-table [id=c8ad2c42cab5431886005870d48659e7]) successfully deleted
Aug 09 13:02:52 dist-test-slave-jq4t krb5kdc[31925](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280569, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.28.155.193@KRBTEST.COM
I20260809 13:02:52.176874 573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:52.150700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42920 (local address 127.28.155.193:33043)
0809 13:02:52.161625 (+ 10925us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:52.161631 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:52.161654 (+ 23us) server_negotiation.cc:407] Connection header received
0809 13:02:52.161715 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:52.161720 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:52.161816 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:52.161956 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:52.163637 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:52.164824 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:52.166191 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:52.166574 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:52.166669 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:52.170896 (+ 4227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:52.170915 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:52.170933 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:52.170976 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:52.174140 (+ 3164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:52.174885 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:52.174893 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:52.174896 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:52.175044 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:52.175397 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:52.175400 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:52.175402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:52.175765 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:52.176054 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:52.176254 (+ 200us) server_negotiation.cc:299] Negotiation successful
0809 13:02:52.176577 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10766,"thread_start_us":11382,"threads_started":1}
W20260809 13:02:52.177634 32321 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42920
W20260809 13:02:52.178256 29295 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 32107: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 13:02:52.178505 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 32107
I20260809 13:02:52.212949 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 32334
Aug 09 13:02:52 dist-test-slave-jq4t krb5kdc[31925](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280569, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.28.155.194@KRBTEST.COM
I20260809 13:02:52.230139 574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:52.213823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48792 (local address 127.28.155.194:35145)
0809 13:02:52.214468 (+ 645us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:52.214472 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:52.214489 (+ 17us) server_negotiation.cc:407] Connection header received
0809 13:02:52.214549 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:52.214553 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:52.214616 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:52.214746 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:52.216117 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:52.216946 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:52.218872 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:52.219346 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:52.219496 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:52.223947 (+ 4451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:52.223966 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:52.223984 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:52.224033 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:52.227038 (+ 3005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:52.227774 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:52.227782 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:52.227784 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:52.227936 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:52.228352 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:52.228357 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:52.228362 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:52.228878 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:52.229216 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:52.229511 (+ 295us) server_negotiation.cc:299] Negotiation successful
0809 13:02:52.229756 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":274,"threads_started":1}
W20260809 13:02:52.230901 32542 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48792
W20260809 13:02:52.231614 29295 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 32334: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 13:02:52.231809 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 32334
I20260809 13:02:52.276947 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 32556
Aug 09 13:02:52 dist-test-slave-jq4t krb5kdc[31925](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280569, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.28.155.195@KRBTEST.COM
I20260809 13:02:52.293493 575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:52.277786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34366 (local address 127.28.155.195:37653)
0809 13:02:52.278388 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:52.278393 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:52.278408 (+ 15us) server_negotiation.cc:407] Connection header received
0809 13:02:52.278460 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:52.278464 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:52.278533 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:52.278661 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:52.280107 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:52.280991 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:52.282228 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:52.282670 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:52.282821 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:52.287380 (+ 4559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:52.287398 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:52.287415 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:52.287457 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:52.290491 (+ 3034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:52.291240 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:52.291248 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:52.291250 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:52.291395 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:52.291794 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:52.291800 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:52.291804 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:52.292200 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:52.292595 (+ 395us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:52.292889 (+ 294us) server_negotiation.cc:299] Negotiation successful
0809 13:02:52.293127 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":311,"threads_started":1}
W20260809 13:02:52.294235 32759 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34366
W20260809 13:02:52.294909 29295 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 32556: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 13:02:52.295104 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 32556
I20260809 13:02:52.327682 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 31941
I20260809 13:02:52.329066 32051 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:02:52.456151 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 31941
2026-08-09T13:02:52Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (9058 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:02:52 dist-test-slave-jq4t krb5kdc[581](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:02:52 dist-test-slave-jq4t krb5kdc[581](info): set up 2 sockets
Aug 09 13:02:52 dist-test-slave-jq4t krb5kdc[581](info): commencing operation
krb5kdc: starting...
W20260809 13:02:53.786962 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.275s user 0.000s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:02:53 dist-test-slave-jq4t krb5kdc[581](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280573, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:02:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:02:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
I20260809 13:02:54.024796 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:35405
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:41971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:35405
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:02:54.375087 611 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:02:54.375420 611 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:02:54.375519 611 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:02:54.383216 611 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:02:54.383343 611 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:02:54.383409 611 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:02:54.383468 611 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:02:54.383514 611 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:02:54.393973 611 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:41971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:35405
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:35405
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:02:54.395406 611 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:02:54.396920 611 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:02:54.410565 617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:54.410569 618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:54.410558 620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:02:54.411211 611 server_base.cc:1034] running on GCE node
I20260809 13:02:54.412169 611 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:02:54.413806 611 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:02:54.415030 611 hybrid_clock.cc:648] HybridClock initialized: now 1786280574414963 us; error 60 us; skew 500 ppm
I20260809 13:02:54.415431 611 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:02:54 dist-test-slave-jq4t krb5kdc[581](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280574, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:02:54.419031 611 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:02:54.420717 611 webserver.cc:460] Webserver started at http://127.28.155.254:41699/ using document root <none> and password file <none>
I20260809 13:02:54.421509 611 fs_manager.cc:359] Metadata directory not provided
I20260809 13:02:54.421653 611 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:02:54.422008 611 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:02:54.425316 611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "1b00bae1ac5c4a63bcaaa5de5c78867e"
format_stamp: "Formatted at 2026-08-09 13:02:54 on dist-test-slave-jq4t"
server_key: "346542a27a3c8a2da272c6e66ea3cf22"
server_key_iv: "b027b467c16ab8531b96b9060462cf79"
server_key_version: "encryptionkey@0"
I20260809 13:02:54.426143 611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "1b00bae1ac5c4a63bcaaa5de5c78867e"
format_stamp: "Formatted at 2026-08-09 13:02:54 on dist-test-slave-jq4t"
server_key: "346542a27a3c8a2da272c6e66ea3cf22"
server_key_iv: "b027b467c16ab8531b96b9060462cf79"
server_key_version: "encryptionkey@0"
I20260809 13:02:54.431871 611 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 13:02:54.436344 630 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:54.437834 611 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:02:54.438043 611 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "1b00bae1ac5c4a63bcaaa5de5c78867e"
format_stamp: "Formatted at 2026-08-09 13:02:54 on dist-test-slave-jq4t"
server_key: "346542a27a3c8a2da272c6e66ea3cf22"
server_key_iv: "b027b467c16ab8531b96b9060462cf79"
server_key_version: "encryptionkey@0"
I20260809 13:02:54.438262 611 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:02:54.459560 611 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:02:54.464395 611 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:02:54.464763 611 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:02:54.485694 611 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:35405
I20260809 13:02:54.485728 709 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:35405 every 8 connection(s)
I20260809 13:02:54.487262 611 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:02:54.490238 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 611
I20260809 13:02:54.490515 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:02:54.491226 29295 external_mini_cluster.cc:1428] Setting key 1e4f68885016a0078858eccc4489e508
I20260809 13:02:54.491596 710 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:02:54.507498 710 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b00bae1ac5c4a63bcaaa5de5c78867e: Bootstrap starting.
Aug 09 13:02:54 dist-test-slave-jq4t krb5kdc[581](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280573, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:02:54.511162 710 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b00bae1ac5c4a63bcaaa5de5c78867e: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:54.512365 710 log.cc:824] T 00000000000000000000000000000000 P 1b00bae1ac5c4a63bcaaa5de5c78867e: Log is configured to *not* fsync() on all Append() calls
I20260809 13:02:54.515564 710 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b00bae1ac5c4a63bcaaa5de5c78867e: No bootstrap required, opened a new log
I20260809 13:02:54.517316 714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:54.493474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47002 (local address 127.28.155.254:35405)
0809 13:02:54.494422 (+ 948us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:54.494434 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:54.494482 (+ 48us) server_negotiation.cc:407] Connection header received
0809 13:02:54.496794 (+ 2312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:54.496820 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:54.497283 (+ 463us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:54.497640 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:54.499702 (+ 2062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:54.501196 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:54.503048 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:54.503769 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:54.503915 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:54.509112 (+ 5197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:54.509121 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:54.509137 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:54.509189 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:54.512699 (+ 3510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:54.513534 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:54.513542 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:54.513548 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:54.513744 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:54.514182 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:54.514187 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:54.514190 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:54.514770 (+ 580us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:54.515138 (+ 368us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:54.515621 (+ 483us) server_negotiation.cc:299] Negotiation successful
0809 13:02:54.516115 (+ 494us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":429,"threads_started":1}
I20260809 13:02:54.524192 710 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1b00bae1ac5c4a63bcaaa5de5c78867e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b00bae1ac5c4a63bcaaa5de5c78867e" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 35405 } }
I20260809 13:02:54.524755 710 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1b00bae1ac5c4a63bcaaa5de5c78867e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:54.524878 710 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1b00bae1ac5c4a63bcaaa5de5c78867e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b00bae1ac5c4a63bcaaa5de5c78867e, State: Initialized, Role: FOLLOWER
I20260809 13:02:54.525609 710 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b00bae1ac5c4a63bcaaa5de5c78867e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b00bae1ac5c4a63bcaaa5de5c78867e" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 35405 } }
I20260809 13:02:54.525904 710 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1b00bae1ac5c4a63bcaaa5de5c78867e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:02:54.526114 710 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1b00bae1ac5c4a63bcaaa5de5c78867e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:02:54.526325 710 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1b00bae1ac5c4a63bcaaa5de5c78867e [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:54.528769 710 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1b00bae1ac5c4a63bcaaa5de5c78867e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b00bae1ac5c4a63bcaaa5de5c78867e" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 35405 } }
I20260809 13:02:54.529368 710 leader_election.cc:302] T 00000000000000000000000000000000 P 1b00bae1ac5c4a63bcaaa5de5c78867e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b00bae1ac5c4a63bcaaa5de5c78867e; no voters:
I20260809 13:02:54.530112 710 leader_election.cc:288] T 00000000000000000000000000000000 P 1b00bae1ac5c4a63bcaaa5de5c78867e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:02:54.530287 716 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1b00bae1ac5c4a63bcaaa5de5c78867e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:02:54.531378 716 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1b00bae1ac5c4a63bcaaa5de5c78867e [term 1 LEADER]: Becoming Leader. State: Replica: 1b00bae1ac5c4a63bcaaa5de5c78867e, State: Running, Role: LEADER
I20260809 13:02:54.531965 716 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b00bae1ac5c4a63bcaaa5de5c78867e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b00bae1ac5c4a63bcaaa5de5c78867e" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 35405 } }
I20260809 13:02:54.532881 710 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1b00bae1ac5c4a63bcaaa5de5c78867e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:02:54.535483 719 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b00bae1ac5c4a63bcaaa5de5c78867e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b00bae1ac5c4a63bcaaa5de5c78867e. Latest consensus state: current_term: 1 leader_uuid: "1b00bae1ac5c4a63bcaaa5de5c78867e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b00bae1ac5c4a63bcaaa5de5c78867e" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 35405 } } }
I20260809 13:02:54.535988 719 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b00bae1ac5c4a63bcaaa5de5c78867e [sys.catalog]: This master's current role is: LEADER
I20260809 13:02:54.535718 717 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b00bae1ac5c4a63bcaaa5de5c78867e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1b00bae1ac5c4a63bcaaa5de5c78867e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b00bae1ac5c4a63bcaaa5de5c78867e" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 35405 } } }
I20260809 13:02:54.536161 717 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b00bae1ac5c4a63bcaaa5de5c78867e [sys.catalog]: This master's current role is: LEADER
I20260809 13:02:54.541296 725 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:02:54.547626 725 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:02:54.558713 725 catalog_manager.cc:1347] Generated new cluster ID: 6d5553513b7341599e92a1ab18d83dc3
I20260809 13:02:54.558887 725 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:02:54.577826 725 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:02:54.579334 725 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:02:54.599035 725 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1b00bae1ac5c4a63bcaaa5de5c78867e: Generated new TSK 0
I20260809 13:02:54.600005 725 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
I20260809 13:02:54.656848 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:0
--local_ip_for_outbound_sockets=127.28.155.193
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:35405
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:41971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:02:55.020069 749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:02:55.020740 749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:02:55.020932 749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:02:55.030628 749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:02:55.030751 749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:02:55.030939 749 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:02:55.042035 749 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:41971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:35405
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:02:55.043532 749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:02:55.045048 749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:02:55.059801 763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:55.060376 760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:55.060768 759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:02:55.061182 749 server_base.cc:1034] running on GCE node
I20260809 13:02:55.062037 749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:02:55.063162 749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:02:55.064414 749 hybrid_clock.cc:648] HybridClock initialized: now 1786280575064344 us; error 70 us; skew 500 ppm
I20260809 13:02:55.064795 749 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:02:55 dist-test-slave-jq4t krb5kdc[581](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280575, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:02:55.068450 749 init.cc:377] Logged in from keytab as kudu/127.28.155.193@KRBTEST.COM (short username kudu)
I20260809 13:02:55.070103 749 webserver.cc:460] Webserver started at http://127.28.155.193:45619/ using document root <none> and password file <none>
I20260809 13:02:55.070878 749 fs_manager.cc:359] Metadata directory not provided
I20260809 13:02:55.071025 749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:02:55.071376 749 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:02:55.074536 749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/data/instance:
uuid: "96f6325edab944c2a521ca4df1b0a17a"
format_stamp: "Formatted at 2026-08-09 13:02:55 on dist-test-slave-jq4t"
server_key: "0543abae90d9142f900acc42a2a9149d"
server_key_iv: "949b22d0aae96ceb186fc0577604280d"
server_key_version: "encryptionkey@0"
I20260809 13:02:55.075363 749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance:
uuid: "96f6325edab944c2a521ca4df1b0a17a"
format_stamp: "Formatted at 2026-08-09 13:02:55 on dist-test-slave-jq4t"
server_key: "0543abae90d9142f900acc42a2a9149d"
server_key_iv: "949b22d0aae96ceb186fc0577604280d"
server_key_version: "encryptionkey@0"
I20260809 13:02:55.081070 749 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 13:02:55.084931 772 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:55.086264 749 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:02:55.086472 749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "96f6325edab944c2a521ca4df1b0a17a"
format_stamp: "Formatted at 2026-08-09 13:02:55 on dist-test-slave-jq4t"
server_key: "0543abae90d9142f900acc42a2a9149d"
server_key_iv: "949b22d0aae96ceb186fc0577604280d"
server_key_version: "encryptionkey@0"
I20260809 13:02:55.086717 749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:02:55.110069 749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:02:55.114463 749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:02:55.114794 749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:02:55.115854 749 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:02:55.117390 749 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:02:55.117512 749 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:55.117671 749 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:02:55.117748 749 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:55.153800 749 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:43141
I20260809 13:02:55.153855 959 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:43141 every 8 connection(s)
I20260809 13:02:55.155234 749 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:02:55.164054 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 749
I20260809 13:02:55.164314 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance
I20260809 13:02:55.165119 29295 external_mini_cluster.cc:1428] Setting key 2f698184baf33e05ba20e66888833eb7
Aug 09 13:02:55 dist-test-slave-jq4t krb5kdc[581](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280575, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:02:55.177920 963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:55.158202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:36293 (local address 127.28.155.254:35405)
0809 13:02:55.158675 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:55.158679 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:55.159748 (+ 1069us) server_negotiation.cc:407] Connection header received
0809 13:02:55.161705 (+ 1957us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:55.161710 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:55.161785 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:55.161889 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:55.163455 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:55.164695 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:55.166510 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:55.167161 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:55.167300 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:55.171754 (+ 4454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:55.171760 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:55.171763 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:55.171796 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:55.174610 (+ 2814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:55.175403 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:55.175411 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:55.175414 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:55.175551 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:55.176002 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:55.176007 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:55.176011 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:55.176304 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:55.176474 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:55.177271 (+ 797us) server_negotiation.cc:299] Negotiation successful
0809 13:02:55.177525 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":239,"threads_started":1}
I20260809 13:02:55.179214 964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:55.158814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:35405 (local address 127.28.155.193:36293)
0809 13:02:55.159572 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:55.159612 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:55.161420 (+ 1808us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:55.162105 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:55.162113 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:55.162666 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:02:55.163238 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:55.163255 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:55.164871 (+ 1616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:55.164875 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:55.166368 (+ 1493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:55.166381 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:55.167435 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:55.167442 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:55.167755 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:55.168575 (+ 820us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:02:55.168657 (+ 82us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:02:55.171524 (+ 2867us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:02:55.174773 (+ 3249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:55.174782 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:55.174800 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:55.175267 (+ 467us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:55.175671 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:55.175676 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:55.175680 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:55.175884 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:55.176452 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:02:55.176460 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:02:55.176870 (+ 410us) client_negotiation.cc:769] Sending connection context
0809 13:02:55.177167 (+ 297us) client_negotiation.cc:240] Negotiation successful
0809 13:02:55.177764 (+ 597us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":279,"threads_started":1}
I20260809 13:02:55.180953 961 heartbeater.cc:347] Connected to a master server at 127.28.155.254:35405
I20260809 13:02:55.181361 961 heartbeater.cc:464] Registering TS with master...
I20260809 13:02:55.182330 961 heartbeater.cc:511] Master 127.28.155.254:35405 requested a full tablet report, sending...
I20260809 13:02:55.184870 655 ts_manager.cc:194] Registered new tserver with Master: 96f6325edab944c2a521ca4df1b0a17a (127.28.155.193:43141)
I20260809 13:02:55.186394 655 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.193@KRBTEST.COM'} at 127.28.155.193:36293
WARNING: no policy specified for kudu/127.28.155.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
I20260809 13:02:55.221452 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:0
--local_ip_for_outbound_sockets=127.28.155.194
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:35405
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:41971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:02:55.575299 972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:02:55.575605 972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:02:55.575757 972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:02:55.583112 972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:02:55.583237 972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:02:55.583356 972 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:02:55.593753 972 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:41971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:35405
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:02:55.595113 972 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:02:55.596459 972 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:02:55.610903 977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:55.611248 978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:55.611474 980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:02:55.611985 972 server_base.cc:1034] running on GCE node
I20260809 13:02:55.612689 972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:02:55.613675 972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:02:55.614923 972 hybrid_clock.cc:648] HybridClock initialized: now 1786280575614873 us; error 41 us; skew 500 ppm
I20260809 13:02:55.615271 972 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:02:55 dist-test-slave-jq4t krb5kdc[581](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280575, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:02:55.618743 972 init.cc:377] Logged in from keytab as kudu/127.28.155.194@KRBTEST.COM (short username kudu)
I20260809 13:02:55.620422 972 webserver.cc:460] Webserver started at http://127.28.155.194:42569/ using document root <none> and password file <none>
I20260809 13:02:55.621192 972 fs_manager.cc:359] Metadata directory not provided
I20260809 13:02:55.621351 972 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:02:55.621691 972 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:02:55.624841 972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/data/instance:
uuid: "eea066bd24a34ff38f604e3a08acbbb2"
format_stamp: "Formatted at 2026-08-09 13:02:55 on dist-test-slave-jq4t"
server_key: "da214ae00367fa08d4a74efdc6dbe411"
server_key_iv: "893b755adf51bd7071487ac3fd4078d6"
server_key_version: "encryptionkey@0"
I20260809 13:02:55.625677 972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance:
uuid: "eea066bd24a34ff38f604e3a08acbbb2"
format_stamp: "Formatted at 2026-08-09 13:02:55 on dist-test-slave-jq4t"
server_key: "da214ae00367fa08d4a74efdc6dbe411"
server_key_iv: "893b755adf51bd7071487ac3fd4078d6"
server_key_version: "encryptionkey@0"
I20260809 13:02:55.631069 972 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260809 13:02:55.634871 991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:55.636251 972 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 13:02:55.636444 972 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "eea066bd24a34ff38f604e3a08acbbb2"
format_stamp: "Formatted at 2026-08-09 13:02:55 on dist-test-slave-jq4t"
server_key: "da214ae00367fa08d4a74efdc6dbe411"
server_key_iv: "893b755adf51bd7071487ac3fd4078d6"
server_key_version: "encryptionkey@0"
I20260809 13:02:55.636716 972 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:02:55.649803 972 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:02:55.654075 972 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:02:55.654402 972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:02:55.655462 972 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:02:55.657030 972 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:02:55.657141 972 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:55.657299 972 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:02:55.657377 972 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:55.693490 972 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:45035
I20260809 13:02:55.693539 1157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:45035 every 8 connection(s)
I20260809 13:02:55.694859 972 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:02:55.695966 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 972
I20260809 13:02:55.696198 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance
I20260809 13:02:55.696838 29295 external_mini_cluster.cc:1428] Setting key f00b60ca294dd022fe8d64d7ecf1ce3b
Aug 09 13:02:55 dist-test-slave-jq4t krb5kdc[581](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280575, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:02:55.719547 1162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:55.698142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:43721 (local address 127.28.155.254:35405)
0809 13:02:55.698682 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:55.698689 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:55.699771 (+ 1082us) server_negotiation.cc:407] Connection header received
0809 13:02:55.702812 (+ 3041us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:55.702816 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:55.702885 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:55.702973 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:55.705197 (+ 2224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:55.705928 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:55.708561 (+ 2633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:55.709342 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:55.709488 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:55.713397 (+ 3909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:55.713402 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:55.713406 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:55.713440 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:55.716102 (+ 2662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:55.716946 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:55.716951 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:55.716955 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:55.717096 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:55.717656 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:55.717661 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:55.717671 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:55.717971 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:55.718138 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:55.718889 (+ 751us) server_negotiation.cc:299] Negotiation successful
0809 13:02:55.719136 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":266,"threads_started":1}
I20260809 13:02:55.720806 1164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:55.698751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:35405 (local address 127.28.155.194:43721)
0809 13:02:55.699580 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:55.699630 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:55.702493 (+ 2863us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:55.703254 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:55.703269 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:55.704111 (+ 842us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:02:55.705017 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:55.705046 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:55.706091 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:55.706101 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:55.708272 (+ 2171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:55.708291 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:55.709594 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:55.709599 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:55.709796 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:55.710601 (+ 805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:02:55.710625 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:02:55.713150 (+ 2525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:02:55.716272 (+ 3122us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:55.716282 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:55.716301 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:55.716813 (+ 512us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:55.717216 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:55.717222 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:55.717226 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:55.717515 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:55.718112 (+ 597us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:02:55.718121 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:02:55.718506 (+ 385us) client_negotiation.cc:769] Sending connection context
0809 13:02:55.718779 (+ 273us) client_negotiation.cc:240] Negotiation successful
0809 13:02:55.719378 (+ 599us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":339,"threads_started":1}
WARNING: no policy specified for kudu/127.28.155.195@KRBTEST.COM; defaulting to no policy
I20260809 13:02:55.722429 1158 heartbeater.cc:347] Connected to a master server at 127.28.155.254:35405
I20260809 13:02:55.722720 1158 heartbeater.cc:464] Registering TS with master...
I20260809 13:02:55.723430 1158 heartbeater.cc:511] Master 127.28.155.254:35405 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.195@KRBTEST.COM" created.
I20260809 13:02:55.725066 655 ts_manager.cc:194] Registered new tserver with Master: eea066bd24a34ff38f604e3a08acbbb2 (127.28.155.194:45035)
I20260809 13:02:55.725926 655 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.194@KRBTEST.COM'} at 127.28.155.194:43721
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
I20260809 13:02:55.751199 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:0
--local_ip_for_outbound_sockets=127.28.155.195
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:35405
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:41971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:02:56.100971 1167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:02:56.101280 1167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:02:56.101377 1167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:02:56.108887 1167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:02:56.109016 1167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:02:56.109136 1167 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:02:56.119213 1167 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:41971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:35405
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:02:56.120604 1167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:02:56.121944 1167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:02:56.135951 1177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:56.136023 1180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:56.135979 1178 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:02:56.137137 1167 server_base.cc:1034] running on GCE node
I20260809 13:02:56.137750 1167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:02:56.138697 1167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:02:56.139918 1167 hybrid_clock.cc:648] HybridClock initialized: now 1786280576139842 us; error 61 us; skew 500 ppm
I20260809 13:02:56.140326 1167 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:02:56 dist-test-slave-jq4t krb5kdc[581](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280576, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:02:56.144163 1167 init.cc:377] Logged in from keytab as kudu/127.28.155.195@KRBTEST.COM (short username kudu)
I20260809 13:02:56.145741 1167 webserver.cc:460] Webserver started at http://127.28.155.195:35253/ using document root <none> and password file <none>
I20260809 13:02:56.146448 1167 fs_manager.cc:359] Metadata directory not provided
I20260809 13:02:56.146560 1167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:02:56.146826 1167 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:02:56.150225 1167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/data/instance:
uuid: "3dffd54e0e364f4a99599de94315b5bb"
format_stamp: "Formatted at 2026-08-09 13:02:56 on dist-test-slave-jq4t"
server_key: "9ab166091119d8bd718c50b0b0015006"
server_key_iv: "f970a8913b83dea4679b932506fccc48"
server_key_version: "encryptionkey@0"
I20260809 13:02:56.151057 1167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance:
uuid: "3dffd54e0e364f4a99599de94315b5bb"
format_stamp: "Formatted at 2026-08-09 13:02:56 on dist-test-slave-jq4t"
server_key: "9ab166091119d8bd718c50b0b0015006"
server_key_iv: "f970a8913b83dea4679b932506fccc48"
server_key_version: "encryptionkey@0"
I20260809 13:02:56.156921 1167 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260809 13:02:56.160589 1190 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:56.161954 1167 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:02:56.162146 1167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "3dffd54e0e364f4a99599de94315b5bb"
format_stamp: "Formatted at 2026-08-09 13:02:56 on dist-test-slave-jq4t"
server_key: "9ab166091119d8bd718c50b0b0015006"
server_key_iv: "f970a8913b83dea4679b932506fccc48"
server_key_version: "encryptionkey@0"
I20260809 13:02:56.162374 1167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:02:56.187099 1167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:02:56.190300 961 heartbeater.cc:503] Master 127.28.155.254:35405 was elected leader, sending a full tablet report...
I20260809 13:02:56.192400 1167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:02:56.192742 1167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:02:56.193818 1167 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:02:56.195310 1167 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:02:56.195420 1167 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:56.195585 1167 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:02:56.195663 1167 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:56.231154 1167 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:43965
I20260809 13:02:56.231205 1384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:43965 every 8 connection(s)
I20260809 13:02:56.232553 1167 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:02:56.235963 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 1167
I20260809 13:02:56.236184 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance
I20260809 13:02:56.236708 29295 external_mini_cluster.cc:1428] Setting key b09b4c233b33f2975ba67a9a9a2b7a2c
Aug 09 13:02:56 dist-test-slave-jq4t krb5kdc[581](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280576, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:02:56.254665 1388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:56.235413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:49339 (local address 127.28.155.254:35405)
0809 13:02:56.235959 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:56.235966 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:56.237202 (+ 1236us) server_negotiation.cc:407] Connection header received
0809 13:02:56.239339 (+ 2137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:56.239345 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:56.239474 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:56.239591 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:56.241315 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:56.242296 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:56.244128 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:56.244603 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:56.244703 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:56.248158 (+ 3455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:56.248163 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:56.248166 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:56.248201 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:56.251382 (+ 3181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:56.252370 (+ 988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:56.252379 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:56.252382 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:56.252590 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:56.253099 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:56.253102 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:56.253104 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:56.253382 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:56.253511 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:56.254196 (+ 685us) server_negotiation.cc:299] Negotiation successful
0809 13:02:56.254371 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":398,"thread_start_us":261,"threads_started":1}
I20260809 13:02:56.255764 1389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:56.236048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:35405 (local address 127.28.155.195:49339)
0809 13:02:56.237003 (+ 955us) negotiation.cc:107] Waiting for socket to connect
0809 13:02:56.237051 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 13:02:56.239077 (+ 2026us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:02:56.239846 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:02:56.239854 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:02:56.240581 (+ 727us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:02:56.241162 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:56.241180 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:56.242570 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:56.242578 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:56.243985 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:02:56.243999 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:02:56.244818 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:02:56.244823 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:02:56.245063 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:56.245728 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:02:56.245750 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:02:56.247962 (+ 2212us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:02:56.251552 (+ 3590us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:56.251562 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:56.251579 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:56.252246 (+ 667us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:56.252745 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:02:56.252750 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:02:56.252753 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:02:56.252995 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:02:56.253516 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:02:56.253522 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:02:56.253862 (+ 340us) client_negotiation.cc:769] Sending connection context
0809 13:02:56.254102 (+ 240us) client_negotiation.cc:240] Negotiation successful
0809 13:02:56.254519 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":667,"thread_start_us":403,"threads_started":1}
I20260809 13:02:56.257277 1386 heartbeater.cc:347] Connected to a master server at 127.28.155.254:35405
I20260809 13:02:56.257586 1386 heartbeater.cc:464] Registering TS with master...
I20260809 13:02:56.258313 1386 heartbeater.cc:511] Master 127.28.155.254:35405 requested a full tablet report, sending...
I20260809 13:02:56.259770 655 ts_manager.cc:194] Registered new tserver with Master: 3dffd54e0e364f4a99599de94315b5bb (127.28.155.195:43965)
I20260809 13:02:56.260775 655 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.195@KRBTEST.COM'} at 127.28.155.195:49339
I20260809 13:02:56.265167 29295 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 13:02:56.305019 1388 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:02:56.302047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35574 (local address 127.28.155.254:35405)
0809 13:02:56.302251 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:56.302256 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:56.302834 (+ 578us) server_negotiation.cc:407] Connection header received
0809 13:02:56.302999 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:56.303004 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:56.303099 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:56.303205 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:56.304677 (+ 1472us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35574: BlockingRecv error: recv got EOF from 127.0.0.1:35574 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 13:02:56.308452 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 749
W20260809 13:02:56.311482 29295 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 749: Not authorized: Client connection negotiation failed: client connection to 127.28.155.193:43141: server requires authentication, but client does not have Kerberos credentials available
I20260809 13:02:56.311638 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 749
I20260809 13:02:56.342797 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 972
W20260809 13:02:56.345855 29295 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 972: Not authorized: Client connection negotiation failed: client connection to 127.28.155.194:45035: server requires authentication, but client does not have Kerberos credentials available
I20260809 13:02:56.346061 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 972
I20260809 13:02:56.370957 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 1167
W20260809 13:02:56.374248 29295 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 1167: Not authorized: Client connection negotiation failed: client connection to 127.28.155.195:43965: server requires authentication, but client does not have Kerberos credentials available
I20260809 13:02:56.374423 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 1167
I20260809 13:02:56.400739 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 611
I20260809 13:02:56.402204 702 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:02:56.513378 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 611
2026-08-09T13:02:56Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (4052 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:02:56 dist-test-slave-jq4t krb5kdc[1415](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:02:56 dist-test-slave-jq4t krb5kdc[1415](info): set up 2 sockets
Aug 09 13:02:56 dist-test-slave-jq4t krb5kdc[1415](info): commencing operation
krb5kdc: starting...
W20260809 13:02:57.843940 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.280s user 0.001s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:02:58 dist-test-slave-jq4t krb5kdc[1415](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280578, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:02:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:02:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
I20260809 13:02:58.092168 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:39893
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:37395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:39893
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:02:58.443845 1433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:02:58.444162 1433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:02:58.444340 1433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:02:58.451923 1433 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:02:58.452057 1433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:02:58.452201 1433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:02:58.452291 1433 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:02:58.452365 1433 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:02:58.462604 1433 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:37395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:39893
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:39893
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:02:58.464066 1433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:02:58.465606 1433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:02:58.477993 1447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:58.477955 1449 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:02:58.478124 1454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:02:58.479087 1433 server_base.cc:1034] running on GCE node
I20260809 13:02:58.479972 1433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:02:58.481489 1433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:02:58.482733 1433 hybrid_clock.cc:648] HybridClock initialized: now 1786280578482695 us; error 52 us; skew 500 ppm
I20260809 13:02:58.483107 1433 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:02:58 dist-test-slave-jq4t krb5kdc[1415](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280578, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:02:58.486584 1433 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:02:58.488281 1433 webserver.cc:460] Webserver started at http://127.28.155.254:36543/ using document root <none> and password file <none>
I20260809 13:02:58.489091 1433 fs_manager.cc:359] Metadata directory not provided
I20260809 13:02:58.489267 1433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:02:58.489615 1433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:02:58.492906 1433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "cf7c03ebceff43c3b9901edd869f998e"
format_stamp: "Formatted at 2026-08-09 13:02:58 on dist-test-slave-jq4t"
server_key: "21585868af93fb5d04aade6bfed81e50"
server_key_iv: "3bb73c14f4fb9fa8e87242218dbbb645"
server_key_version: "encryptionkey@0"
I20260809 13:02:58.493775 1433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "cf7c03ebceff43c3b9901edd869f998e"
format_stamp: "Formatted at 2026-08-09 13:02:58 on dist-test-slave-jq4t"
server_key: "21585868af93fb5d04aade6bfed81e50"
server_key_iv: "3bb73c14f4fb9fa8e87242218dbbb645"
server_key_version: "encryptionkey@0"
I20260809 13:02:58.499269 1433 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 13:02:58.503019 1462 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:02:58.504415 1433 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260809 13:02:58.504645 1433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "cf7c03ebceff43c3b9901edd869f998e"
format_stamp: "Formatted at 2026-08-09 13:02:58 on dist-test-slave-jq4t"
server_key: "21585868af93fb5d04aade6bfed81e50"
server_key_iv: "3bb73c14f4fb9fa8e87242218dbbb645"
server_key_version: "encryptionkey@0"
I20260809 13:02:58.504868 1433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:02:58.537142 1433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:02:58.542323 1433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:02:58.542691 1433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:02:58.563501 1433 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:39893
I20260809 13:02:58.563546 1549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:39893 every 8 connection(s)
I20260809 13:02:58.565080 1433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:02:58.566556 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 1433
I20260809 13:02:58.566836 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:02:58.567726 29295 external_mini_cluster.cc:1428] Setting key 0b72724285b9d1772e80f441d4f2347a
I20260809 13:02:58.570421 1550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 13:02:58 dist-test-slave-jq4t krb5kdc[1415](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280578, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:02:58.585445 1550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf7c03ebceff43c3b9901edd869f998e: Bootstrap starting.
I20260809 13:02:58.590016 1550 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cf7c03ebceff43c3b9901edd869f998e: Neither blocks nor log segments found. Creating new log.
I20260809 13:02:58.591512 1550 log.cc:824] T 00000000000000000000000000000000 P cf7c03ebceff43c3b9901edd869f998e: Log is configured to *not* fsync() on all Append() calls
I20260809 13:02:58.594465 1555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:58.569863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57214 (local address 127.28.155.254:39893)
0809 13:02:58.570738 (+ 875us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:58.570751 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:58.570795 (+ 44us) server_negotiation.cc:407] Connection header received
0809 13:02:58.572614 (+ 1819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:58.572637 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:58.573036 (+ 399us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:58.573382 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:58.575395 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:58.576936 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:58.578913 (+ 1977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:58.579655 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:58.579808 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:58.585051 (+ 5243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:58.585064 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:58.585085 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:02:58.585143 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:58.589343 (+ 4200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:58.590088 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:58.590100 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:58.590109 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:58.590351 (+ 242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:02:58.590756 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:02:58.590763 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:02:58.590766 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:02:58.591632 (+ 866us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:58.591958 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:58.592465 (+ 507us) server_negotiation.cc:299] Negotiation successful
0809 13:02:58.593025 (+ 560us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":654,"thread_start_us":387,"threads_started":1}
I20260809 13:02:58.595402 1550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf7c03ebceff43c3b9901edd869f998e: No bootstrap required, opened a new log
I20260809 13:02:58.598948 29295 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 13:02:58.603793 1550 raft_consensus.cc:348] T 00000000000000000000000000000000 P cf7c03ebceff43c3b9901edd869f998e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf7c03ebceff43c3b9901edd869f998e" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 39893 } }
I20260809 13:02:58.604224 1550 raft_consensus.cc:374] T 00000000000000000000000000000000 P cf7c03ebceff43c3b9901edd869f998e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:02:58.604374 1550 raft_consensus.cc:729] T 00000000000000000000000000000000 P cf7c03ebceff43c3b9901edd869f998e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf7c03ebceff43c3b9901edd869f998e, State: Initialized, Role: FOLLOWER
I20260809 13:02:58.605085 1550 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf7c03ebceff43c3b9901edd869f998e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf7c03ebceff43c3b9901edd869f998e" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 39893 } }
I20260809 13:02:58.605351 1550 raft_consensus.cc:388] T 00000000000000000000000000000000 P cf7c03ebceff43c3b9901edd869f998e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:02:58.605501 1550 raft_consensus.cc:482] T 00000000000000000000000000000000 P cf7c03ebceff43c3b9901edd869f998e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:02:58.605685 1550 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cf7c03ebceff43c3b9901edd869f998e [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:02:58.608049 1550 raft_consensus.cc:504] T 00000000000000000000000000000000 P cf7c03ebceff43c3b9901edd869f998e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf7c03ebceff43c3b9901edd869f998e" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 39893 } }
I20260809 13:02:58.608702 1550 leader_election.cc:302] T 00000000000000000000000000000000 P cf7c03ebceff43c3b9901edd869f998e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cf7c03ebceff43c3b9901edd869f998e; no voters:
I20260809 13:02:58.609498 1550 leader_election.cc:288] T 00000000000000000000000000000000 P cf7c03ebceff43c3b9901edd869f998e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:02:58.610873 1561 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cf7c03ebceff43c3b9901edd869f998e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:02:58.612197 1561 raft_consensus.cc:686] T 00000000000000000000000000000000 P cf7c03ebceff43c3b9901edd869f998e [term 1 LEADER]: Becoming Leader. State: Replica: cf7c03ebceff43c3b9901edd869f998e, State: Running, Role: LEADER
I20260809 13:02:58.612875 1561 consensus_queue.cc:237] T 00000000000000000000000000000000 P cf7c03ebceff43c3b9901edd869f998e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf7c03ebceff43c3b9901edd869f998e" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 39893 } }
I20260809 13:02:58.613241 1550 sys_catalog.cc:564] T 00000000000000000000000000000000 P cf7c03ebceff43c3b9901edd869f998e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:02:58.620383 1563 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf7c03ebceff43c3b9901edd869f998e [sys.catalog]: SysCatalogTable state changed. Reason: New leader cf7c03ebceff43c3b9901edd869f998e. Latest consensus state: current_term: 1 leader_uuid: "cf7c03ebceff43c3b9901edd869f998e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf7c03ebceff43c3b9901edd869f998e" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 39893 } } }
I20260809 13:02:58.620914 1563 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf7c03ebceff43c3b9901edd869f998e [sys.catalog]: This master's current role is: LEADER
I20260809 13:02:58.620425 1562 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf7c03ebceff43c3b9901edd869f998e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cf7c03ebceff43c3b9901edd869f998e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf7c03ebceff43c3b9901edd869f998e" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 39893 } } }
I20260809 13:02:58.621112 1562 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf7c03ebceff43c3b9901edd869f998e [sys.catalog]: This master's current role is: LEADER
W20260809 13:02:58.631181 1580 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cf7c03ebceff43c3b9901edd869f998e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 13:02:58.631362 1580 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 13:02:58.631520 1577 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:02:58.633967 1577 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:02:58.645366 1577 catalog_manager.cc:1347] Generated new cluster ID: 980f83db07dd4a3783f399bcaf9b4e63
I20260809 13:02:58.645613 1577 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:02:58.658640 1577 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:02:58.659243 1555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:02:58.648936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57226 (local address 127.28.155.254:39893)
0809 13:02:58.649147 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 13:02:58.649153 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:02:58.649776 (+ 623us) server_negotiation.cc:407] Connection header received
0809 13:02:58.649997 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:02:58.650007 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:02:58.650092 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:02:58.650192 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:02:58.651676 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:58.652863 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:58.654817 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:02:58.655508 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:02:58.655665 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:02:58.657125 (+ 1460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:02:58.657132 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:02:58.657136 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:02:58.658208 (+ 1072us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:02:58.658278 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:02:58.658342 (+ 64us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:02:58.658459 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 13:02:58.658711 (+ 252us) server_negotiation.cc:299] Negotiation successful
0809 13:02:58.658832 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260809 13:02:58.660564 1577 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:02:58.668720 1577 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cf7c03ebceff43c3b9901edd869f998e: Generated new TSK 0
I20260809 13:02:58.669699 1577 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 13:02:58.682546 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 1433
I20260809 13:02:58.684367 1543 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:02:58.778857 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 1433
2026-08-09T13:02:58Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2261 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:02:58 dist-test-slave-jq4t krb5kdc[1599](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:02:58 dist-test-slave-jq4t krb5kdc[1599](info): set up 2 sockets
Aug 09 13:02:58 dist-test-slave-jq4t krb5kdc[1599](info): commencing operation
krb5kdc: starting...
W20260809 13:03:00.102022 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.276s user 0.001s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:03:00 dist-test-slave-jq4t krb5kdc[1599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280580, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:03:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:03:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
I20260809 13:03:00.340600 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:34259
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:38117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:34259
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:00.690572 1619 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:00.690891 1619 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:00.691027 1619 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:00.698248 1619 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:03:00.698354 1619 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:00.698459 1619 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:00.698565 1619 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:03:00.698652 1619 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:03:00.708478 1619 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:38117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:34259
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:34259
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:00.709966 1619 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:00.711529 1619 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:00.724006 1631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:00.724031 1628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:00.724210 1629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:00.725828 1619 server_base.cc:1034] running on GCE node
I20260809 13:03:00.726640 1619 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:00.728139 1619 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:00.729372 1619 hybrid_clock.cc:648] HybridClock initialized: now 1786280580729333 us; error 51 us; skew 500 ppm
I20260809 13:03:00.729746 1619 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:00 dist-test-slave-jq4t krb5kdc[1599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280580, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:00.733180 1619 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:03:00.734754 1619 webserver.cc:460] Webserver started at http://127.28.155.254:45987/ using document root <none> and password file <none>
I20260809 13:03:00.735532 1619 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:00.735687 1619 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:00.736037 1619 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:00.739249 1619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "793ab3ea1cbf46bf93b23d5e89f99b2b"
format_stamp: "Formatted at 2026-08-09 13:03:00 on dist-test-slave-jq4t"
server_key: "1fa6f07d875101d7dd1219198565ce38"
server_key_iv: "c1f39b4838aed018901bbdda70dc94c7"
server_key_version: "encryptionkey@0"
I20260809 13:03:00.740108 1619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "793ab3ea1cbf46bf93b23d5e89f99b2b"
format_stamp: "Formatted at 2026-08-09 13:03:00 on dist-test-slave-jq4t"
server_key: "1fa6f07d875101d7dd1219198565ce38"
server_key_iv: "c1f39b4838aed018901bbdda70dc94c7"
server_key_version: "encryptionkey@0"
I20260809 13:03:00.745759 1619 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260809 13:03:00.749428 1646 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:00.750840 1619 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:03:00.751037 1619 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "793ab3ea1cbf46bf93b23d5e89f99b2b"
format_stamp: "Formatted at 2026-08-09 13:03:00 on dist-test-slave-jq4t"
server_key: "1fa6f07d875101d7dd1219198565ce38"
server_key_iv: "c1f39b4838aed018901bbdda70dc94c7"
server_key_version: "encryptionkey@0"
I20260809 13:03:00.751255 1619 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:00.771595 1619 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:00.776368 1619 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:00.776733 1619 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:00.797261 1619 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:34259
I20260809 13:03:00.797297 1725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:34259 every 8 connection(s)
I20260809 13:03:00.798750 1619 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:03:00.802708 1726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:00.805611 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 1619
I20260809 13:03:00.805845 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:03:00.806712 29295 external_mini_cluster.cc:1428] Setting key 358cda57ad7b2bfdf7383333af4fe412
I20260809 13:03:00.817591 1726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 793ab3ea1cbf46bf93b23d5e89f99b2b: Bootstrap starting.
I20260809 13:03:00.821383 1726 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 793ab3ea1cbf46bf93b23d5e89f99b2b: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:00.822654 1726 log.cc:824] T 00000000000000000000000000000000 P 793ab3ea1cbf46bf93b23d5e89f99b2b: Log is configured to *not* fsync() on all Append() calls
Aug 09 13:03:00 dist-test-slave-jq4t krb5kdc[1599](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280580, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:03:00.825896 1726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 793ab3ea1cbf46bf93b23d5e89f99b2b: No bootstrap required, opened a new log
I20260809 13:03:00.831698 1729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:00.808944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39806 (local address 127.28.155.254:34259)
0809 13:03:00.809857 (+ 913us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:00.809872 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:00.809927 (+ 55us) server_negotiation.cc:407] Connection header received
0809 13:03:00.812448 (+ 2521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:00.812506 (+ 58us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:00.813012 (+ 506us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:00.813492 (+ 480us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:00.814832 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:00.816951 (+ 2119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:00.818274 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:00.819329 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:00.819566 (+ 237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:00.824025 (+ 4459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:00.824038 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:00.824060 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:00.824110 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:00.827374 (+ 3264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:00.828223 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:00.828229 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:00.828234 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:00.828413 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:00.828895 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:00.828898 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:00.828900 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:00.829452 (+ 552us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:00.829714 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:00.830181 (+ 467us) server_negotiation.cc:299] Negotiation successful
0809 13:03:00.830560 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":639,"thread_start_us":376,"threads_started":1}
I20260809 13:03:00.834964 1726 raft_consensus.cc:348] T 00000000000000000000000000000000 P 793ab3ea1cbf46bf93b23d5e89f99b2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "793ab3ea1cbf46bf93b23d5e89f99b2b" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 34259 } }
I20260809 13:03:00.835350 1726 raft_consensus.cc:374] T 00000000000000000000000000000000 P 793ab3ea1cbf46bf93b23d5e89f99b2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:00.835465 1726 raft_consensus.cc:729] T 00000000000000000000000000000000 P 793ab3ea1cbf46bf93b23d5e89f99b2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 793ab3ea1cbf46bf93b23d5e89f99b2b, State: Initialized, Role: FOLLOWER
I20260809 13:03:00.836114 1726 consensus_queue.cc:260] T 00000000000000000000000000000000 P 793ab3ea1cbf46bf93b23d5e89f99b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "793ab3ea1cbf46bf93b23d5e89f99b2b" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 34259 } }
I20260809 13:03:00.836426 1726 raft_consensus.cc:388] T 00000000000000000000000000000000 P 793ab3ea1cbf46bf93b23d5e89f99b2b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:03:00.836632 1726 raft_consensus.cc:482] T 00000000000000000000000000000000 P 793ab3ea1cbf46bf93b23d5e89f99b2b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:03:00.836828 1726 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 793ab3ea1cbf46bf93b23d5e89f99b2b [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:00.839097 1726 raft_consensus.cc:504] T 00000000000000000000000000000000 P 793ab3ea1cbf46bf93b23d5e89f99b2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "793ab3ea1cbf46bf93b23d5e89f99b2b" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 34259 } }
I20260809 13:03:00.839643 1726 leader_election.cc:302] T 00000000000000000000000000000000 P 793ab3ea1cbf46bf93b23d5e89f99b2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 793ab3ea1cbf46bf93b23d5e89f99b2b; no voters:
I20260809 13:03:00.840332 1726 leader_election.cc:288] T 00000000000000000000000000000000 P 793ab3ea1cbf46bf93b23d5e89f99b2b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:03:00.840451 1734 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 793ab3ea1cbf46bf93b23d5e89f99b2b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:03:00.842031 1734 raft_consensus.cc:686] T 00000000000000000000000000000000 P 793ab3ea1cbf46bf93b23d5e89f99b2b [term 1 LEADER]: Becoming Leader. State: Replica: 793ab3ea1cbf46bf93b23d5e89f99b2b, State: Running, Role: LEADER
I20260809 13:03:00.842592 1734 consensus_queue.cc:237] T 00000000000000000000000000000000 P 793ab3ea1cbf46bf93b23d5e89f99b2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "793ab3ea1cbf46bf93b23d5e89f99b2b" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 34259 } }
I20260809 13:03:00.842804 1726 sys_catalog.cc:564] T 00000000000000000000000000000000 P 793ab3ea1cbf46bf93b23d5e89f99b2b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:03:00.845920 1736 sys_catalog.cc:455] T 00000000000000000000000000000000 P 793ab3ea1cbf46bf93b23d5e89f99b2b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 793ab3ea1cbf46bf93b23d5e89f99b2b. Latest consensus state: current_term: 1 leader_uuid: "793ab3ea1cbf46bf93b23d5e89f99b2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "793ab3ea1cbf46bf93b23d5e89f99b2b" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 34259 } } }
I20260809 13:03:00.846220 1735 sys_catalog.cc:455] T 00000000000000000000000000000000 P 793ab3ea1cbf46bf93b23d5e89f99b2b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "793ab3ea1cbf46bf93b23d5e89f99b2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "793ab3ea1cbf46bf93b23d5e89f99b2b" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 34259 } } }
I20260809 13:03:00.846419 1736 sys_catalog.cc:458] T 00000000000000000000000000000000 P 793ab3ea1cbf46bf93b23d5e89f99b2b [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:00.846498 1735 sys_catalog.cc:458] T 00000000000000000000000000000000 P 793ab3ea1cbf46bf93b23d5e89f99b2b [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:00.848116 1753 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:03:00.852946 1753 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:03:00.861858 1753 catalog_manager.cc:1347] Generated new cluster ID: 37250664d1b14fd391a3b212b80a5692
I20260809 13:03:00.861984 1753 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:03:00.878404 1753 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:03:00.879941 1753 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:03:00.886775 1753 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 793ab3ea1cbf46bf93b23d5e89f99b2b: Generated new TSK 0
I20260809 13:03:00.887637 1753 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
I20260809 13:03:00.952436 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:0
--local_ip_for_outbound_sockets=127.28.155.193
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:34259
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:38117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:01.328163 1767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:01.328576 1767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:01.328763 1767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:01.336557 1767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:01.336735 1767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:01.336936 1767 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:03:01.347797 1767 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:38117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:34259
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:01.349313 1767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:01.350703 1767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:01.364898 1775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:01.364877 1776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:01.364923 1780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:01.365885 1767 server_base.cc:1034] running on GCE node
I20260809 13:03:01.366503 1767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:01.367468 1767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:01.368709 1767 hybrid_clock.cc:648] HybridClock initialized: now 1786280581368656 us; error 57 us; skew 500 ppm
I20260809 13:03:01.369165 1767 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:01 dist-test-slave-jq4t krb5kdc[1599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280581, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:01.375759 1767 init.cc:377] Logged in from keytab as kudu/127.28.155.193@KRBTEST.COM (short username kudu)
I20260809 13:03:01.377875 1767 webserver.cc:460] Webserver started at http://127.28.155.193:39919/ using document root <none> and password file <none>
I20260809 13:03:01.378921 1767 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:01.379081 1767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:01.379472 1767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:01.384688 1767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/data/instance:
uuid: "bd9272e1feb747478ab98341e4daac41"
format_stamp: "Formatted at 2026-08-09 13:03:01 on dist-test-slave-jq4t"
server_key: "878556eb63c7dbc60b5fc95f707847b5"
server_key_iv: "ae6e0001b44ae7f900fda1c0047354a4"
server_key_version: "encryptionkey@0"
I20260809 13:03:01.385864 1767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance:
uuid: "bd9272e1feb747478ab98341e4daac41"
format_stamp: "Formatted at 2026-08-09 13:03:01 on dist-test-slave-jq4t"
server_key: "878556eb63c7dbc60b5fc95f707847b5"
server_key_iv: "ae6e0001b44ae7f900fda1c0047354a4"
server_key_version: "encryptionkey@0"
I20260809 13:03:01.393666 1767 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260809 13:03:01.398491 1794 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:01.400113 1767 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260809 13:03:01.400321 1767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "bd9272e1feb747478ab98341e4daac41"
format_stamp: "Formatted at 2026-08-09 13:03:01 on dist-test-slave-jq4t"
server_key: "878556eb63c7dbc60b5fc95f707847b5"
server_key_iv: "ae6e0001b44ae7f900fda1c0047354a4"
server_key_version: "encryptionkey@0"
I20260809 13:03:01.400637 1767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:01.437187 1767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:01.442097 1767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:01.442435 1767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:01.443615 1767 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:03:01.445194 1767 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:03:01.445305 1767 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:01.445478 1767 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:03:01.445551 1767 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:01.481842 1767 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:41369
I20260809 13:03:01.481911 1971 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:41369 every 8 connection(s)
I20260809 13:03:01.483305 1767 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:03:01.492741 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 1767
I20260809 13:03:01.492974 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance
I20260809 13:03:01.493662 29295 external_mini_cluster.cc:1428] Setting key adaf7cc149edf1ec2175e3755a526d9f
Aug 09 13:03:01 dist-test-slave-jq4t krb5kdc[1599](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280581, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:03:01.505035 1975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:01.486134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:38195 (local address 127.28.155.254:34259)
0809 13:03:01.486662 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:01.486666 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:01.487450 (+ 784us) server_negotiation.cc:407] Connection header received
0809 13:03:01.489518 (+ 2068us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:01.489524 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:01.489624 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:01.489751 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:01.491364 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:01.492114 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:01.493988 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:01.494507 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:01.494663 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:01.498940 (+ 4277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:01.498945 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:01.498948 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:01.498984 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:01.501744 (+ 2760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:01.502539 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:01.502544 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:01.502546 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:01.502672 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:01.503135 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:01.503146 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:01.503148 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:01.503422 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:01.503588 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:01.504340 (+ 752us) server_negotiation.cc:299] Negotiation successful
0809 13:03:01.504621 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":278,"threads_started":1}
I20260809 13:03:01.506240 1976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:01.486539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:34259 (local address 127.28.155.193:38195)
0809 13:03:01.487261 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:01.487308 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:01.489221 (+ 1913us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:01.490010 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:01.490018 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:01.490561 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:01.491176 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:01.491195 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:01.492296 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:01.492300 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:01.493828 (+ 1528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:01.493847 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:01.494779 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:01.494790 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:01.495037 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:01.495852 (+ 815us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:01.495883 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:01.498691 (+ 2808us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:01.501920 (+ 3229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:01.501930 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:01.501946 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:01.502397 (+ 451us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:01.502790 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:01.502795 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:01.502799 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:01.503004 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:01.503568 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:01.503577 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:01.503943 (+ 366us) client_negotiation.cc:769] Sending connection context
0809 13:03:01.504216 (+ 273us) client_negotiation.cc:240] Negotiation successful
0809 13:03:01.504853 (+ 637us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":300,"threads_started":1}
I20260809 13:03:01.508064 1972 heartbeater.cc:347] Connected to a master server at 127.28.155.254:34259
I20260809 13:03:01.508399 1972 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:01.509244 1972 heartbeater.cc:511] Master 127.28.155.254:34259 requested a full tablet report, sending...
I20260809 13:03:01.511721 1671 ts_manager.cc:194] Registered new tserver with Master: bd9272e1feb747478ab98341e4daac41 (127.28.155.193:41369)
I20260809 13:03:01.514104 1671 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.193@KRBTEST.COM'} at 127.28.155.193:38195
WARNING: no policy specified for kudu/127.28.155.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
I20260809 13:03:01.547983 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:0
--local_ip_for_outbound_sockets=127.28.155.194
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:34259
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:38117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:01.897159 1980 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:01.897486 1980 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:01.897646 1980 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:01.905236 1980 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:01.905371 1980 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:01.905548 1980 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:03:01.915868 1980 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:38117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:34259
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:01.917388 1980 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:01.918751 1980 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:01.932857 1987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:01.932775 1988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:01.932928 1990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:01.933810 1980 server_base.cc:1034] running on GCE node
I20260809 13:03:01.934439 1980 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:01.935438 1980 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:01.936672 1980 hybrid_clock.cc:648] HybridClock initialized: now 1786280581936627 us; error 40 us; skew 500 ppm
I20260809 13:03:01.937033 1980 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:01 dist-test-slave-jq4t krb5kdc[1599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280581, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:01.943500 1980 init.cc:377] Logged in from keytab as kudu/127.28.155.194@KRBTEST.COM (short username kudu)
I20260809 13:03:01.945336 1980 webserver.cc:460] Webserver started at http://127.28.155.194:37153/ using document root <none> and password file <none>
I20260809 13:03:01.946260 1980 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:01.946408 1980 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:01.946727 1980 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:01.950037 1980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/data/instance:
uuid: "9721746519034d6ebca8a9f81d178779"
format_stamp: "Formatted at 2026-08-09 13:03:01 on dist-test-slave-jq4t"
server_key: "bd556d65b98927bf99d0951b9f27a925"
server_key_iv: "f5e19ab2a00d84f47accb087ced29e0c"
server_key_version: "encryptionkey@0"
I20260809 13:03:01.950875 1980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance:
uuid: "9721746519034d6ebca8a9f81d178779"
format_stamp: "Formatted at 2026-08-09 13:03:01 on dist-test-slave-jq4t"
server_key: "bd556d65b98927bf99d0951b9f27a925"
server_key_iv: "f5e19ab2a00d84f47accb087ced29e0c"
server_key_version: "encryptionkey@0"
I20260809 13:03:01.956646 1980 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 13:03:01.960320 2003 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:01.961787 1980 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:03:01.961987 1980 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "9721746519034d6ebca8a9f81d178779"
format_stamp: "Formatted at 2026-08-09 13:03:01 on dist-test-slave-jq4t"
server_key: "bd556d65b98927bf99d0951b9f27a925"
server_key_iv: "f5e19ab2a00d84f47accb087ced29e0c"
server_key_version: "encryptionkey@0"
I20260809 13:03:01.962214 1980 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:01.979151 1980 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:01.984170 1980 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:01.984553 1980 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:01.985737 1980 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:03:01.987300 1980 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:03:01.987378 1980 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:01.987536 1980 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:03:01.987596 1980 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:02.024350 1980 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:44751
I20260809 13:03:02.024399 2189 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:44751 every 8 connection(s)
I20260809 13:03:02.025863 1980 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:03:02.031188 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 1980
I20260809 13:03:02.031395 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance
I20260809 13:03:02.031872 29295 external_mini_cluster.cc:1428] Setting key 977f474f93a30d95b3fabf31b50d830f
Aug 09 13:03:02 dist-test-slave-jq4t krb5kdc[1599](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280581, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:03:02.047639 2199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:02.028610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:50969 (local address 127.28.155.254:34259)
0809 13:03:02.029145 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:02.029150 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:02.030024 (+ 874us) server_negotiation.cc:407] Connection header received
0809 13:03:02.032166 (+ 2142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:02.032172 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:02.032271 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:02.032396 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:02.033935 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:02.034707 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:02.036348 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:02.036881 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:02.037033 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:02.041054 (+ 4021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:02.041060 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:02.041064 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:02.041099 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:02.044173 (+ 3074us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:02.045033 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:02.045039 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:02.045042 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:02.045200 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:02.045696 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:02.045701 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:02.045704 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:02.046013 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:02.046182 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:02.046982 (+ 800us) server_negotiation.cc:299] Negotiation successful
0809 13:03:02.047226 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":292,"threads_started":1}
I20260809 13:03:02.048789 2201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:02.029073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:34259 (local address 127.28.155.194:50969)
0809 13:03:02.029821 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:02.029867 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:02.031846 (+ 1979us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:02.032673 (+ 827us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:02.032682 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:02.033198 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:02.033760 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:02.033777 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:02.034882 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:02.034886 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:02.036187 (+ 1301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:02.036200 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:02.037134 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:02.037143 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:02.037397 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:02.038149 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:02.038172 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:02.040802 (+ 2630us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:02.044316 (+ 3514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:02.044326 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:02.044345 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:02.044890 (+ 545us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:02.045321 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:02.045329 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:02.045336 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:02.045564 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:02.046154 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:02.046162 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:02.046596 (+ 434us) client_negotiation.cc:769] Sending connection context
0809 13:03:02.046879 (+ 283us) client_negotiation.cc:240] Negotiation successful
0809 13:03:02.047473 (+ 594us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":292,"threads_started":1}
I20260809 13:03:02.050505 2194 heartbeater.cc:347] Connected to a master server at 127.28.155.254:34259
I20260809 13:03:02.050871 2194 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:02.051700 2194 heartbeater.cc:511] Master 127.28.155.254:34259 requested a full tablet report, sending...
I20260809 13:03:02.053442 1671 ts_manager.cc:194] Registered new tserver with Master: 9721746519034d6ebca8a9f81d178779 (127.28.155.194:44751)
I20260809 13:03:02.054831 1671 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.194@KRBTEST.COM'} at 127.28.155.194:50969
WARNING: no policy specified for kudu/127.28.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
I20260809 13:03:02.085989 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:0
--local_ip_for_outbound_sockets=127.28.155.195
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:34259
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:38117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:02.442765 2204 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:02.443168 2204 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:02.443280 2204 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:02.451159 2204 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:02.451283 2204 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:02.451403 2204 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:03:02.461977 2204 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:38117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:34259
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:02.463351 2204 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:02.464766 2204 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:02.478996 2214 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:02.479031 2220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:02.479066 2215 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:02.479990 2204 server_base.cc:1034] running on GCE node
I20260809 13:03:02.480780 2204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:02.481953 2204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:02.483202 2204 hybrid_clock.cc:648] HybridClock initialized: now 1786280582483141 us; error 58 us; skew 500 ppm
I20260809 13:03:02.483552 2204 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:02 dist-test-slave-jq4t krb5kdc[1599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280582, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:02.487238 2204 init.cc:377] Logged in from keytab as kudu/127.28.155.195@KRBTEST.COM (short username kudu)
I20260809 13:03:02.488953 2204 webserver.cc:460] Webserver started at http://127.28.155.195:44229/ using document root <none> and password file <none>
I20260809 13:03:02.489711 2204 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:02.489873 2204 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:02.490208 2204 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:02.493448 2204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/data/instance:
uuid: "038b03d56d784414953113a3e471a689"
format_stamp: "Formatted at 2026-08-09 13:03:02 on dist-test-slave-jq4t"
server_key: "2eeef9fc0ef34f6bbf9bbe77a032a470"
server_key_iv: "f06a69e95dc635b6635be22056a962a9"
server_key_version: "encryptionkey@0"
I20260809 13:03:02.494334 2204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance:
uuid: "038b03d56d784414953113a3e471a689"
format_stamp: "Formatted at 2026-08-09 13:03:02 on dist-test-slave-jq4t"
server_key: "2eeef9fc0ef34f6bbf9bbe77a032a470"
server_key_iv: "f06a69e95dc635b6635be22056a962a9"
server_key_version: "encryptionkey@0"
I20260809 13:03:02.500105 2204 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260809 13:03:02.503942 2232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:02.505432 2204 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:03:02.505649 2204 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "038b03d56d784414953113a3e471a689"
format_stamp: "Formatted at 2026-08-09 13:03:02 on dist-test-slave-jq4t"
server_key: "2eeef9fc0ef34f6bbf9bbe77a032a470"
server_key_iv: "f06a69e95dc635b6635be22056a962a9"
server_key_version: "encryptionkey@0"
I20260809 13:03:02.505874 2204 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:02.517663 1972 heartbeater.cc:503] Master 127.28.155.254:34259 was elected leader, sending a full tablet report...
I20260809 13:03:02.528571 2204 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:02.533618 2204 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:02.533972 2204 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:02.535228 2204 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:03:02.536863 2204 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:03:02.536978 2204 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:02.537145 2204 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:03:02.537220 2204 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:02.574218 2204 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:39037
I20260809 13:03:02.574316 2423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:39037 every 8 connection(s)
I20260809 13:03:02.575747 2204 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:03:02.582314 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 2204
I20260809 13:03:02.582525 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance
I20260809 13:03:02.583135 29295 external_mini_cluster.cc:1428] Setting key 04c4d3d624d9654195b1945d8a188e5a
Aug 09 13:03:02 dist-test-slave-jq4t krb5kdc[1599](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280582, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:03:02.598031 2433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:02.578646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:32805 (local address 127.28.155.254:34259)
0809 13:03:02.579116 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:02.579121 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:02.580220 (+ 1099us) server_negotiation.cc:407] Connection header received
0809 13:03:02.582234 (+ 2014us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:02.582239 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:02.582344 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:02.582481 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:02.584670 (+ 2189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:02.585785 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:02.587623 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:02.588035 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:02.588147 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:02.591674 (+ 3527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:02.591679 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:02.591683 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:02.591717 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:02.594811 (+ 3094us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:02.595549 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:02.595553 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:02.595555 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:02.595688 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:02.596096 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:02.596099 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:02.596101 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:02.596375 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:02.596553 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:02.597392 (+ 839us) server_negotiation.cc:299] Negotiation successful
0809 13:03:02.597633 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":216,"threads_started":1}
I20260809 13:03:02.599246 2434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:02.579221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:34259 (local address 127.28.155.195:32805)
0809 13:03:02.580020 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:02.580079 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:02.581930 (+ 1851us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:02.582811 (+ 881us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:02.582824 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:02.583632 (+ 808us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:02.584440 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:02.584474 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:02.585942 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:02.585946 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:02.587480 (+ 1534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:02.587494 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:02.588244 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:02.588249 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:02.588460 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:02.589180 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:02.589206 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:02.591462 (+ 2256us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:02.594967 (+ 3505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:02.594974 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:02.594987 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:02.595435 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:02.595782 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:02.595785 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:02.595787 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:02.595987 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:02.596531 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:02.596545 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:02.596965 (+ 420us) client_negotiation.cc:769] Sending connection context
0809 13:03:02.597298 (+ 333us) client_negotiation.cc:240] Negotiation successful
0809 13:03:02.597863 (+ 565us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":350,"threads_started":1}
I20260809 13:03:02.600710 2426 heartbeater.cc:347] Connected to a master server at 127.28.155.254:34259
I20260809 13:03:02.601040 2426 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:02.601854 2426 heartbeater.cc:511] Master 127.28.155.254:34259 requested a full tablet report, sending...
I20260809 13:03:02.603430 1671 ts_manager.cc:194] Registered new tserver with Master: 038b03d56d784414953113a3e471a689 (127.28.155.195:39037)
I20260809 13:03:02.604326 1671 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.195@KRBTEST.COM'} at 127.28.155.195:32805
I20260809 13:03:02.611564 29295 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 13:03:02 dist-test-slave-jq4t krb5kdc[1599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280582, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 09 13:03:02 dist-test-slave-jq4t krb5kdc[1599](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280582, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:03:02.670164 2433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:02.654830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39820 (local address 127.28.155.254:34259)
0809 13:03:02.655115 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:02.655124 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:02.655482 (+ 358us) server_negotiation.cc:407] Connection header received
0809 13:03:02.655748 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:02.655753 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:02.655843 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:02.655963 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:02.657476 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:02.658264 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:02.659582 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:02.660026 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:02.660185 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:02.664332 (+ 4147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:02.664338 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:02.664341 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:02.664379 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:02.667253 (+ 2874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:02.667964 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:02.667970 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:02.667973 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:02.668127 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:02.668592 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:02.668597 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:02.668601 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:02.668964 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:02.669243 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:02.669563 (+ 320us) server_negotiation.cc:299] Negotiation successful
0809 13:03:02.669824 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
W20260809 13:03:02.670852 1671 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:39820
I20260809 13:03:02.672362 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 1767
Aug 09 13:03:02 dist-test-slave-jq4t krb5kdc[1599](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280582, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.28.155.193@KRBTEST.COM
I20260809 13:03:02.689525 2446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:02.673646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59764 (local address 127.28.155.193:41369)
0809 13:03:02.674390 (+ 744us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:02.674397 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:02.674422 (+ 25us) server_negotiation.cc:407] Connection header received
0809 13:03:02.674482 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:02.674488 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:02.674708 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:02.674835 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:02.676181 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:02.677302 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:02.678471 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:02.679034 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:02.679136 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:02.683283 (+ 4147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:02.683298 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:02.683314 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:02.683357 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:02.686649 (+ 3292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:02.687348 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:02.687356 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:02.687358 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:02.687496 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:02.687842 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:02.687845 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:02.687847 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:02.688215 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:02.688453 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:02.688811 (+ 358us) server_negotiation.cc:299] Negotiation successful
0809 13:03:02.689040 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":576,"thread_start_us":398,"threads_started":1}
W20260809 13:03:02.690889 1965 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:59764
W20260809 13:03:02.692044 29295 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 1767: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 13:03:02.692302 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 1767
I20260809 13:03:02.716334 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 1980
Aug 09 13:03:02 dist-test-slave-jq4t krb5kdc[1599](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280582, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.28.155.194@KRBTEST.COM
I20260809 13:03:02.733024 2448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:02.717387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53246 (local address 127.28.155.194:44751)
0809 13:03:02.717982 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:02.717989 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:02.718016 (+ 27us) server_negotiation.cc:407] Connection header received
0809 13:03:02.718083 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:02.718089 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:02.718313 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:02.718463 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:02.719720 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:02.720845 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:02.722109 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:02.722679 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:02.722787 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:02.727319 (+ 4532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:02.727334 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:02.727348 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:02.727385 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:02.730364 (+ 2979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:02.731017 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:02.731024 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:02.731026 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:02.731154 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:02.731483 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:02.731486 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:02.731488 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:02.731834 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:02.732096 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:02.732327 (+ 231us) server_negotiation.cc:299] Negotiation successful
0809 13:03:02.732660 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":300,"threads_started":1}
W20260809 13:03:02.734338 2183 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:53246
W20260809 13:03:02.735497 29295 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 1980: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 13:03:02.735682 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 1980
I20260809 13:03:02.763461 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 2204
Aug 09 13:03:02 dist-test-slave-jq4t krb5kdc[1599](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280582, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.28.155.195@KRBTEST.COM
I20260809 13:03:02.781185 2449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:02.764554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53192 (local address 127.28.155.195:39037)
0809 13:03:02.765324 (+ 770us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:02.765331 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:02.765363 (+ 32us) server_negotiation.cc:407] Connection header received
0809 13:03:02.765430 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:02.765436 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:02.765664 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:02.765807 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:02.767188 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:02.768301 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:02.769692 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:02.770285 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:02.770392 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:02.775094 (+ 4702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:02.775109 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:02.775123 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:02.775162 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:02.778032 (+ 2870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:02.778762 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:02.778769 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:02.778772 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:02.778899 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:02.779318 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:02.779322 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:02.779324 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:02.779698 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:02.780040 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:02.780368 (+ 328us) server_negotiation.cc:299] Negotiation successful
0809 13:03:02.780853 (+ 485us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":601,"thread_start_us":327,"threads_started":1}
W20260809 13:03:02.782584 2415 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:53192
W20260809 13:03:02.783916 29295 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 2204: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 13:03:02.784142 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 2204
I20260809 13:03:02.809839 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 1619
I20260809 13:03:02.811287 1721 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:02.922564 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 1619
2026-08-09T13:03:02Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (4151 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:03:03 dist-test-slave-jq4t krb5kdc[2459](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:03:03 dist-test-slave-jq4t krb5kdc[2459](info): set up 2 sockets
Aug 09 13:03:03 dist-test-slave-jq4t krb5kdc[2459](info): commencing operation
krb5kdc: starting...
W20260809 13:03:04.252686 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.275s user 0.003s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:03:04 dist-test-slave-jq4t krb5kdc[2459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:03:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:03:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
I20260809 13:03:04.509024 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:44233
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:37329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:44233
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:04.867488 2485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:04.867861 2485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:04.868039 2485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:04.875516 2485 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:03:04.875698 2485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:04.875831 2485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:04.875942 2485 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:03:04.876021 2485 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:03:04.886574 2485 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:37329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:44233
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:44233
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:04.888018 2485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:04.889432 2485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:04.901798 2491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:04.901856 2492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:04.901856 2494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:04.902762 2485 server_base.cc:1034] running on GCE node
I20260809 13:03:04.903565 2485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:04.905121 2485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:04.906380 2485 hybrid_clock.cc:648] HybridClock initialized: now 1786280584906331 us; error 43 us; skew 500 ppm
I20260809 13:03:04.906698 2485 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:04 dist-test-slave-jq4t krb5kdc[2459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280584, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:04.909984 2485 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:03:04.911561 2485 webserver.cc:460] Webserver started at http://127.28.155.254:34769/ using document root <none> and password file <none>
I20260809 13:03:04.912276 2485 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:04.912410 2485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:04.912786 2485 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:04.915982 2485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "ef9242edf87a4bdbbc329128aab11a2b"
format_stamp: "Formatted at 2026-08-09 13:03:04 on dist-test-slave-jq4t"
server_key: "9e35cfb62458c991d1a9498ddc4b4a37"
server_key_iv: "c0a41d8e96673adbd364c49be7ad78f6"
server_key_version: "encryptionkey@0"
I20260809 13:03:04.916868 2485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "ef9242edf87a4bdbbc329128aab11a2b"
format_stamp: "Formatted at 2026-08-09 13:03:04 on dist-test-slave-jq4t"
server_key: "9e35cfb62458c991d1a9498ddc4b4a37"
server_key_iv: "c0a41d8e96673adbd364c49be7ad78f6"
server_key_version: "encryptionkey@0"
I20260809 13:03:04.922161 2485 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 13:03:04.925633 2504 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:04.926944 2485 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 13:03:04.927153 2485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "ef9242edf87a4bdbbc329128aab11a2b"
format_stamp: "Formatted at 2026-08-09 13:03:04 on dist-test-slave-jq4t"
server_key: "9e35cfb62458c991d1a9498ddc4b4a37"
server_key_iv: "c0a41d8e96673adbd364c49be7ad78f6"
server_key_version: "encryptionkey@0"
I20260809 13:03:04.927361 2485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:04.942951 2485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:04.947300 2485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:04.947623 2485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:04.967480 2485 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:44233
I20260809 13:03:04.967512 2581 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:44233 every 8 connection(s)
I20260809 13:03:04.969096 2485 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:03:04.973328 2582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:04.975324 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 2485
I20260809 13:03:04.975584 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:03:04.976297 29295 external_mini_cluster.cc:1428] Setting key b41fe59c0e72e3bbfb8363a7f661601d
I20260809 13:03:04.986122 2582 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef9242edf87a4bdbbc329128aab11a2b: Bootstrap starting.
I20260809 13:03:04.989653 2582 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ef9242edf87a4bdbbc329128aab11a2b: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:04.990811 2582 log.cc:824] T 00000000000000000000000000000000 P ef9242edf87a4bdbbc329128aab11a2b: Log is configured to *not* fsync() on all Append() calls
Aug 09 13:03:04 dist-test-slave-jq4t krb5kdc[2459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:03:04.994330 2582 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef9242edf87a4bdbbc329128aab11a2b: No bootstrap required, opened a new log
I20260809 13:03:05.001569 2586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:04.978687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52842 (local address 127.28.155.254:44233)
0809 13:03:04.979572 (+ 885us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:04.979585 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:04.979632 (+ 47us) server_negotiation.cc:407] Connection header received
0809 13:03:04.981745 (+ 2113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:04.981773 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:04.982200 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:04.982641 (+ 441us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:04.984296 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:04.985761 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:04.987185 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:04.987948 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:04.988172 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:04.992855 (+ 4683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:04.992864 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:04.992880 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:04.992921 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:04.996686 (+ 3765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:04.997577 (+ 891us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:04.997586 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:04.997593 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:04.997794 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:04.998242 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:04.998249 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:04.998256 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:04.998873 (+ 617us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:04.999266 (+ 393us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:04.999768 (+ 502us) server_negotiation.cc:299] Negotiation successful
0809 13:03:05.000288 (+ 520us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":637,"thread_start_us":388,"threads_started":1}
I20260809 13:03:05.003203 2582 raft_consensus.cc:348] T 00000000000000000000000000000000 P ef9242edf87a4bdbbc329128aab11a2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef9242edf87a4bdbbc329128aab11a2b" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44233 } }
I20260809 13:03:05.003780 2582 raft_consensus.cc:374] T 00000000000000000000000000000000 P ef9242edf87a4bdbbc329128aab11a2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:05.003911 2582 raft_consensus.cc:729] T 00000000000000000000000000000000 P ef9242edf87a4bdbbc329128aab11a2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9242edf87a4bdbbc329128aab11a2b, State: Initialized, Role: FOLLOWER
I20260809 13:03:05.004691 2582 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef9242edf87a4bdbbc329128aab11a2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef9242edf87a4bdbbc329128aab11a2b" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44233 } }
I20260809 13:03:05.005030 2582 raft_consensus.cc:388] T 00000000000000000000000000000000 P ef9242edf87a4bdbbc329128aab11a2b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:03:05.005232 2582 raft_consensus.cc:482] T 00000000000000000000000000000000 P ef9242edf87a4bdbbc329128aab11a2b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:03:05.005419 2582 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ef9242edf87a4bdbbc329128aab11a2b [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:05.008044 2582 raft_consensus.cc:504] T 00000000000000000000000000000000 P ef9242edf87a4bdbbc329128aab11a2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef9242edf87a4bdbbc329128aab11a2b" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44233 } }
I20260809 13:03:05.008750 2582 leader_election.cc:302] T 00000000000000000000000000000000 P ef9242edf87a4bdbbc329128aab11a2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ef9242edf87a4bdbbc329128aab11a2b; no voters:
I20260809 13:03:05.009430 2582 leader_election.cc:288] T 00000000000000000000000000000000 P ef9242edf87a4bdbbc329128aab11a2b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:03:05.009620 2592 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ef9242edf87a4bdbbc329128aab11a2b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:03:05.010418 2592 raft_consensus.cc:686] T 00000000000000000000000000000000 P ef9242edf87a4bdbbc329128aab11a2b [term 1 LEADER]: Becoming Leader. State: Replica: ef9242edf87a4bdbbc329128aab11a2b, State: Running, Role: LEADER
I20260809 13:03:05.011077 2592 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef9242edf87a4bdbbc329128aab11a2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef9242edf87a4bdbbc329128aab11a2b" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44233 } }
I20260809 13:03:05.011838 2582 sys_catalog.cc:564] T 00000000000000000000000000000000 P ef9242edf87a4bdbbc329128aab11a2b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:03:05.014441 2596 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9242edf87a4bdbbc329128aab11a2b [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef9242edf87a4bdbbc329128aab11a2b. Latest consensus state: current_term: 1 leader_uuid: "ef9242edf87a4bdbbc329128aab11a2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef9242edf87a4bdbbc329128aab11a2b" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44233 } } }
I20260809 13:03:05.015179 2596 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9242edf87a4bdbbc329128aab11a2b [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:05.015275 2595 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9242edf87a4bdbbc329128aab11a2b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ef9242edf87a4bdbbc329128aab11a2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef9242edf87a4bdbbc329128aab11a2b" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44233 } } }
I20260809 13:03:05.020411 2595 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9242edf87a4bdbbc329128aab11a2b [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:05.021359 2600 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:03:05.027360 2600 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:03:05.038108 2600 catalog_manager.cc:1347] Generated new cluster ID: 55688de6278045efb50fe97a20371bf9
I20260809 13:03:05.038277 2600 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:03:05.086612 2600 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:03:05.088663 2600 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:03:05.107300 2600 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ef9242edf87a4bdbbc329128aab11a2b: Generated new TSK 0
I20260809 13:03:05.108392 2600 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
I20260809 13:03:05.182717 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:0
--local_ip_for_outbound_sockets=127.28.155.193
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:44233
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:37329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:05.572211 2627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:05.572604 2627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:05.572731 2627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:05.580750 2627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:05.580888 2627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:05.581010 2627 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:03:05.591571 2627 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:37329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:44233
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:05.592926 2627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:05.594269 2627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:05.608705 2639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:05.608608 2645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:05.608685 2640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:05.609931 2627 server_base.cc:1034] running on GCE node
I20260809 13:03:05.610713 2627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:05.611779 2627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:05.613005 2627 hybrid_clock.cc:648] HybridClock initialized: now 1786280585612963 us; error 35 us; skew 500 ppm
I20260809 13:03:05.613413 2627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:05 dist-test-slave-jq4t krb5kdc[2459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280585, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:05.616921 2627 init.cc:377] Logged in from keytab as kudu/127.28.155.193@KRBTEST.COM (short username kudu)
I20260809 13:03:05.618580 2627 webserver.cc:460] Webserver started at http://127.28.155.193:37043/ using document root <none> and password file <none>
I20260809 13:03:05.619333 2627 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:05.619491 2627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:05.619834 2627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:05.623208 2627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-0/data/instance:
uuid: "cef44bdc86c9474d8e9ac087830876eb"
format_stamp: "Formatted at 2026-08-09 13:03:05 on dist-test-slave-jq4t"
server_key: "20637e5cedbcdde875f48b85e70dacb0"
server_key_iv: "41c9fc315ac699cbcc2046f6660b3ddb"
server_key_version: "encryptionkey@0"
I20260809 13:03:05.624218 2627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance:
uuid: "cef44bdc86c9474d8e9ac087830876eb"
format_stamp: "Formatted at 2026-08-09 13:03:05 on dist-test-slave-jq4t"
server_key: "20637e5cedbcdde875f48b85e70dacb0"
server_key_iv: "41c9fc315ac699cbcc2046f6660b3ddb"
server_key_version: "encryptionkey@0"
I20260809 13:03:05.629827 2627 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 13:03:05.633558 2656 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:05.635056 2627 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:03:05.635245 2627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "cef44bdc86c9474d8e9ac087830876eb"
format_stamp: "Formatted at 2026-08-09 13:03:05 on dist-test-slave-jq4t"
server_key: "20637e5cedbcdde875f48b85e70dacb0"
server_key_iv: "41c9fc315ac699cbcc2046f6660b3ddb"
server_key_version: "encryptionkey@0"
I20260809 13:03:05.635438 2627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:05.657044 2627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:05.661266 2627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:05.661541 2627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:05.662545 2627 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:03:05.663914 2627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:03:05.664007 2627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:05.664094 2627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:03:05.664147 2627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:05.699849 2627 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:36395
I20260809 13:03:05.699910 2841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:36395 every 8 connection(s)
I20260809 13:03:05.701339 2627 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:03:05.711476 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 2627
I20260809 13:03:05.711741 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance
I20260809 13:03:05.712651 29295 external_mini_cluster.cc:1428] Setting key 0a495476c796f7c25fdea1afcd27869a
Aug 09 13:03:05 dist-test-slave-jq4t krb5kdc[2459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280585, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:03:05.725801 2845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:05.704261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:45689 (local address 127.28.155.254:44233)
0809 13:03:05.704799 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:05.704806 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:05.705878 (+ 1072us) server_negotiation.cc:407] Connection header received
0809 13:03:05.707884 (+ 2006us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:05.707888 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:05.707972 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:05.708082 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:05.709975 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:05.710767 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:05.713579 (+ 2812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:05.714209 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:05.714369 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:05.718718 (+ 4349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:05.718724 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:05.718727 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:05.718766 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:05.721704 (+ 2938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:05.722799 (+ 1095us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:05.722803 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:05.722805 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:05.722952 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:05.723503 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:05.723506 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:05.723508 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:05.723930 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:05.724101 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:05.725011 (+ 910us) server_negotiation.cc:299] Negotiation successful
0809 13:03:05.725310 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":274,"threads_started":1}
I20260809 13:03:05.726518 2847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:05.704952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:44233 (local address 127.28.155.193:45689)
0809 13:03:05.705694 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:05.705741 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:05.707544 (+ 1803us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:05.708369 (+ 825us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:05.708379 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:05.709077 (+ 698us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:05.709721 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:05.709741 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:05.711013 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:05.711019 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:05.713391 (+ 2372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:05.713407 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:05.714508 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:05.714514 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:05.714745 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:05.715572 (+ 827us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:05.715605 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:05.718421 (+ 2816us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:05.721891 (+ 3470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:05.721905 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:05.721929 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:05.722660 (+ 731us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:05.723077 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:05.723085 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:05.723092 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:05.723380 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:05.724081 (+ 701us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:05.724093 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:05.724570 (+ 477us) client_negotiation.cc:769] Sending connection context
0809 13:03:05.724834 (+ 264us) client_negotiation.cc:240] Negotiation successful
0809 13:03:05.725282 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":281,"threads_started":1}
I20260809 13:03:05.728308 2842 heartbeater.cc:347] Connected to a master server at 127.28.155.254:44233
I20260809 13:03:05.728690 2842 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:05.729517 2842 heartbeater.cc:511] Master 127.28.155.254:44233 requested a full tablet report, sending...
I20260809 13:03:05.731899 2531 ts_manager.cc:194] Registered new tserver with Master: cef44bdc86c9474d8e9ac087830876eb (127.28.155.193:36395)
I20260809 13:03:05.733578 2531 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.193@KRBTEST.COM'} at 127.28.155.193:45689
WARNING: no policy specified for kudu/127.28.155.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
I20260809 13:03:05.771732 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:0
--local_ip_for_outbound_sockets=127.28.155.194
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:44233
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:37329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:06.126331 2856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:06.126698 2856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:06.126883 2856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:06.134796 2856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:06.134972 2856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:06.135159 2856 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:03:06.145542 2856 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:37329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:44233
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:06.146982 2856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:06.148360 2856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:06.163004 2866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:06.163179 2870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:06.162961 2867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:06.164292 2856 server_base.cc:1034] running on GCE node
I20260809 13:03:06.165010 2856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:06.166033 2856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:06.167271 2856 hybrid_clock.cc:648] HybridClock initialized: now 1786280586167228 us; error 37 us; skew 500 ppm
I20260809 13:03:06.167615 2856 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:06 dist-test-slave-jq4t krb5kdc[2459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280586, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:06.170943 2856 init.cc:377] Logged in from keytab as kudu/127.28.155.194@KRBTEST.COM (short username kudu)
I20260809 13:03:06.172391 2856 webserver.cc:460] Webserver started at http://127.28.155.194:35281/ using document root <none> and password file <none>
I20260809 13:03:06.173158 2856 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:06.173318 2856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:06.173645 2856 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:06.176868 2856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-1/data/instance:
uuid: "730d81d99c3e4616bf30454805308863"
format_stamp: "Formatted at 2026-08-09 13:03:06 on dist-test-slave-jq4t"
server_key: "e918f8cf00084e55e1100afd6eb6a047"
server_key_iv: "95eb5efb97947f629469823350c146a3"
server_key_version: "encryptionkey@0"
I20260809 13:03:06.177804 2856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance:
uuid: "730d81d99c3e4616bf30454805308863"
format_stamp: "Formatted at 2026-08-09 13:03:06 on dist-test-slave-jq4t"
server_key: "e918f8cf00084e55e1100afd6eb6a047"
server_key_iv: "95eb5efb97947f629469823350c146a3"
server_key_version: "encryptionkey@0"
I20260809 13:03:06.183449 2856 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 13:03:06.187299 2883 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:06.188782 2856 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 13:03:06.188980 2856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "730d81d99c3e4616bf30454805308863"
format_stamp: "Formatted at 2026-08-09 13:03:06 on dist-test-slave-jq4t"
server_key: "e918f8cf00084e55e1100afd6eb6a047"
server_key_iv: "95eb5efb97947f629469823350c146a3"
server_key_version: "encryptionkey@0"
I20260809 13:03:06.189220 2856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:06.217741 2856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:06.222270 2856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:06.222607 2856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:06.223819 2856 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:03:06.225414 2856 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:03:06.225526 2856 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:06.225683 2856 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:03:06.225759 2856 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:06.261910 2856 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:39893
I20260809 13:03:06.261976 3072 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:39893 every 8 connection(s)
I20260809 13:03:06.263341 2856 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:03:06.268522 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 2856
I20260809 13:03:06.268756 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance
I20260809 13:03:06.269208 29295 external_mini_cluster.cc:1428] Setting key c332d2e52a22647fcb3a20d7449c8a6d
Aug 09 13:03:06 dist-test-slave-jq4t krb5kdc[2459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280586, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:03:06.286691 3078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:06.266027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:53917 (local address 127.28.155.254:44233)
0809 13:03:06.266523 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:06.266530 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:06.267534 (+ 1004us) server_negotiation.cc:407] Connection header received
0809 13:03:06.269759 (+ 2225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:06.269765 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:06.269857 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:06.269958 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:06.271879 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:06.273018 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:06.274621 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:06.275375 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:06.275521 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:06.280167 (+ 4646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:06.280175 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:06.280182 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:06.280230 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:06.283171 (+ 2941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:06.283967 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:06.283974 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:06.283978 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:06.284130 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:06.284761 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:06.284768 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:06.284772 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:06.285111 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:06.285292 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:06.286027 (+ 735us) server_negotiation.cc:299] Negotiation successful
0809 13:03:06.286288 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":224,"threads_started":1}
I20260809 13:03:06.287762 3079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:06.266607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:44233 (local address 127.28.155.194:53917)
0809 13:03:06.267342 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:06.267390 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:06.269453 (+ 2063us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:06.270351 (+ 898us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:06.270361 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:06.270921 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:06.271694 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:06.271715 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:06.273176 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:06.273179 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:06.274453 (+ 1274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:06.274466 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:06.275607 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:06.275612 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:06.275820 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:06.276660 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:06.276693 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:06.279888 (+ 3195us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:06.283334 (+ 3446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:06.283344 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:06.283363 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:06.283839 (+ 476us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:06.284254 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:06.284259 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:06.284263 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:06.284471 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:06.285256 (+ 785us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:06.285265 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:06.285645 (+ 380us) client_negotiation.cc:769] Sending connection context
0809 13:03:06.285922 (+ 277us) client_negotiation.cc:240] Negotiation successful
0809 13:03:06.286502 (+ 580us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":289,"threads_started":1}
I20260809 13:03:06.289399 3073 heartbeater.cc:347] Connected to a master server at 127.28.155.254:44233
I20260809 13:03:06.289748 3073 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:06.290544 3073 heartbeater.cc:511] Master 127.28.155.254:44233 requested a full tablet report, sending...
I20260809 13:03:06.292244 2531 ts_manager.cc:194] Registered new tserver with Master: 730d81d99c3e4616bf30454805308863 (127.28.155.194:39893)
I20260809 13:03:06.293649 2531 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.194@KRBTEST.COM'} at 127.28.155.194:53917
WARNING: no policy specified for kudu/127.28.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
I20260809 13:03:06.327761 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:0
--local_ip_for_outbound_sockets=127.28.155.195
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:44233
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:37329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:06.686424 3085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:06.686813 3085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:06.686939 3085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:06.694427 3085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:06.694545 3085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:06.694669 3085 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:03:06.704978 3085 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:37329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:44233
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:06.706146 3085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:06.707397 3085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:06.721364 3094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:06.721320 3093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:06.721266 3096 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:06.722337 3085 server_base.cc:1034] running on GCE node
I20260809 13:03:06.723083 3085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:06.724076 3085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:06.725314 3085 hybrid_clock.cc:648] HybridClock initialized: now 1786280586725270 us; error 58 us; skew 500 ppm
I20260809 13:03:06.725657 3085 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:06 dist-test-slave-jq4t krb5kdc[2459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280586, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:06.729045 3085 init.cc:377] Logged in from keytab as kudu/127.28.155.195@KRBTEST.COM (short username kudu)
I20260809 13:03:06.730743 3085 webserver.cc:460] Webserver started at http://127.28.155.195:45625/ using document root <none> and password file <none>
I20260809 13:03:06.731532 3085 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:06.731695 3085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:06.732052 3085 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:06.735296 3085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-2/data/instance:
uuid: "4c6a19d7e3904cadb548924f5672bc9a"
format_stamp: "Formatted at 2026-08-09 13:03:06 on dist-test-slave-jq4t"
server_key: "650271f40dd827e1a1cc2cc21b8a166c"
server_key_iv: "96411fd7cd430aa386445fada36c9ef3"
server_key_version: "encryptionkey@0"
I20260809 13:03:06.736150 3085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance:
uuid: "4c6a19d7e3904cadb548924f5672bc9a"
format_stamp: "Formatted at 2026-08-09 13:03:06 on dist-test-slave-jq4t"
server_key: "650271f40dd827e1a1cc2cc21b8a166c"
server_key_iv: "96411fd7cd430aa386445fada36c9ef3"
server_key_version: "encryptionkey@0"
I20260809 13:03:06.737087 2842 heartbeater.cc:503] Master 127.28.155.254:44233 was elected leader, sending a full tablet report...
I20260809 13:03:06.742415 3085 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260809 13:03:06.746099 3108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:06.747459 3085 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 13:03:06.747650 3085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "4c6a19d7e3904cadb548924f5672bc9a"
format_stamp: "Formatted at 2026-08-09 13:03:06 on dist-test-slave-jq4t"
server_key: "650271f40dd827e1a1cc2cc21b8a166c"
server_key_iv: "96411fd7cd430aa386445fada36c9ef3"
server_key_version: "encryptionkey@0"
I20260809 13:03:06.747861 3085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:06.778816 3085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:06.783308 3085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:06.783643 3085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:06.784758 3085 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:03:06.786365 3085 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:03:06.786448 3085 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:06.786610 3085 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:03:06.786666 3085 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:06.822356 3085 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:37859
I20260809 13:03:06.822402 3304 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:37859 every 8 connection(s)
I20260809 13:03:06.823874 3085 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:03:06.824878 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 3085
I20260809 13:03:06.825089 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance
I20260809 13:03:06.825700 29295 external_mini_cluster.cc:1428] Setting key 4f285bde27f20dcb8be606e831a03c46
Aug 09 13:03:06 dist-test-slave-jq4t krb5kdc[2459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280586, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:03:06.845981 3309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:06.827006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:59581 (local address 127.28.155.254:44233)
0809 13:03:06.827538 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:06.827551 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:06.828728 (+ 1177us) server_negotiation.cc:407] Connection header received
0809 13:03:06.830676 (+ 1948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:06.830680 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:06.830751 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:06.830891 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:06.832616 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:06.833444 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:06.835077 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:06.835519 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:06.835631 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:06.839532 (+ 3901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:06.839537 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:06.839540 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:06.839602 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:06.843017 (+ 3415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:06.843748 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:06.843752 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:06.843754 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:06.843902 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:06.844306 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:06.844309 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:06.844311 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:06.844674 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:06.844800 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:06.845519 (+ 719us) server_negotiation.cc:299] Negotiation successful
0809 13:03:06.845702 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":263,"threads_started":1}
I20260809 13:03:06.846989 3310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:06.827684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:44233 (local address 127.28.155.195:59581)
0809 13:03:06.828545 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:06.828603 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:06.830418 (+ 1815us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:06.831091 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:06.831099 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:06.831703 (+ 604us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:06.832390 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:06.832412 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:06.833613 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:06.833617 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:06.834915 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:06.834928 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:06.835736 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:06.835740 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:06.835948 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:06.836769 (+ 821us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:06.836794 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:06.839283 (+ 2489us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:06.843151 (+ 3868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:06.843159 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:06.843172 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:06.843635 (+ 463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:06.843997 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:06.844000 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:06.844002 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:06.844201 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:06.844786 (+ 585us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:06.844792 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:06.845158 (+ 366us) client_negotiation.cc:769] Sending connection context
0809 13:03:06.845390 (+ 232us) client_negotiation.cc:240] Negotiation successful
0809 13:03:06.845819 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"thread_start_us":364,"threads_started":1}
I20260809 13:03:06.848397 3305 heartbeater.cc:347] Connected to a master server at 127.28.155.254:44233
I20260809 13:03:06.848764 3305 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:06.849532 3305 heartbeater.cc:511] Master 127.28.155.254:44233 requested a full tablet report, sending...
I20260809 13:03:06.851146 2531 ts_manager.cc:194] Registered new tserver with Master: 4c6a19d7e3904cadb548924f5672bc9a (127.28.155.195:37859)
I20260809 13:03:06.852140 2531 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.195@KRBTEST.COM'} at 127.28.155.195:59581
I20260809 13:03:06.854846 29295 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 13:03:06 dist-test-slave-jq4t krb5kdc[2459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 13:03:06 dist-test-slave-jq4t krb5kdc[2459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.193@KRBTEST.COM
I20260809 13:03:06.915593 3316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:06.898610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35578 (local address 127.28.155.193:36395)
0809 13:03:06.899394 (+ 784us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:06.899401 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:06.899427 (+ 26us) server_negotiation.cc:407] Connection header received
0809 13:03:06.899489 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:06.899495 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:06.899723 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:06.899904 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:06.901547 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:06.902610 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:06.903951 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:06.904652 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:06.904800 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:06.909246 (+ 4446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:06.909259 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:06.909274 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:06.909313 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:06.912611 (+ 3298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:06.913307 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:06.913319 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:06.913323 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:06.913464 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:06.913873 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:06.913879 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:06.913882 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:06.914239 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:06.914605 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:06.914903 (+ 298us) server_negotiation.cc:299] Negotiation successful
0809 13:03:06.915194 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":369,"threads_started":1}
Aug 09 13:03:06 dist-test-slave-jq4t krb5kdc[2459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:03:06.935035 3309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:06.920682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48644 (local address 127.28.155.254:44233)
0809 13:03:06.920949 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:06.920955 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:06.921121 (+ 166us) server_negotiation.cc:407] Connection header received
0809 13:03:06.921262 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:06.921266 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:06.921354 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:06.921442 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:06.922822 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:06.923586 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:06.924921 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:06.925350 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:06.925456 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:06.929433 (+ 3977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:06.929438 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:06.929442 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:06.929477 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:06.932543 (+ 3066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:06.933193 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:06.933197 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:06.933199 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:06.933327 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:06.933647 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:06.933650 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:06.933652 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:06.934008 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:06.934202 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:06.934479 (+ 277us) server_negotiation.cc:299] Negotiation successful
0809 13:03:06.934658 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
W20260809 13:03:06.935730 2531 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48644
I20260809 13:03:06.936838 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 2627
I20260809 13:03:06.954249 3316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:06.937779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35580 (local address 127.28.155.193:36395)
0809 13:03:06.938011 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:06.938017 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:06.938251 (+ 234us) server_negotiation.cc:407] Connection header received
0809 13:03:06.938444 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:06.938450 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:06.938568 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:06.938707 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:06.939951 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:06.940759 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:06.941994 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:06.942422 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:06.942574 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:06.948526 (+ 5952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:06.948557 (+ 31us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:06.948561 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:06.948599 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:06.951433 (+ 2834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:06.952178 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:06.952184 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:06.952188 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:06.952329 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:06.952753 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:06.952758 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:06.952761 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:06.953043 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:06.953302 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:06.953632 (+ 330us) server_negotiation.cc:299] Negotiation successful
0809 13:03:06.953901 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 13:03:06.954869 2836 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:07.041127 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 2627
I20260809 13:03:07.067698 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 2856
Aug 09 13:03:07 dist-test-slave-jq4t krb5kdc[2459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.194@KRBTEST.COM
I20260809 13:03:07.085099 3323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:07.068908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56112 (local address 127.28.155.194:39893)
0809 13:03:07.069502 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:07.069509 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:07.069547 (+ 38us) server_negotiation.cc:407] Connection header received
0809 13:03:07.069613 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:07.069619 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:07.069836 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:07.069965 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:07.071472 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:07.072614 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:07.073863 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:07.074439 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:07.074554 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:07.079045 (+ 4491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:07.079059 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:07.079074 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:07.079109 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:07.082170 (+ 3061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:07.082938 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:07.082946 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:07.082948 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:07.083078 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:07.083415 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:07.083418 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:07.083420 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:07.083788 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:07.084057 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:07.084368 (+ 311us) server_negotiation.cc:299] Negotiation successful
0809 13:03:07.084668 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":311,"threads_started":1}
I20260809 13:03:07.086570 3068 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:07.172848 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 2856
I20260809 13:03:07.200901 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 3085
Aug 09 13:03:07 dist-test-slave-jq4t krb5kdc[2459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.195@KRBTEST.COM
I20260809 13:03:07.218492 3326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:07.201935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47424 (local address 127.28.155.195:37859)
0809 13:03:07.202647 (+ 712us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:07.202655 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:07.202687 (+ 32us) server_negotiation.cc:407] Connection header received
0809 13:03:07.202753 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:07.202760 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:07.202988 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:07.203128 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:07.204437 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:07.205648 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:07.207038 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:07.207667 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:07.207779 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:07.212618 (+ 4839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:07.212634 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:07.212651 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:07.212698 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:07.215676 (+ 2978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:07.216426 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:07.216435 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:07.216437 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:07.216633 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:07.216974 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:07.216977 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:07.216979 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:07.217343 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:07.217595 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:07.217843 (+ 248us) server_negotiation.cc:299] Negotiation successful
0809 13:03:07.218072 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":343,"threads_started":1}
I20260809 13:03:07.219815 3298 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:07.305580 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 3085
I20260809 13:03:07.330866 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 2485
I20260809 13:03:07.332248 2572 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:07.448695 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 2485
2026-08-09T13:03:07Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4525 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:03:07 dist-test-slave-jq4t krb5kdc[3338](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:03:07 dist-test-slave-jq4t krb5kdc[3338](info): set up 2 sockets
Aug 09 13:03:07 dist-test-slave-jq4t krb5kdc[3338](info): commencing operation
krb5kdc: starting...
W20260809 13:03:08.791935 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.289s user 0.000s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:03:08 dist-test-slave-jq4t krb5kdc[3338](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280588, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:03:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:03:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
I20260809 13:03:09.044905 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:46437
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:36441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:46437
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:09.407600 3364 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:09.408004 3364 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:09.408180 3364 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:09.415812 3364 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:03:09.415992 3364 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:09.416126 3364 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:09.416236 3364 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:03:09.416326 3364 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:03:09.426671 3364 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:36441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:46437
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:46437
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:09.428167 3364 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:09.429714 3364 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:09.442607 3369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:09.442639 3373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:09.442607 3370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:09.443557 3364 server_base.cc:1034] running on GCE node
I20260809 13:03:09.444434 3364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:09.446058 3364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:09.447297 3364 hybrid_clock.cc:648] HybridClock initialized: now 1786280589447240 us; error 50 us; skew 500 ppm
I20260809 13:03:09.447688 3364 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:09 dist-test-slave-jq4t krb5kdc[3338](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280589, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:09.451212 3364 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:03:09.452574 3364 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:09.452718 3364 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:09.453097 3364 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:09.456346 3364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "43d177cbe1684dd29708a2732d4e3540"
format_stamp: "Formatted at 2026-08-09 13:03:09 on dist-test-slave-jq4t"
server_key: "fa63b055d02ef1db1bfec8023e3d5b7d"
server_key_iv: "8faecb5ff89d94fdcf57efcb0757354c"
server_key_version: "encryptionkey@0"
I20260809 13:03:09.457288 3364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "43d177cbe1684dd29708a2732d4e3540"
format_stamp: "Formatted at 2026-08-09 13:03:09 on dist-test-slave-jq4t"
server_key: "fa63b055d02ef1db1bfec8023e3d5b7d"
server_key_iv: "8faecb5ff89d94fdcf57efcb0757354c"
server_key_version: "encryptionkey@0"
I20260809 13:03:09.462679 3364 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 13:03:09.466465 3389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:09.467869 3364 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 13:03:09.468086 3364 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "43d177cbe1684dd29708a2732d4e3540"
format_stamp: "Formatted at 2026-08-09 13:03:09 on dist-test-slave-jq4t"
server_key: "fa63b055d02ef1db1bfec8023e3d5b7d"
server_key_iv: "8faecb5ff89d94fdcf57efcb0757354c"
server_key_version: "encryptionkey@0"
I20260809 13:03:09.468346 3364 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:09.486009 3364 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:09.490659 3364 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:09.490993 3364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:09.511721 3364 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:46437
I20260809 13:03:09.511761 3476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:46437 every 8 connection(s)
I20260809 13:03:09.512908 3364 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:03:09.517030 3477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:09.520785 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 3364
I20260809 13:03:09.521051 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:03:09.521908 29295 external_mini_cluster.cc:1428] Setting key d0499a7ffa04dbf131d4e22814177157
I20260809 13:03:09.531687 3477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43d177cbe1684dd29708a2732d4e3540: Bootstrap starting.
I20260809 13:03:09.536015 3477 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 43d177cbe1684dd29708a2732d4e3540: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:09.537598 3477 log.cc:824] T 00000000000000000000000000000000 P 43d177cbe1684dd29708a2732d4e3540: Log is configured to *not* fsync() on all Append() calls
Aug 09 13:03:09 dist-test-slave-jq4t krb5kdc[3338](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280588, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:03:09.541028 3477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43d177cbe1684dd29708a2732d4e3540: No bootstrap required, opened a new log
I20260809 13:03:09.547927 3482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:09.524272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58950 (local address 127.28.155.254:46437)
0809 13:03:09.525235 (+ 963us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:09.525248 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:09.525293 (+ 45us) server_negotiation.cc:407] Connection header received
0809 13:03:09.527036 (+ 1743us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:09.527062 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:09.527533 (+ 471us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:09.527897 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:09.529959 (+ 2062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:09.531336 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:09.533254 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:09.534011 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:09.534164 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:09.539593 (+ 5429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:09.539602 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:09.539619 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:09.539665 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:09.543074 (+ 3409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:09.543943 (+ 869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:09.543951 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:09.543957 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:09.544158 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:09.544679 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:09.544685 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:09.544688 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:09.545316 (+ 628us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:09.545722 (+ 406us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:09.546243 (+ 521us) server_negotiation.cc:299] Negotiation successful
0809 13:03:09.546779 (+ 536us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":739,"thread_start_us":499,"threads_started":1}
I20260809 13:03:09.549971 3477 raft_consensus.cc:348] T 00000000000000000000000000000000 P 43d177cbe1684dd29708a2732d4e3540 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43d177cbe1684dd29708a2732d4e3540" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46437 } }
I20260809 13:03:09.550443 3477 raft_consensus.cc:374] T 00000000000000000000000000000000 P 43d177cbe1684dd29708a2732d4e3540 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:09.550576 3477 raft_consensus.cc:729] T 00000000000000000000000000000000 P 43d177cbe1684dd29708a2732d4e3540 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43d177cbe1684dd29708a2732d4e3540, State: Initialized, Role: FOLLOWER
I20260809 13:03:09.551326 3477 consensus_queue.cc:260] T 00000000000000000000000000000000 P 43d177cbe1684dd29708a2732d4e3540 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43d177cbe1684dd29708a2732d4e3540" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46437 } }
I20260809 13:03:09.551636 3477 raft_consensus.cc:388] T 00000000000000000000000000000000 P 43d177cbe1684dd29708a2732d4e3540 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:03:09.551803 3477 raft_consensus.cc:482] T 00000000000000000000000000000000 P 43d177cbe1684dd29708a2732d4e3540 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:03:09.552001 3477 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 43d177cbe1684dd29708a2732d4e3540 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:09.554543 3477 raft_consensus.cc:504] T 00000000000000000000000000000000 P 43d177cbe1684dd29708a2732d4e3540 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43d177cbe1684dd29708a2732d4e3540" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46437 } }
I20260809 13:03:09.555121 3477 leader_election.cc:302] T 00000000000000000000000000000000 P 43d177cbe1684dd29708a2732d4e3540 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 43d177cbe1684dd29708a2732d4e3540; no voters:
I20260809 13:03:09.555905 3477 leader_election.cc:288] T 00000000000000000000000000000000 P 43d177cbe1684dd29708a2732d4e3540 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:03:09.556025 3487 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 43d177cbe1684dd29708a2732d4e3540 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:03:09.556813 3487 raft_consensus.cc:686] T 00000000000000000000000000000000 P 43d177cbe1684dd29708a2732d4e3540 [term 1 LEADER]: Becoming Leader. State: Replica: 43d177cbe1684dd29708a2732d4e3540, State: Running, Role: LEADER
I20260809 13:03:09.557439 3487 consensus_queue.cc:237] T 00000000000000000000000000000000 P 43d177cbe1684dd29708a2732d4e3540 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43d177cbe1684dd29708a2732d4e3540" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46437 } }
I20260809 13:03:09.558609 3477 sys_catalog.cc:564] T 00000000000000000000000000000000 P 43d177cbe1684dd29708a2732d4e3540 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:03:09.566213 3490 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43d177cbe1684dd29708a2732d4e3540 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 43d177cbe1684dd29708a2732d4e3540. Latest consensus state: current_term: 1 leader_uuid: "43d177cbe1684dd29708a2732d4e3540" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43d177cbe1684dd29708a2732d4e3540" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46437 } } }
I20260809 13:03:09.566689 3490 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43d177cbe1684dd29708a2732d4e3540 [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:09.567873 3488 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43d177cbe1684dd29708a2732d4e3540 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "43d177cbe1684dd29708a2732d4e3540" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43d177cbe1684dd29708a2732d4e3540" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46437 } } }
I20260809 13:03:09.568218 3488 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43d177cbe1684dd29708a2732d4e3540 [sys.catalog]: This master's current role is: LEADER
W20260809 13:03:09.571569 3513 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 43d177cbe1684dd29708a2732d4e3540: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 13:03:09.571694 3513 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 13:03:09.571873 3514 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:03:09.574013 3514 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:03:09.582573 3514 catalog_manager.cc:1347] Generated new cluster ID: 52a2d8abd99846489d0be3296620934b
I20260809 13:03:09.582726 3514 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:03:09.604923 3514 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:03:09.606339 3514 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:03:09.620678 3514 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 43d177cbe1684dd29708a2732d4e3540: Generated new TSK 0
I20260809 13:03:09.621857 3514 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
I20260809 13:03:09.692565 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:0
--local_ip_for_outbound_sockets=127.28.155.193
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:46437
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:36441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:10.050280 3525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:10.050603 3525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:10.050779 3525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:10.061110 3525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:10.061304 3525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:10.061537 3525 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:03:10.073756 3525 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:36441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:46437
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:10.075116 3525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:10.076467 3525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:10.090365 3539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:10.090318 3536 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:10.090610 3534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:10.091480 3525 server_base.cc:1034] running on GCE node
I20260809 13:03:10.092154 3525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:10.093387 3525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:10.094686 3525 hybrid_clock.cc:648] HybridClock initialized: now 1786280590094611 us; error 64 us; skew 500 ppm
I20260809 13:03:10.095093 3525 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:10 dist-test-slave-jq4t krb5kdc[3338](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280590, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:10.098587 3525 init.cc:377] Logged in from keytab as kudu/127.28.155.193@KRBTEST.COM (short username kudu)
I20260809 13:03:10.099783 3525 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:10.099879 3525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:10.100172 3525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:10.103323 3525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-0/data/instance:
uuid: "30be8113344e4efd9b2082b777571694"
format_stamp: "Formatted at 2026-08-09 13:03:10 on dist-test-slave-jq4t"
server_key: "a7f4919eb294e4526dde9cb5aff14d1e"
server_key_iv: "c4405e821f010645cd6e396a87e823ae"
server_key_version: "encryptionkey@0"
I20260809 13:03:10.104141 3525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance:
uuid: "30be8113344e4efd9b2082b777571694"
format_stamp: "Formatted at 2026-08-09 13:03:10 on dist-test-slave-jq4t"
server_key: "a7f4919eb294e4526dde9cb5aff14d1e"
server_key_iv: "c4405e821f010645cd6e396a87e823ae"
server_key_version: "encryptionkey@0"
I20260809 13:03:10.109509 3525 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 13:03:10.113163 3549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:10.114528 3525 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:03:10.114675 3525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "30be8113344e4efd9b2082b777571694"
format_stamp: "Formatted at 2026-08-09 13:03:10 on dist-test-slave-jq4t"
server_key: "a7f4919eb294e4526dde9cb5aff14d1e"
server_key_iv: "c4405e821f010645cd6e396a87e823ae"
server_key_version: "encryptionkey@0"
I20260809 13:03:10.114869 3525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:10.142743 3525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:10.147053 3525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:10.147308 3525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:10.148291 3525 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:03:10.149756 3525 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:03:10.149847 3525 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:10.149932 3525 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:03:10.149983 3525 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:10.185833 3525 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:45921
I20260809 13:03:10.185902 3745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:45921 every 8 connection(s)
I20260809 13:03:10.186828 3525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:03:10.189565 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 3525
I20260809 13:03:10.189811 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance
I20260809 13:03:10.190723 29295 external_mini_cluster.cc:1428] Setting key 8ddebbb498bece7847f4b69f85db6734
Aug 09 13:03:10 dist-test-slave-jq4t krb5kdc[3338](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280590, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:03:10.211947 3752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:10.189638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:41969 (local address 127.28.155.254:46437)
0809 13:03:10.190224 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:10.190228 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:10.191384 (+ 1156us) server_negotiation.cc:407] Connection header received
0809 13:03:10.193916 (+ 2532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:10.193921 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:10.194002 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:10.194098 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:10.196471 (+ 2373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:10.197291 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:10.200000 (+ 2709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:10.200411 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:10.200612 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:10.205488 (+ 4876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:10.205495 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:10.205499 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:10.205537 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:10.208562 (+ 3025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:10.209406 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:10.209412 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:10.209416 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:10.209558 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:10.210036 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:10.210041 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:10.210046 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:10.210354 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:10.210516 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:10.211311 (+ 795us) server_negotiation.cc:299] Negotiation successful
0809 13:03:10.211566 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":307,"threads_started":1}
I20260809 13:03:10.213193 3754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:10.190304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:46437 (local address 127.28.155.193:41969)
0809 13:03:10.191200 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:10.191246 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:10.193584 (+ 2338us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:10.194400 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:10.194426 (+ 26us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:10.195326 (+ 900us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:10.196265 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:10.196296 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:10.197485 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:10.197494 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:10.199756 (+ 2262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:10.199777 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:10.200770 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:10.200780 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:10.201148 (+ 368us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:10.202089 (+ 941us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:10.202127 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:10.205207 (+ 3080us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:10.208749 (+ 3542us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:10.208757 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:10.208773 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:10.209257 (+ 484us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:10.209697 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:10.209701 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:10.209703 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:10.209904 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:10.210511 (+ 607us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:10.210519 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:10.210913 (+ 394us) client_negotiation.cc:769] Sending connection context
0809 13:03:10.211201 (+ 288us) client_negotiation.cc:240] Negotiation successful
0809 13:03:10.211803 (+ 602us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":639,"thread_start_us":410,"threads_started":1}
I20260809 13:03:10.215137 3747 heartbeater.cc:347] Connected to a master server at 127.28.155.254:46437
I20260809 13:03:10.215459 3747 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:10.216161 3747 heartbeater.cc:511] Master 127.28.155.254:46437 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.28.155.194@KRBTEST.COM; defaulting to no policy
I20260809 13:03:10.218567 3413 ts_manager.cc:194] Registered new tserver with Master: 30be8113344e4efd9b2082b777571694 (127.28.155.193:45921)
I20260809 13:03:10.220082 3413 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.193@KRBTEST.COM'} at 127.28.155.193:41969
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
I20260809 13:03:10.249912 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:0
--local_ip_for_outbound_sockets=127.28.155.194
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:46437
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:36441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:10.611500 3759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:10.611858 3759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:10.612052 3759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:10.619611 3759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:10.619763 3759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:10.619943 3759 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:03:10.629952 3759 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:36441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:46437
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:10.631414 3759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:10.632884 3759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:10.646211 3766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:10.646256 3771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:10.646302 3769 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:10.647469 3759 server_base.cc:1034] running on GCE node
I20260809 13:03:10.648104 3759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:10.649116 3759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:10.650324 3759 hybrid_clock.cc:648] HybridClock initialized: now 1786280590650288 us; error 32 us; skew 500 ppm
I20260809 13:03:10.650776 3759 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:10 dist-test-slave-jq4t krb5kdc[3338](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280590, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:10.654086 3759 init.cc:377] Logged in from keytab as kudu/127.28.155.194@KRBTEST.COM (short username kudu)
I20260809 13:03:10.655323 3759 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:10.655448 3759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:10.655802 3759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:10.659003 3759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-1/data/instance:
uuid: "b1d1fc78c4354c2587f72a7d6f48dabd"
format_stamp: "Formatted at 2026-08-09 13:03:10 on dist-test-slave-jq4t"
server_key: "16fa3de3bad3c9668e9d36fb685efc48"
server_key_iv: "8f1509fe283b00ee092ecb8f15204794"
server_key_version: "encryptionkey@0"
I20260809 13:03:10.659907 3759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance:
uuid: "b1d1fc78c4354c2587f72a7d6f48dabd"
format_stamp: "Formatted at 2026-08-09 13:03:10 on dist-test-slave-jq4t"
server_key: "16fa3de3bad3c9668e9d36fb685efc48"
server_key_iv: "8f1509fe283b00ee092ecb8f15204794"
server_key_version: "encryptionkey@0"
I20260809 13:03:10.665205 3759 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260809 13:03:10.668754 3777 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:10.670195 3759 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 13:03:10.670392 3759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "b1d1fc78c4354c2587f72a7d6f48dabd"
format_stamp: "Formatted at 2026-08-09 13:03:10 on dist-test-slave-jq4t"
server_key: "16fa3de3bad3c9668e9d36fb685efc48"
server_key_iv: "8f1509fe283b00ee092ecb8f15204794"
server_key_version: "encryptionkey@0"
I20260809 13:03:10.670647 3759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:10.688894 3759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:10.693143 3759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:10.693447 3759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:10.694469 3759 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:03:10.695951 3759 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:03:10.696079 3759 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:10.696224 3759 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:03:10.696317 3759 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:10.731825 3759 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:45969
I20260809 13:03:10.731885 3977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:45969 every 8 connection(s)
I20260809 13:03:10.732865 3759 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:03:10.740760 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 3759
I20260809 13:03:10.740998 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance
I20260809 13:03:10.741458 29295 external_mini_cluster.cc:1428] Setting key 3cd017c990f9e34ca4b71cd14274d662
Aug 09 13:03:10 dist-test-slave-jq4t krb5kdc[3338](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280590, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:03:10.754818 3981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:10.735399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:33569 (local address 127.28.155.254:46437)
0809 13:03:10.735894 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:10.735901 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:10.736884 (+ 983us) server_negotiation.cc:407] Connection header received
0809 13:03:10.738666 (+ 1782us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:10.738671 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:10.738752 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:10.738850 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:10.740598 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:10.741576 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:10.743629 (+ 2053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:10.744124 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:10.744226 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:10.748667 (+ 4441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:10.748673 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:10.748676 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:10.748710 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:10.751472 (+ 2762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:10.752296 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:10.752300 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:10.752303 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:10.752431 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:10.752958 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:10.752963 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:10.752973 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:10.753254 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:10.753425 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:10.754182 (+ 757us) server_negotiation.cc:299] Negotiation successful
0809 13:03:10.754422 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":223,"threads_started":1}
I20260809 13:03:10.755805 3982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:10.735922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:46437 (local address 127.28.155.194:33569)
0809 13:03:10.736711 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:10.736755 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:10.738406 (+ 1651us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:10.739056 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:10.739064 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:10.739588 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:10.740341 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:10.740372 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:10.741748 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:10.741753 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:10.743472 (+ 1719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:10.743485 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:10.744469 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:10.744503 (+ 34us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:10.744828 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:10.745590 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:10.745626 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:10.748400 (+ 2774us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:10.751649 (+ 3249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:10.751658 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:10.751674 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:10.752150 (+ 476us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:10.752622 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:10.752627 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:10.752631 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:10.752827 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:10.753403 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:10.753411 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:10.753776 (+ 365us) client_negotiation.cc:769] Sending connection context
0809 13:03:10.754061 (+ 285us) client_negotiation.cc:240] Negotiation successful
0809 13:03:10.754629 (+ 568us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":290,"threads_started":1}
I20260809 13:03:10.757500 3978 heartbeater.cc:347] Connected to a master server at 127.28.155.254:46437
I20260809 13:03:10.757825 3978 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:10.758530 3978 heartbeater.cc:511] Master 127.28.155.254:46437 requested a full tablet report, sending...
I20260809 13:03:10.760211 3413 ts_manager.cc:194] Registered new tserver with Master: b1d1fc78c4354c2587f72a7d6f48dabd (127.28.155.194:45969)
I20260809 13:03:10.761677 3413 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.194@KRBTEST.COM'} at 127.28.155.194:33569
WARNING: no policy specified for kudu/127.28.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
I20260809 13:03:10.799597 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:0
--local_ip_for_outbound_sockets=127.28.155.195
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:46437
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:36441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:11.150672 3989 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:11.150985 3989 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:11.151160 3989 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:11.158613 3989 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:11.158746 3989 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:11.158933 3989 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:03:11.168926 3989 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:36441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:46437
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:11.170377 3989 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:11.171876 3989 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:11.185096 4000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:11.185320 4004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:11.185871 3998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:11.186352 3989 server_base.cc:1034] running on GCE node
I20260809 13:03:11.187002 3989 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:11.188055 3989 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:11.189282 3989 hybrid_clock.cc:648] HybridClock initialized: now 1786280591189214 us; error 62 us; skew 500 ppm
I20260809 13:03:11.189643 3989 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:11 dist-test-slave-jq4t krb5kdc[3338](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280591, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:11.193059 3989 init.cc:377] Logged in from keytab as kudu/127.28.155.195@KRBTEST.COM (short username kudu)
I20260809 13:03:11.194319 3989 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:11.194417 3989 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:11.194700 3989 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:11.197907 3989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-2/data/instance:
uuid: "f19cafeb1f014ddc852eda66f87552d2"
format_stamp: "Formatted at 2026-08-09 13:03:11 on dist-test-slave-jq4t"
server_key: "e4041c4077dee1a11cd439c53cd05056"
server_key_iv: "f41f80a14264e2481f3a25f0b9a8af51"
server_key_version: "encryptionkey@0"
I20260809 13:03:11.198727 3989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance:
uuid: "f19cafeb1f014ddc852eda66f87552d2"
format_stamp: "Formatted at 2026-08-09 13:03:11 on dist-test-slave-jq4t"
server_key: "e4041c4077dee1a11cd439c53cd05056"
server_key_iv: "f41f80a14264e2481f3a25f0b9a8af51"
server_key_version: "encryptionkey@0"
I20260809 13:03:11.204088 3989 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260809 13:03:11.207846 4016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:11.209426 3989 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:03:11.209635 3989 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "f19cafeb1f014ddc852eda66f87552d2"
format_stamp: "Formatted at 2026-08-09 13:03:11 on dist-test-slave-jq4t"
server_key: "e4041c4077dee1a11cd439c53cd05056"
server_key_iv: "f41f80a14264e2481f3a25f0b9a8af51"
server_key_version: "encryptionkey@0"
I20260809 13:03:11.209892 3989 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:11.224261 3747 heartbeater.cc:503] Master 127.28.155.254:46437 was elected leader, sending a full tablet report...
I20260809 13:03:11.238582 3989 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:11.242934 3989 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:11.243181 3989 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:11.244210 3989 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:03:11.245664 3989 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:03:11.245756 3989 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:11.245850 3989 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:03:11.245903 3989 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:11.282680 3989 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:34445
I20260809 13:03:11.282776 4210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:34445 every 8 connection(s)
I20260809 13:03:11.283619 3989 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:03:11.284986 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 3989
I20260809 13:03:11.285202 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance
I20260809 13:03:11.285719 29295 external_mini_cluster.cc:1428] Setting key ce2e366a5df4cb8b36fe13ef16fa7a7c
Aug 09 13:03:11 dist-test-slave-jq4t krb5kdc[3338](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280591, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:03:11.304625 4214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:11.286434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:41059 (local address 127.28.155.254:46437)
0809 13:03:11.287005 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:11.287012 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:11.288125 (+ 1113us) server_negotiation.cc:407] Connection header received
0809 13:03:11.290094 (+ 1969us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:11.290098 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:11.290192 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:11.290283 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:11.291821 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:11.292713 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:11.294307 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:11.294735 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:11.294840 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:11.298503 (+ 3663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:11.298508 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:11.298511 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:11.298556 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:11.301441 (+ 2885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:11.302223 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:11.302229 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:11.302234 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:11.302365 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:11.302800 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:11.302806 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:11.302809 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:11.303092 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:11.303260 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:11.303964 (+ 704us) server_negotiation.cc:299] Negotiation successful
0809 13:03:11.304190 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":284,"threads_started":1}
I20260809 13:03:11.305653 4216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:11.287092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:46437 (local address 127.28.155.195:41059)
0809 13:03:11.287939 (+ 847us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:11.287993 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:11.289845 (+ 1852us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:11.290504 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:11.290512 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:11.291080 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:11.291654 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:11.291670 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:11.292856 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:11.292860 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:11.294156 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:11.294168 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:11.294933 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:11.294937 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:11.295145 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:11.295874 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:11.295898 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:11.298306 (+ 2408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:11.301608 (+ 3302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:11.301617 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:11.301634 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:11.302090 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:11.302479 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:11.302484 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:11.302488 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:11.302687 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:11.303233 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:11.303241 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:11.303593 (+ 352us) client_negotiation.cc:769] Sending connection context
0809 13:03:11.303860 (+ 267us) client_negotiation.cc:240] Negotiation successful
0809 13:03:11.304424 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":356,"threads_started":1}
I20260809 13:03:11.307051 4211 heartbeater.cc:347] Connected to a master server at 127.28.155.254:46437
I20260809 13:03:11.307359 4211 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:11.308020 4211 heartbeater.cc:511] Master 127.28.155.254:46437 requested a full tablet report, sending...
I20260809 13:03:11.309624 3413 ts_manager.cc:194] Registered new tserver with Master: f19cafeb1f014ddc852eda66f87552d2 (127.28.155.195:34445)
I20260809 13:03:11.310446 3413 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.195@KRBTEST.COM'} at 127.28.155.195:41059
I20260809 13:03:11.314168 29295 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 13:03:11.331566 4214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:11.318870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58960 (local address 127.28.155.254:46437)
0809 13:03:11.319049 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:11.319054 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:11.319741 (+ 687us) server_negotiation.cc:407] Connection header received
0809 13:03:11.319835 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:11.319839 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:11.319932 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:11.320021 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:11.321609 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:11.322370 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:11.323599 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:11.324008 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:11.324109 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:11.326420 (+ 2311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:11.326425 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:11.326428 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:11.326467 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:11.329220 (+ 2753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:11.329830 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:11.329834 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:11.329837 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:11.329998 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:11.330318 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:11.330321 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:11.330323 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:11.330653 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:11.330898 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:11.331152 (+ 254us) server_negotiation.cc:299] Negotiation successful
0809 13:03:11.331326 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 13:03:11.335736 3413 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58960:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 13:03:11.342756 3413 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:03:11.369477 4244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:11.354912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:45921 (local address 127.0.0.1:43998)
0809 13:03:11.356957 (+ 2045us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:11.357021 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:11.357232 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:11.360811 (+ 3579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:11.360824 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:11.360873 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:03:11.362015 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:11.362026 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:11.364538 (+ 2512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:11.364544 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:11.366111 (+ 1567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:11.366129 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:11.368582 (+ 2453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:11.368589 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:11.368774 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:11.368806 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 13:03:11.368934 (+ 128us) client_negotiation.cc:240] Negotiation successful
0809 13:03:11.369078 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1706,"thread_start_us":2666,"threads_started":1}
I20260809 13:03:11.369518 4245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:11.356258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55386 (local address 127.28.155.194:45969)
0809 13:03:11.360264 (+ 4006us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:11.360275 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:11.360311 (+ 36us) server_negotiation.cc:407] Connection header received
0809 13:03:11.360445 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:11.360455 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:11.360697 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:11.360947 (+ 250us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:03:11.361684 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:11.363801 (+ 2117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:11.366853 (+ 3052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:11.368017 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:11.368211 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:11.368405 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:11.369004 (+ 599us) server_negotiation.cc:299] Negotiation successful
0809 13:03:11.369182 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3841,"thread_start_us":3711,"threads_started":1}
I20260809 13:03:11.369719 4239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:11.354980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43998 (local address 127.28.155.193:45921)
0809 13:03:11.359936 (+ 4956us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:11.359948 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:11.359983 (+ 35us) server_negotiation.cc:407] Connection header received
0809 13:03:11.360180 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:11.360192 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:11.360497 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:11.361092 (+ 595us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:03:11.362260 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:11.364383 (+ 2123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:11.366365 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:11.368304 (+ 1939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:11.368681 (+ 377us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:11.368859 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:11.369202 (+ 343us) server_negotiation.cc:299] Negotiation successful
0809 13:03:11.369391 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4720,"thread_start_us":4538,"threads_started":1}
I20260809 13:03:11.370425 4243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:11.355486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:45969 (local address 127.0.0.1:55386)
0809 13:03:11.357852 (+ 2366us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:11.357872 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:11.357988 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:11.361056 (+ 3068us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:11.361061 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:11.361090 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:03:11.361439 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:11.361449 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:11.363941 (+ 2492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:11.363947 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:11.366689 (+ 2742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:11.366704 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:11.368232 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:11.368239 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:11.368451 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:11.368540 (+ 89us) client_negotiation.cc:769] Sending connection context
0809 13:03:11.368686 (+ 146us) client_negotiation.cc:240] Negotiation successful
0809 13:03:11.368902 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2237,"mutex_wait_us":1,"thread_start_us":1036,"threads_started":1}
I20260809 13:03:11.371379 4251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:11.358968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:34445 (local address 127.0.0.1:33232)
0809 13:03:11.362951 (+ 3983us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:11.362973 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:11.363098 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:11.363661 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:11.363666 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:11.363692 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:03:11.364111 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:11.364122 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:11.366169 (+ 2047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:11.366174 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:11.368330 (+ 2156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:11.368344 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:11.370572 (+ 2228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:11.370578 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:11.370748 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:11.370793 (+ 45us) client_negotiation.cc:769] Sending connection context
0809 13:03:11.370921 (+ 128us) client_negotiation.cc:240] Negotiation successful
0809 13:03:11.371058 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3836,"thread_start_us":3664,"threads_started":1}
I20260809 13:03:11.372527 4246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:11.358340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33232 (local address 127.28.155.195:34445)
0809 13:03:11.360731 (+ 2391us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:11.360741 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:11.363094 (+ 2353us) server_negotiation.cc:407] Connection header received
0809 13:03:11.363235 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:11.363243 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:11.363453 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:11.363638 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:03:11.364372 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:11.366006 (+ 1634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:11.368553 (+ 2547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:11.370030 (+ 1477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:11.370231 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:11.370407 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:11.370994 (+ 587us) server_negotiation.cc:299] Negotiation successful
0809 13:03:11.371208 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2220,"thread_start_us":2032,"threads_started":1}
I20260809 13:03:11.374488 3861 tablet_service.cc:1467] Processing CreateTablet for tablet c5efb4a342f74920b3fa9447f58ed962 (DEFAULT_TABLE table=test-table [id=d6ca659e856546c3a0da8742517c0ee0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:03:11.374488 3628 tablet_service.cc:1467] Processing CreateTablet for tablet c5efb4a342f74920b3fa9447f58ed962 (DEFAULT_TABLE table=test-table [id=d6ca659e856546c3a0da8742517c0ee0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:03:11.376104 3628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5efb4a342f74920b3fa9447f58ed962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:11.376127 3861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5efb4a342f74920b3fa9447f58ed962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:11.375984 4107 tablet_service.cc:1467] Processing CreateTablet for tablet c5efb4a342f74920b3fa9447f58ed962 (DEFAULT_TABLE table=test-table [id=d6ca659e856546c3a0da8742517c0ee0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:03:11.377224 4107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5efb4a342f74920b3fa9447f58ed962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:11.396970 4253 tablet_bootstrap.cc:492] T c5efb4a342f74920b3fa9447f58ed962 P b1d1fc78c4354c2587f72a7d6f48dabd: Bootstrap starting.
I20260809 13:03:11.401870 4253 tablet_bootstrap.cc:654] T c5efb4a342f74920b3fa9447f58ed962 P b1d1fc78c4354c2587f72a7d6f48dabd: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:11.403187 4254 tablet_bootstrap.cc:492] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694: Bootstrap starting.
I20260809 13:03:11.406213 4255 tablet_bootstrap.cc:492] T c5efb4a342f74920b3fa9447f58ed962 P f19cafeb1f014ddc852eda66f87552d2: Bootstrap starting.
I20260809 13:03:11.408365 4253 log.cc:824] T c5efb4a342f74920b3fa9447f58ed962 P b1d1fc78c4354c2587f72a7d6f48dabd: Log is configured to *not* fsync() on all Append() calls
I20260809 13:03:11.408757 4254 tablet_bootstrap.cc:654] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:11.410157 4254 log.cc:824] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694: Log is configured to *not* fsync() on all Append() calls
I20260809 13:03:11.410940 4255 tablet_bootstrap.cc:654] T c5efb4a342f74920b3fa9447f58ed962 P f19cafeb1f014ddc852eda66f87552d2: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:11.411942 4253 tablet_bootstrap.cc:492] T c5efb4a342f74920b3fa9447f58ed962 P b1d1fc78c4354c2587f72a7d6f48dabd: No bootstrap required, opened a new log
I20260809 13:03:11.412266 4253 ts_tablet_manager.cc:1397] T c5efb4a342f74920b3fa9447f58ed962 P b1d1fc78c4354c2587f72a7d6f48dabd: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.003s
I20260809 13:03:11.412220 4255 log.cc:824] T c5efb4a342f74920b3fa9447f58ed962 P f19cafeb1f014ddc852eda66f87552d2: Log is configured to *not* fsync() on all Append() calls
I20260809 13:03:11.413744 4254 tablet_bootstrap.cc:492] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694: No bootstrap required, opened a new log
I20260809 13:03:11.414142 4254 ts_tablet_manager.cc:1397] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.004s
I20260809 13:03:11.415833 4255 tablet_bootstrap.cc:492] T c5efb4a342f74920b3fa9447f58ed962 P f19cafeb1f014ddc852eda66f87552d2: No bootstrap required, opened a new log
I20260809 13:03:11.416141 4255 ts_tablet_manager.cc:1397] T c5efb4a342f74920b3fa9447f58ed962 P f19cafeb1f014ddc852eda66f87552d2: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260809 13:03:11.422016 4253 raft_consensus.cc:348] T c5efb4a342f74920b3fa9447f58ed962 P b1d1fc78c4354c2587f72a7d6f48dabd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30be8113344e4efd9b2082b777571694" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45921 } } peers { permanent_uuid: "f19cafeb1f014ddc852eda66f87552d2" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 34445 } } peers { permanent_uuid: "b1d1fc78c4354c2587f72a7d6f48dabd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 45969 } }
I20260809 13:03:11.422477 4253 raft_consensus.cc:374] T c5efb4a342f74920b3fa9447f58ed962 P b1d1fc78c4354c2587f72a7d6f48dabd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:11.422582 4253 raft_consensus.cc:729] T c5efb4a342f74920b3fa9447f58ed962 P b1d1fc78c4354c2587f72a7d6f48dabd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1d1fc78c4354c2587f72a7d6f48dabd, State: Initialized, Role: FOLLOWER
I20260809 13:03:11.423283 4253 consensus_queue.cc:260] T c5efb4a342f74920b3fa9447f58ed962 P b1d1fc78c4354c2587f72a7d6f48dabd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30be8113344e4efd9b2082b777571694" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45921 } } peers { permanent_uuid: "f19cafeb1f014ddc852eda66f87552d2" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 34445 } } peers { permanent_uuid: "b1d1fc78c4354c2587f72a7d6f48dabd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 45969 } }
I20260809 13:03:11.424629 3978 heartbeater.cc:503] Master 127.28.155.254:46437 was elected leader, sending a full tablet report...
I20260809 13:03:11.425228 4253 ts_tablet_manager.cc:1428] T c5efb4a342f74920b3fa9447f58ed962 P b1d1fc78c4354c2587f72a7d6f48dabd: Time spent starting tablet: real 0.013s user 0.012s sys 0.002s
I20260809 13:03:11.427408 4254 raft_consensus.cc:348] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30be8113344e4efd9b2082b777571694" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45921 } } peers { permanent_uuid: "f19cafeb1f014ddc852eda66f87552d2" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 34445 } } peers { permanent_uuid: "b1d1fc78c4354c2587f72a7d6f48dabd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 45969 } }
I20260809 13:03:11.427402 4255 raft_consensus.cc:348] T c5efb4a342f74920b3fa9447f58ed962 P f19cafeb1f014ddc852eda66f87552d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30be8113344e4efd9b2082b777571694" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45921 } } peers { permanent_uuid: "f19cafeb1f014ddc852eda66f87552d2" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 34445 } } peers { permanent_uuid: "b1d1fc78c4354c2587f72a7d6f48dabd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 45969 } }
I20260809 13:03:11.427902 4254 raft_consensus.cc:374] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:11.427902 4255 raft_consensus.cc:374] T c5efb4a342f74920b3fa9447f58ed962 P f19cafeb1f014ddc852eda66f87552d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:11.428023 4254 raft_consensus.cc:729] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30be8113344e4efd9b2082b777571694, State: Initialized, Role: FOLLOWER
I20260809 13:03:11.428017 4255 raft_consensus.cc:729] T c5efb4a342f74920b3fa9447f58ed962 P f19cafeb1f014ddc852eda66f87552d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f19cafeb1f014ddc852eda66f87552d2, State: Initialized, Role: FOLLOWER
I20260809 13:03:11.428720 4254 consensus_queue.cc:260] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30be8113344e4efd9b2082b777571694" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45921 } } peers { permanent_uuid: "f19cafeb1f014ddc852eda66f87552d2" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 34445 } } peers { permanent_uuid: "b1d1fc78c4354c2587f72a7d6f48dabd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 45969 } }
I20260809 13:03:11.428723 4255 consensus_queue.cc:260] T c5efb4a342f74920b3fa9447f58ed962 P f19cafeb1f014ddc852eda66f87552d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30be8113344e4efd9b2082b777571694" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45921 } } peers { permanent_uuid: "f19cafeb1f014ddc852eda66f87552d2" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 34445 } } peers { permanent_uuid: "b1d1fc78c4354c2587f72a7d6f48dabd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 45969 } }
I20260809 13:03:11.440992 4254 ts_tablet_manager.cc:1428] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694: Time spent starting tablet: real 0.027s user 0.015s sys 0.006s
I20260809 13:03:11.443092 4211 heartbeater.cc:503] Master 127.28.155.254:46437 was elected leader, sending a full tablet report...
I20260809 13:03:11.443782 4255 ts_tablet_manager.cc:1428] T c5efb4a342f74920b3fa9447f58ed962 P f19cafeb1f014ddc852eda66f87552d2: Time spent starting tablet: real 0.028s user 0.015s sys 0.011s
W20260809 13:03:11.485107 3980 tablet.cc:2369] T c5efb4a342f74920b3fa9447f58ed962 P b1d1fc78c4354c2587f72a7d6f48dabd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 13:03:11.535398 4212 tablet.cc:2369] T c5efb4a342f74920b3fa9447f58ed962 P f19cafeb1f014ddc852eda66f87552d2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 13:03:11.689498 3748 tablet.cc:2369] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:03:11.767920 4264 raft_consensus.cc:482] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:03:11.768308 4264 raft_consensus.cc:504] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30be8113344e4efd9b2082b777571694" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45921 } } peers { permanent_uuid: "f19cafeb1f014ddc852eda66f87552d2" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 34445 } } peers { permanent_uuid: "b1d1fc78c4354c2587f72a7d6f48dabd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 45969 } }
I20260809 13:03:11.770255 4264 leader_election.cc:288] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f19cafeb1f014ddc852eda66f87552d2 (127.28.155.195:34445), b1d1fc78c4354c2587f72a7d6f48dabd (127.28.155.194:45969)
I20260809 13:03:11.777961 4246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:11.770778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:58095 (local address 127.28.155.195:34445)
0809 13:03:11.771079 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:11.771089 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:11.771976 (+ 887us) server_negotiation.cc:407] Connection header received
0809 13:03:11.772200 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:11.772208 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:11.772302 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:11.772373 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:03:11.773184 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:11.773956 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:11.776008 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:11.776896 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:11.777101 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:11.777187 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:11.777498 (+ 311us) server_negotiation.cc:299] Negotiation successful
0809 13:03:11.777642 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260809 13:03:11.778101 4245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:11.770895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:59191 (local address 127.28.155.194:45969)
0809 13:03:11.771152 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:11.771161 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:11.772060 (+ 899us) server_negotiation.cc:407] Connection header received
0809 13:03:11.772308 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:11.772312 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:11.772409 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:11.772535 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:03:11.773323 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:11.774109 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:11.776156 (+ 2047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:11.776999 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:11.777184 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:11.777268 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:11.777651 (+ 383us) server_negotiation.cc:299] Negotiation successful
0809 13:03:11.777795 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260809 13:03:11.778282 4269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:11.770759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:45969 (local address 127.28.155.193:59191)
0809 13:03:11.771958 (+ 1199us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:11.771979 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:11.772155 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:11.772554 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:11.772562 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:11.772624 (+ 62us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:03:11.773129 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:11.773143 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:11.774266 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:11.774272 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:11.775989 (+ 1717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:11.776010 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:11.777238 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:11.777245 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:11.777416 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:11.777439 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 13:03:11.777614 (+ 175us) client_negotiation.cc:240] Negotiation successful
0809 13:03:11.777774 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1051,"mutex_wait_us":1,"spinlock_wait_cycles":1792,"thread_start_us":514,"threads_started":1}
I20260809 13:03:11.778577 4270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:11.770642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:34445 (local address 127.28.155.193:58095)
0809 13:03:11.771832 (+ 1190us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:11.771848 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:11.772044 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:11.772432 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:11.772439 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:11.772470 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:03:11.773000 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:11.773013 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:11.774108 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:11.774115 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:11.775825 (+ 1710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:11.775839 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:11.777130 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:11.777136 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:11.777311 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:11.777336 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 13:03:11.777466 (+ 130us) client_negotiation.cc:240] Negotiation successful
0809 13:03:11.777610 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1047,"mutex_wait_us":50,"thread_start_us":922,"threads_started":1}
I20260809 13:03:11.779467 3892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5efb4a342f74920b3fa9447f58ed962" candidate_uuid: "30be8113344e4efd9b2082b777571694" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d1fc78c4354c2587f72a7d6f48dabd" is_pre_election: true
I20260809 13:03:11.779598 4138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5efb4a342f74920b3fa9447f58ed962" candidate_uuid: "30be8113344e4efd9b2082b777571694" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f19cafeb1f014ddc852eda66f87552d2" is_pre_election: true
I20260809 13:03:11.780073 3892 raft_consensus.cc:2454] T c5efb4a342f74920b3fa9447f58ed962 P b1d1fc78c4354c2587f72a7d6f48dabd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30be8113344e4efd9b2082b777571694 in term 0.
I20260809 13:03:11.780121 4138 raft_consensus.cc:2454] T c5efb4a342f74920b3fa9447f58ed962 P f19cafeb1f014ddc852eda66f87552d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30be8113344e4efd9b2082b777571694 in term 0.
I20260809 13:03:11.780894 3552 leader_election.cc:302] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 30be8113344e4efd9b2082b777571694, b1d1fc78c4354c2587f72a7d6f48dabd, f19cafeb1f014ddc852eda66f87552d2; no voters:
I20260809 13:03:11.781395 4264 raft_consensus.cc:2781] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:03:11.781553 4264 raft_consensus.cc:482] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:03:11.781657 4264 raft_consensus.cc:3037] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:11.784015 4264 raft_consensus.cc:504] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30be8113344e4efd9b2082b777571694" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45921 } } peers { permanent_uuid: "f19cafeb1f014ddc852eda66f87552d2" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 34445 } } peers { permanent_uuid: "b1d1fc78c4354c2587f72a7d6f48dabd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 45969 } }
I20260809 13:03:11.784816 4264 leader_election.cc:288] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694 [CANDIDATE]: Term 1 election: Requested vote from peers f19cafeb1f014ddc852eda66f87552d2 (127.28.155.195:34445), b1d1fc78c4354c2587f72a7d6f48dabd (127.28.155.194:45969)
I20260809 13:03:11.785400 4138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5efb4a342f74920b3fa9447f58ed962" candidate_uuid: "30be8113344e4efd9b2082b777571694" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f19cafeb1f014ddc852eda66f87552d2"
I20260809 13:03:11.785513 3892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5efb4a342f74920b3fa9447f58ed962" candidate_uuid: "30be8113344e4efd9b2082b777571694" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d1fc78c4354c2587f72a7d6f48dabd"
I20260809 13:03:11.785648 4138 raft_consensus.cc:3037] T c5efb4a342f74920b3fa9447f58ed962 P f19cafeb1f014ddc852eda66f87552d2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:11.785780 3892 raft_consensus.cc:3037] T c5efb4a342f74920b3fa9447f58ed962 P b1d1fc78c4354c2587f72a7d6f48dabd [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:11.788340 3892 raft_consensus.cc:2454] T c5efb4a342f74920b3fa9447f58ed962 P b1d1fc78c4354c2587f72a7d6f48dabd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30be8113344e4efd9b2082b777571694 in term 1.
I20260809 13:03:11.788393 4138 raft_consensus.cc:2454] T c5efb4a342f74920b3fa9447f58ed962 P f19cafeb1f014ddc852eda66f87552d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30be8113344e4efd9b2082b777571694 in term 1.
I20260809 13:03:11.788882 3555 leader_election.cc:302] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30be8113344e4efd9b2082b777571694, b1d1fc78c4354c2587f72a7d6f48dabd; no voters:
I20260809 13:03:11.789229 4264 raft_consensus.cc:2781] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:03:11.789717 4264 raft_consensus.cc:686] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694 [term 1 LEADER]: Becoming Leader. State: Replica: 30be8113344e4efd9b2082b777571694, State: Running, Role: LEADER
I20260809 13:03:11.790336 4264 consensus_queue.cc:237] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30be8113344e4efd9b2082b777571694" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45921 } } peers { permanent_uuid: "f19cafeb1f014ddc852eda66f87552d2" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 34445 } } peers { permanent_uuid: "b1d1fc78c4354c2587f72a7d6f48dabd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 45969 } }
I20260809 13:03:11.795619 3412 catalog_manager.cc:5495] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694 reported cstate change: term changed from 0 to 1, leader changed from <none> to 30be8113344e4efd9b2082b777571694 (127.28.155.193). New cstate: current_term: 1 leader_uuid: "30be8113344e4efd9b2082b777571694" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30be8113344e4efd9b2082b777571694" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f19cafeb1f014ddc852eda66f87552d2" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1d1fc78c4354c2587f72a7d6f48dabd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 45969 } health_report { overall_health: UNKNOWN } } }
I20260809 13:03:11.838864 4239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:11.833312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44000 (local address 127.28.155.193:45921)
0809 13:03:11.833502 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:11.833507 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:11.833783 (+ 276us) server_negotiation.cc:407] Connection header received
0809 13:03:11.833978 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:11.833982 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:11.834090 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:11.834222 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:03:11.834606 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:11.835337 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:11.836794 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:11.837221 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:11.837318 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:11.837798 (+ 480us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:03:11.838365 (+ 567us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:03:11.838478 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:11.838575 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 13:03:11.838649 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 13:03:11.847491 3892 raft_consensus.cc:1261] T c5efb4a342f74920b3fa9447f58ed962 P b1d1fc78c4354c2587f72a7d6f48dabd [term 1 FOLLOWER]: Refusing update from remote peer 30be8113344e4efd9b2082b777571694: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:03:11.847492 4138 raft_consensus.cc:1261] T c5efb4a342f74920b3fa9447f58ed962 P f19cafeb1f014ddc852eda66f87552d2 [term 1 FOLLOWER]: Refusing update from remote peer 30be8113344e4efd9b2082b777571694: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:03:11.848603 4264 consensus_queue.cc:1035] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f19cafeb1f014ddc852eda66f87552d2" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:03:11.848948 4271 consensus_queue.cc:1035] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1d1fc78c4354c2587f72a7d6f48dabd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 45969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:03:11.861572 4280 mvcc.cc:205] Tried to move back new op lower bound from 7316605304197136384 to 7316605303978033152. Current Snapshot: MvccSnapshot[applied={T|T < 7316605304197136384}]
I20260809 13:03:11.879468 3412 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58960:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:03:11.879796 3412 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58960:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:03:11.883836 3412 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 43d177cbe1684dd29708a2732d4e3540: Sending DeleteTablet for 3 replicas of tablet c5efb4a342f74920b3fa9447f58ed962
I20260809 13:03:11.885342 3628 tablet_service.cc:1514] Processing DeleteTablet for tablet c5efb4a342f74920b3fa9447f58ed962 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:03:11 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:43998
I20260809 13:03:11.885330 3861 tablet_service.cc:1514] Processing DeleteTablet for tablet c5efb4a342f74920b3fa9447f58ed962 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:03:11 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:55386
I20260809 13:03:11.885385 4107 tablet_service.cc:1514] Processing DeleteTablet for tablet c5efb4a342f74920b3fa9447f58ed962 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:03:11 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:33232
I20260809 13:03:11.888741 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 3525
I20260809 13:03:11.901937 4299 tablet_replica.cc:330] T c5efb4a342f74920b3fa9447f58ed962 P b1d1fc78c4354c2587f72a7d6f48dabd: stopping tablet replica
I20260809 13:03:11.907397 4299 raft_consensus.cc:2229] T c5efb4a342f74920b3fa9447f58ed962 P b1d1fc78c4354c2587f72a7d6f48dabd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:03:11.908368 4299 raft_consensus.cc:2258] T c5efb4a342f74920b3fa9447f58ed962 P b1d1fc78c4354c2587f72a7d6f48dabd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:03:11.913630 4299 ts_tablet_manager.cc:1905] T c5efb4a342f74920b3fa9447f58ed962 P b1d1fc78c4354c2587f72a7d6f48dabd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:03:11.917171 4301 tablet_replica.cc:330] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694: stopping tablet replica
I20260809 13:03:11.917274 4302 tablet_replica.cc:330] T c5efb4a342f74920b3fa9447f58ed962 P f19cafeb1f014ddc852eda66f87552d2: stopping tablet replica
I20260809 13:03:11.917788 4301 raft_consensus.cc:2229] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694 [term 1 LEADER]: Raft consensus shutting down.
I20260809 13:03:11.917774 4302 raft_consensus.cc:2229] T c5efb4a342f74920b3fa9447f58ed962 P f19cafeb1f014ddc852eda66f87552d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:03:11.918488 4302 raft_consensus.cc:2258] T c5efb4a342f74920b3fa9447f58ed962 P f19cafeb1f014ddc852eda66f87552d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:03:11.918699 4301 raft_consensus.cc:2258] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694 [term 1 FOLLOWER]: Raft consensus is shut down!
Aug 09 13:03:11 dist-test-slave-jq4t krb5kdc[3338](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280588, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.193@KRBTEST.COM
I20260809 13:03:11.921053 4302 ts_tablet_manager.cc:1905] T c5efb4a342f74920b3fa9447f58ed962 P f19cafeb1f014ddc852eda66f87552d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:03:11.922464 4301 ts_tablet_manager.cc:1905] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:03:11.924721 4299 ts_tablet_manager.cc:1918] T c5efb4a342f74920b3fa9447f58ed962 P b1d1fc78c4354c2587f72a7d6f48dabd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:03:11.924908 4299 log.cc:1196] T c5efb4a342f74920b3fa9447f58ed962 P b1d1fc78c4354c2587f72a7d6f48dabd: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-1/wal/wals/c5efb4a342f74920b3fa9447f58ed962
I20260809 13:03:11.925544 4299 ts_tablet_manager.cc:1939] T c5efb4a342f74920b3fa9447f58ed962 P b1d1fc78c4354c2587f72a7d6f48dabd: Deleting consensus metadata
I20260809 13:03:11.927805 3395 catalog_manager.cc:4841] TS b1d1fc78c4354c2587f72a7d6f48dabd (127.28.155.194:45969): tablet c5efb4a342f74920b3fa9447f58ed962 (table test-table [id=d6ca659e856546c3a0da8742517c0ee0]) successfully deleted
I20260809 13:03:11.928607 4302 ts_tablet_manager.cc:1918] T c5efb4a342f74920b3fa9447f58ed962 P f19cafeb1f014ddc852eda66f87552d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:03:11.928781 4302 log.cc:1196] T c5efb4a342f74920b3fa9447f58ed962 P f19cafeb1f014ddc852eda66f87552d2: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-2/wal/wals/c5efb4a342f74920b3fa9447f58ed962
I20260809 13:03:11.929370 4302 ts_tablet_manager.cc:1939] T c5efb4a342f74920b3fa9447f58ed962 P f19cafeb1f014ddc852eda66f87552d2: Deleting consensus metadata
I20260809 13:03:11.931351 3394 catalog_manager.cc:4841] TS f19cafeb1f014ddc852eda66f87552d2 (127.28.155.195:34445): tablet c5efb4a342f74920b3fa9447f58ed962 (table test-table [id=d6ca659e856546c3a0da8742517c0ee0]) successfully deleted
I20260809 13:03:11.933838 4239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:11.890781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44010 (local address 127.28.155.193:45921)
0809 13:03:11.891048 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:11.891057 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:11.895820 (+ 4763us) server_negotiation.cc:407] Connection header received
0809 13:03:11.896919 (+ 1099us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:11.896929 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:11.897097 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:11.897201 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:11.902410 (+ 5209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:11.904111 (+ 1701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:11.909071 (+ 4960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:11.910142 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:11.910289 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:11.925091 (+ 14802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:11.925108 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:11.925125 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:11.925176 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:11.929834 (+ 4658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:11.931009 (+ 1175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:11.931019 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:11.931022 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:11.931261 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:11.931897 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:11.931903 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:11.931908 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:11.932373 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:11.932833 (+ 460us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:11.933118 (+ 285us) server_negotiation.cc:299] Negotiation successful
0809 13:03:11.933400 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260809 13:03:11.934566 3738 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:12.038516 4301 ts_tablet_manager.cc:1918] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:03:12.038867 4301 log.cc:1196] T c5efb4a342f74920b3fa9447f58ed962 P 30be8113344e4efd9b2082b777571694: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786280548611909-29295-0/minicluster-data/ts-0/wal/wals/c5efb4a342f74920b3fa9447f58ed962
I20260809 13:03:12.039233 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 3525
W20260809 13:03:12.064162 3394 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.155.193:45921 (error 108)
I20260809 13:03:12.065069 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 3759
I20260809 13:03:12.066800 4308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:12.065711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:45921 (local address 127.0.0.1:44018)
0809 13:03:12.066376 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:12.066549 (+ 173us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:45921: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":371,"threads_started":1}
W20260809 13:03:12.067099 3394 catalog_manager.cc:4584] TS 30be8113344e4efd9b2082b777571694 (127.28.155.193:45921): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c5efb4a342f74920b3fa9447f58ed962: Network error: Client connection negotiation failed: client connection to 127.28.155.193:45921: connect: Connection refused (error 111)
Aug 09 13:03:12 dist-test-slave-jq4t krb5kdc[3338](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280588, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.194@KRBTEST.COM
I20260809 13:03:12.088455 4245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:12.065907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55396 (local address 127.28.155.194:45969)
0809 13:03:12.066153 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:12.066159 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:12.066182 (+ 23us) server_negotiation.cc:407] Connection header received
0809 13:03:12.066318 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:12.066331 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:12.066402 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:12.066501 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:12.067995 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:12.068841 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:12.070044 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:12.070433 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:12.070527 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:12.082511 (+ 11984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:12.082535 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:12.082553 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:12.082603 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:12.085800 (+ 3197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:12.086564 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:12.086573 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:12.086575 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:12.086736 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:12.087092 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:12.087097 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:12.087100 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:12.087504 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:12.087738 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:12.087992 (+ 254us) server_negotiation.cc:299] Negotiation successful
0809 13:03:12.088186 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260809 13:03:12.089254 3969 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:12.121106 4308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:12.120599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:45921 (local address 127.0.0.1:44024)
0809 13:03:12.120823 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:12.120937 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:45921: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260809 13:03:12.122347 4308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:12.121917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:45921 (local address 127.0.0.1:44036)
0809 13:03:12.122121 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:12.122194 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:45921: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260809 13:03:12.183429 4308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:12.182786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:45921 (local address 127.0.0.1:44052)
0809 13:03:12.183096 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:12.183219 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:45921: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121}
I20260809 13:03:12.183952 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 3759
I20260809 13:03:12.184751 4308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:12.184215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:45921 (local address 127.0.0.1:44066)
0809 13:03:12.184443 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:12.184563 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:45921: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260809 13:03:12.212407 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 3989
Aug 09 13:03:12 dist-test-slave-jq4t krb5kdc[3338](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280588, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.195@KRBTEST.COM
I20260809 13:03:12.228392 4246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:12.213396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33244 (local address 127.28.155.195:34445)
0809 13:03:12.213597 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:12.213601 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:12.213622 (+ 21us) server_negotiation.cc:407] Connection header received
0809 13:03:12.213860 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:12.213865 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:12.213932 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:12.214018 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:12.215560 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:12.216327 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:12.217672 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:12.218100 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:12.218193 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:12.222646 (+ 4453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:12.222664 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:12.222680 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:12.222717 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:12.225742 (+ 3025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:12.226417 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:12.226424 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:12.226427 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:12.226579 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:12.226932 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:12.226936 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:12.226938 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:12.227311 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:12.227551 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:12.227817 (+ 266us) server_negotiation.cc:299] Negotiation successful
0809 13:03:12.227993 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 13:03:12.229161 4202 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:12.265396 4308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:12.264796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:45921 (local address 127.0.0.1:44076)
0809 13:03:12.265071 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:12.265193 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:45921: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260809 13:03:12.266655 4308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:12.266165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:45921 (local address 127.0.0.1:44082)
0809 13:03:12.266390 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:12.266478 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:45921: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260809 13:03:12.321897 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 3989
I20260809 13:03:12.347255 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 3364
I20260809 13:03:12.348650 3471 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:12.464301 4308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:12.463584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:45921 (local address 127.0.0.1:44086)
0809 13:03:12.463968 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:12.464089 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:45921: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219}
I20260809 13:03:12.464526 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 3364
2026-08-09T13:03:12Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (5012 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-09T13:03:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:03:12Z Disabled control of system clock
I20260809 13:03:12.550626 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:38071
--webserver_interface=127.28.155.254
--webserver_port=0
--builtin_ntp_servers=127.28.155.212:42523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:38071
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 13:03:12.908249 4319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:12.908595 4319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:12.908685 4319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:12.916401 4319 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:03:12.916594 4319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:12.916649 4319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:12.916723 4319 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:03:12.916769 4319 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:03:12.926489 4319 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:42523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:38071
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:38071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:12.927901 4319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:12.929759 4319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:12.942348 4330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:12.942266 4334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:12.942310 4331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:12.943583 4319 server_base.cc:1034] running on GCE node
I20260809 13:03:12.944461 4319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:12.946053 4319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:12.947270 4319 hybrid_clock.cc:648] HybridClock initialized: now 1786280592947227 us; error 38 us; skew 500 ppm
I20260809 13:03:12.947649 4319 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 13:03:12.950244 4319 webserver.cc:460] Webserver started at http://127.28.155.254:38277/ using document root <none> and password file <none>
I20260809 13:03:12.951037 4319 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:12.951143 4319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:12.951547 4319 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:12.954795 4319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "604e5fb829704064b51fad47a5379458"
format_stamp: "Formatted at 2026-08-09 13:03:12 on dist-test-slave-jq4t"
server_key: "a66478c806bcdefa234af2d915756aca"
server_key_iv: "3dc684d010c7f4eb822c6489c3002802"
server_key_version: "encryptionkey@0"
I20260809 13:03:12.955694 4319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "604e5fb829704064b51fad47a5379458"
format_stamp: "Formatted at 2026-08-09 13:03:12 on dist-test-slave-jq4t"
server_key: "a66478c806bcdefa234af2d915756aca"
server_key_iv: "3dc684d010c7f4eb822c6489c3002802"
server_key_version: "encryptionkey@0"
I20260809 13:03:12.961299 4319 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260809 13:03:12.964901 4345 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:12.966305 4319 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 13:03:12.966506 4319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "604e5fb829704064b51fad47a5379458"
format_stamp: "Formatted at 2026-08-09 13:03:12 on dist-test-slave-jq4t"
server_key: "a66478c806bcdefa234af2d915756aca"
server_key_iv: "3dc684d010c7f4eb822c6489c3002802"
server_key_version: "encryptionkey@0"
I20260809 13:03:12.966770 4319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:12.972872 4319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:12.973717 4319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:12.974066 4319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:12.994654 4319 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:38071
I20260809 13:03:12.994686 4430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:38071 every 8 connection(s)
I20260809 13:03:12.996188 4319 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:03:13.000166 4431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:13.005594 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 4319
I20260809 13:03:13.005789 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:03:13.006521 29295 external_mini_cluster.cc:1428] Setting key 8c4e52e22c96f4d00960d8f33f5f40e0
I20260809 13:03:13.013293 4431 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 604e5fb829704064b51fad47a5379458: Bootstrap starting.
I20260809 13:03:13.017285 4435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:13.008899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49534 (local address 127.28.155.254:38071)
0809 13:03:13.010162 (+ 1263us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:13.010178 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:13.010235 (+ 57us) server_negotiation.cc:407] Connection header received
0809 13:03:13.012779 (+ 2544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:13.012819 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:13.013433 (+ 614us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:13.013922 (+ 489us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:13.015061 (+ 1139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:13.015074 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:13.015097 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:03:13.015121 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:13.015212 (+ 91us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:03:13.015242 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:13.015506 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:13.015639 (+ 133us) server_negotiation.cc:299] Negotiation successful
0809 13:03:13.015947 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":652,"thread_start_us":385,"threads_started":1}
I20260809 13:03:13.017870 4431 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 604e5fb829704064b51fad47a5379458: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:13.019186 4431 log.cc:824] T 00000000000000000000000000000000 P 604e5fb829704064b51fad47a5379458: Log is configured to *not* fsync() on all Append() calls
I20260809 13:03:13.022395 4431 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 604e5fb829704064b51fad47a5379458: No bootstrap required, opened a new log
I20260809 13:03:13.030443 4431 raft_consensus.cc:348] T 00000000000000000000000000000000 P 604e5fb829704064b51fad47a5379458 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604e5fb829704064b51fad47a5379458" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 38071 } }
I20260809 13:03:13.030902 4431 raft_consensus.cc:374] T 00000000000000000000000000000000 P 604e5fb829704064b51fad47a5379458 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:13.031009 4431 raft_consensus.cc:729] T 00000000000000000000000000000000 P 604e5fb829704064b51fad47a5379458 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604e5fb829704064b51fad47a5379458, State: Initialized, Role: FOLLOWER
I20260809 13:03:13.031670 4431 consensus_queue.cc:260] T 00000000000000000000000000000000 P 604e5fb829704064b51fad47a5379458 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604e5fb829704064b51fad47a5379458" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 38071 } }
I20260809 13:03:13.031919 4431 raft_consensus.cc:388] T 00000000000000000000000000000000 P 604e5fb829704064b51fad47a5379458 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:03:13.032060 4431 raft_consensus.cc:482] T 00000000000000000000000000000000 P 604e5fb829704064b51fad47a5379458 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:03:13.032253 4431 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 604e5fb829704064b51fad47a5379458 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:13.034595 4431 raft_consensus.cc:504] T 00000000000000000000000000000000 P 604e5fb829704064b51fad47a5379458 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604e5fb829704064b51fad47a5379458" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 38071 } }
I20260809 13:03:13.035135 4431 leader_election.cc:302] T 00000000000000000000000000000000 P 604e5fb829704064b51fad47a5379458 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 604e5fb829704064b51fad47a5379458; no voters:
I20260809 13:03:13.035930 4431 leader_election.cc:288] T 00000000000000000000000000000000 P 604e5fb829704064b51fad47a5379458 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:03:13.036091 4441 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 604e5fb829704064b51fad47a5379458 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:03:13.036901 4441 raft_consensus.cc:686] T 00000000000000000000000000000000 P 604e5fb829704064b51fad47a5379458 [term 1 LEADER]: Becoming Leader. State: Replica: 604e5fb829704064b51fad47a5379458, State: Running, Role: LEADER
I20260809 13:03:13.037565 4441 consensus_queue.cc:237] T 00000000000000000000000000000000 P 604e5fb829704064b51fad47a5379458 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604e5fb829704064b51fad47a5379458" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 38071 } }
I20260809 13:03:13.038318 4431 sys_catalog.cc:564] T 00000000000000000000000000000000 P 604e5fb829704064b51fad47a5379458 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:03:13.040980 4444 sys_catalog.cc:455] T 00000000000000000000000000000000 P 604e5fb829704064b51fad47a5379458 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "604e5fb829704064b51fad47a5379458" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604e5fb829704064b51fad47a5379458" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 38071 } } }
I20260809 13:03:13.041422 4444 sys_catalog.cc:458] T 00000000000000000000000000000000 P 604e5fb829704064b51fad47a5379458 [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:13.040880 4445 sys_catalog.cc:455] T 00000000000000000000000000000000 P 604e5fb829704064b51fad47a5379458 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 604e5fb829704064b51fad47a5379458. Latest consensus state: current_term: 1 leader_uuid: "604e5fb829704064b51fad47a5379458" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604e5fb829704064b51fad47a5379458" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 38071 } } }
I20260809 13:03:13.045629 4445 sys_catalog.cc:458] T 00000000000000000000000000000000 P 604e5fb829704064b51fad47a5379458 [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:13.046888 4453 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:03:13.051815 4453 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:03:13.060911 4453 catalog_manager.cc:1347] Generated new cluster ID: 0a537c0105904bfba308ef45d655cec3
I20260809 13:03:13.061067 4453 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:03:13.071710 4453 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:03:13.072196 4453 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:03:13.080307 4453 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 604e5fb829704064b51fad47a5379458: Generated new TSK 0
I20260809 13:03:13.081223 4453 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 13:03:13.094889 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:0
--local_ip_for_outbound_sockets=127.28.155.193
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:38071
--builtin_ntp_servers=127.28.155.212:42523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 13:03:13.458314 4474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:13.458617 4474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:13.458714 4474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:13.466279 4474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:13.466384 4474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:13.466511 4474 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:03:13.476034 4474 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:42523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:38071
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:13.477433 4474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:13.479491 4474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:13.493636 4486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:13.493641 4491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:13.493711 4487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:13.494458 4474 server_base.cc:1034] running on GCE node
I20260809 13:03:13.495146 4474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:13.496178 4474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:13.497416 4474 hybrid_clock.cc:648] HybridClock initialized: now 1786280593497335 us; error 100 us; skew 500 ppm
I20260809 13:03:13.497773 4474 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 13:03:13.500335 4474 webserver.cc:460] Webserver started at http://127.28.155.193:36931/ using document root <none> and password file <none>
I20260809 13:03:13.501129 4474 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:13.501266 4474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:13.501694 4474 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:13.504838 4474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-0/data/instance:
uuid: "739f6ee1af584d9e8fa180164e28ef42"
format_stamp: "Formatted at 2026-08-09 13:03:13 on dist-test-slave-jq4t"
server_key: "77bf34cc4388d736a9cb459266cad169"
server_key_iv: "e7e122b1607aa06d40b76462f72958b1"
server_key_version: "encryptionkey@0"
I20260809 13:03:13.505698 4474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance:
uuid: "739f6ee1af584d9e8fa180164e28ef42"
format_stamp: "Formatted at 2026-08-09 13:03:13 on dist-test-slave-jq4t"
server_key: "77bf34cc4388d736a9cb459266cad169"
server_key_iv: "e7e122b1607aa06d40b76462f72958b1"
server_key_version: "encryptionkey@0"
I20260809 13:03:13.511149 4474 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 13:03:13.514719 4499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:13.516088 4474 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260809 13:03:13.516278 4474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "739f6ee1af584d9e8fa180164e28ef42"
format_stamp: "Formatted at 2026-08-09 13:03:13 on dist-test-slave-jq4t"
server_key: "77bf34cc4388d736a9cb459266cad169"
server_key_iv: "e7e122b1607aa06d40b76462f72958b1"
server_key_version: "encryptionkey@0"
I20260809 13:03:13.516577 4474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:13.522253 4474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:13.523063 4474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:13.523344 4474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:13.524289 4474 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:03:13.525797 4474 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:03:13.525925 4474 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:13.526108 4474 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:03:13.526211 4474 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:13.560386 4474 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:44917
I20260809 13:03:13.560441 4693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:44917 every 8 connection(s)
I20260809 13:03:13.561825 4474 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:03:13.570315 4697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:13.564454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:43687 (local address 127.28.155.254:38071)
0809 13:03:13.564986 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:13.564990 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:13.566061 (+ 1071us) server_negotiation.cc:407] Connection header received
0809 13:03:13.567858 (+ 1797us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:13.567865 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:13.567946 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:13.568077 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:13.569475 (+ 1398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:13.569482 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:13.569487 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:03:13.569513 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:13.569565 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:03:13.569577 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:13.569712 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:13.569911 (+ 199us) server_negotiation.cc:299] Negotiation successful
0809 13:03:13.569992 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":266,"threads_started":1}
I20260809 13:03:13.571400 4706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:13.564960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:38071 (local address 127.28.155.193:43687)
0809 13:03:13.565889 (+ 929us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:13.565925 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:13.567577 (+ 1652us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:13.568339 (+ 762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:13.568347 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:13.568433 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:13.569165 (+ 732us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 13:03:13.569167 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:13.569206 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 13:03:13.569293 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:13.569683 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:13.569696 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:13.569705 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 13:03:13.570026 (+ 321us) client_negotiation.cc:240] Negotiation successful
0809 13:03:13.570290 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":290,"threads_started":1}
I20260809 13:03:13.571465 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 4474
I20260809 13:03:13.571656 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance
I20260809 13:03:13.572587 29295 external_mini_cluster.cc:1428] Setting key 5d951ee669a2fd1c83e16fb84ce0fb43
I20260809 13:03:13.573014 4694 heartbeater.cc:347] Connected to a master server at 127.28.155.254:38071
I20260809 13:03:13.573339 4694 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:13.573952 4694 heartbeater.cc:511] Master 127.28.155.254:38071 requested a full tablet report, sending...
I20260809 13:03:13.575537 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:0
--local_ip_for_outbound_sockets=127.28.155.194
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:38071
--builtin_ntp_servers=127.28.155.212:42523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260809 13:03:13.576015 4376 ts_manager.cc:194] Registered new tserver with Master: 739f6ee1af584d9e8fa180164e28ef42 (127.28.155.193:44917)
W20260809 13:03:13.927579 4707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:13.927873 4707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:13.927966 4707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:13.935249 4707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:13.935354 4707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:13.935463 4707 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:03:13.945084 4707 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:42523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:38071
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:13.946440 4707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:13.948236 4707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:13.962284 4723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:13.962206 4729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:13.962263 4724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:13.963174 4707 server_base.cc:1034] running on GCE node
I20260809 13:03:13.963825 4707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:13.964897 4707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:13.966145 4707 hybrid_clock.cc:648] HybridClock initialized: now 1786280593966088 us; error 45 us; skew 500 ppm
I20260809 13:03:13.966475 4707 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 13:03:13.968946 4707 webserver.cc:460] Webserver started at http://127.28.155.194:35491/ using document root <none> and password file <none>
I20260809 13:03:13.969668 4707 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:13.969801 4707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:13.970212 4707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:13.973429 4707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-1/data/instance:
uuid: "495d99d01482436daad8465bd2488dc5"
format_stamp: "Formatted at 2026-08-09 13:03:13 on dist-test-slave-jq4t"
server_key: "bbf6f49a552806ece0d9f36a059efbeb"
server_key_iv: "8129e2f5fd50360792f681e3dc3c03a1"
server_key_version: "encryptionkey@0"
I20260809 13:03:13.974294 4707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance:
uuid: "495d99d01482436daad8465bd2488dc5"
format_stamp: "Formatted at 2026-08-09 13:03:13 on dist-test-slave-jq4t"
server_key: "bbf6f49a552806ece0d9f36a059efbeb"
server_key_iv: "8129e2f5fd50360792f681e3dc3c03a1"
server_key_version: "encryptionkey@0"
I20260809 13:03:13.979611 4707 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 13:03:13.983331 4736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:13.984722 4707 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:03:13.984930 4707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "495d99d01482436daad8465bd2488dc5"
format_stamp: "Formatted at 2026-08-09 13:03:13 on dist-test-slave-jq4t"
server_key: "bbf6f49a552806ece0d9f36a059efbeb"
server_key_iv: "8129e2f5fd50360792f681e3dc3c03a1"
server_key_version: "encryptionkey@0"
I20260809 13:03:13.985194 4707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:13.991335 4707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:13.992233 4707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:13.992703 4707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:13.993757 4707 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:03:13.995561 4707 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:03:13.995692 4707 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:13.995837 4707 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:03:13.995932 4707 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:14.032128 4707 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:33427
I20260809 13:03:14.032186 4942 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:33427 every 8 connection(s)
I20260809 13:03:14.033759 4707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:03:14.042187 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 4707
I20260809 13:03:14.042414 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance
I20260809 13:03:14.042778 4697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:14.036730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:43551 (local address 127.28.155.254:38071)
0809 13:03:14.036960 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:14.036966 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:14.038469 (+ 1503us) server_negotiation.cc:407] Connection header received
0809 13:03:14.040259 (+ 1790us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:14.040263 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:14.040343 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:14.040444 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:14.041868 (+ 1424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:14.041872 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:14.041875 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:03:14.041890 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:14.041921 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:03:14.041932 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:14.042053 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:14.042403 (+ 350us) server_negotiation.cc:299] Negotiation successful
0809 13:03:14.042482 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 13:03:14.043033 29295 external_mini_cluster.cc:1428] Setting key 91dcdeb07f022cc6caf3d9402fb4d1c1
I20260809 13:03:14.043918 4946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:14.037320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:38071 (local address 127.28.155.194:43551)
0809 13:03:14.038310 (+ 990us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:14.038350 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:14.039972 (+ 1622us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:14.040695 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:14.040703 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:14.040793 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:14.041538 (+ 745us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 13:03:14.041541 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:14.041579 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 13:03:14.041665 (+ 86us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:14.042045 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:14.042057 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:14.042067 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 13:03:14.042478 (+ 411us) client_negotiation.cc:240] Negotiation successful
0809 13:03:14.042750 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":290,"threads_started":1}
I20260809 13:03:14.045521 4943 heartbeater.cc:347] Connected to a master server at 127.28.155.254:38071
I20260809 13:03:14.045893 4943 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:14.046255 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:0
--local_ip_for_outbound_sockets=127.28.155.195
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:38071
--builtin_ntp_servers=127.28.155.212:42523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260809 13:03:14.046672 4943 heartbeater.cc:511] Master 127.28.155.254:38071 requested a full tablet report, sending...
I20260809 13:03:14.048273 4376 ts_manager.cc:194] Registered new tserver with Master: 495d99d01482436daad8465bd2488dc5 (127.28.155.194:33427)
W20260809 13:03:14.401782 4948 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:14.402104 4948 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:14.402200 4948 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:14.409868 4948 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:14.409989 4948 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:14.410168 4948 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:03:14.419850 4948 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:42523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:38071
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:14.421455 4948 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:14.423318 4948 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:14.437016 4963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:14.437106 4968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:14.437115 4964 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:14.438248 4948 server_base.cc:1034] running on GCE node
I20260809 13:03:14.438969 4948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:14.440116 4948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:14.441354 4948 hybrid_clock.cc:648] HybridClock initialized: now 1786280594441312 us; error 40 us; skew 500 ppm
I20260809 13:03:14.441704 4948 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 13:03:14.444422 4948 webserver.cc:460] Webserver started at http://127.28.155.195:39985/ using document root <none> and password file <none>
I20260809 13:03:14.445221 4948 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:14.445364 4948 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:14.445735 4948 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:14.448886 4948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-2/data/instance:
uuid: "a327f0fbdc6c4ff5b706fbe49e302d6d"
format_stamp: "Formatted at 2026-08-09 13:03:14 on dist-test-slave-jq4t"
server_key: "1e17f0e9e84e43d998ac59df58a6344d"
server_key_iv: "bacd01070bc2ac33cdf2fadbb9923942"
server_key_version: "encryptionkey@0"
I20260809 13:03:14.449754 4948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance:
uuid: "a327f0fbdc6c4ff5b706fbe49e302d6d"
format_stamp: "Formatted at 2026-08-09 13:03:14 on dist-test-slave-jq4t"
server_key: "1e17f0e9e84e43d998ac59df58a6344d"
server_key_iv: "bacd01070bc2ac33cdf2fadbb9923942"
server_key_version: "encryptionkey@0"
I20260809 13:03:14.455464 4948 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 13:03:14.459065 4980 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:14.460624 4948 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:03:14.460814 4948 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "a327f0fbdc6c4ff5b706fbe49e302d6d"
format_stamp: "Formatted at 2026-08-09 13:03:14 on dist-test-slave-jq4t"
server_key: "1e17f0e9e84e43d998ac59df58a6344d"
server_key_iv: "bacd01070bc2ac33cdf2fadbb9923942"
server_key_version: "encryptionkey@0"
I20260809 13:03:14.461066 4948 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:14.466964 4948 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:14.467723 4948 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:14.467958 4948 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:14.468964 4948 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:03:14.470417 4948 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:03:14.470542 4948 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:14.470678 4948 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:03:14.470774 4948 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:14.506989 4948 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:35919
I20260809 13:03:14.507047 5199 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:35919 every 8 connection(s)
I20260809 13:03:14.508424 4948 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:03:14.512672 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 4948
I20260809 13:03:14.512873 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance
I20260809 13:03:14.513410 29295 external_mini_cluster.cc:1428] Setting key 343ddac3c26469f3b28673f5728c1e67
I20260809 13:03:14.517642 4697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:14.511224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:59715 (local address 127.28.155.254:38071)
0809 13:03:14.511423 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:14.511428 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:14.513155 (+ 1727us) server_negotiation.cc:407] Connection header received
0809 13:03:14.515301 (+ 2146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:14.515307 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:14.515399 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:14.515525 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:14.517000 (+ 1475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:14.517005 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:14.517008 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:03:14.517024 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:14.517062 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:03:14.517074 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:14.517183 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:14.517357 (+ 174us) server_negotiation.cc:299] Negotiation successful
0809 13:03:14.517413 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 13:03:14.518656 5202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:14.511803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:38071 (local address 127.28.155.195:59715)
0809 13:03:14.512950 (+ 1147us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:14.513014 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:14.515017 (+ 2003us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:14.515769 (+ 752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:14.515778 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:14.515873 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:14.516721 (+ 848us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 13:03:14.516723 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:14.516767 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 13:03:14.516857 (+ 90us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:14.517167 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:14.517175 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:14.517180 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 13:03:14.517407 (+ 227us) client_negotiation.cc:240] Negotiation successful
0809 13:03:14.517642 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":353,"threads_started":1}
I20260809 13:03:14.520081 5200 heartbeater.cc:347] Connected to a master server at 127.28.155.254:38071
I20260809 13:03:14.520398 5200 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:14.521101 5200 heartbeater.cc:511] Master 127.28.155.254:38071 requested a full tablet report, sending...
I20260809 13:03:14.522600 4376 ts_manager.cc:194] Registered new tserver with Master: a327f0fbdc6c4ff5b706fbe49e302d6d (127.28.155.195:35919)
I20260809 13:03:14.529238 29295 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 13:03:14.536940 4697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:14.533974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49544 (local address 127.28.155.254:38071)
0809 13:03:14.534156 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:14.534161 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:14.534736 (+ 575us) server_negotiation.cc:407] Connection header received
0809 13:03:14.534974 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:14.534980 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:14.535044 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:14.535136 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:14.536278 (+ 1142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:14.536283 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:14.536286 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:03:14.536303 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:14.536340 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:03:14.536360 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:14.536553 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:14.536632 (+ 79us) server_negotiation.cc:299] Negotiation successful
0809 13:03:14.536688 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 13:03:14.541635 4376 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49544:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 13:03:14.549194 4376 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:03:14.572510 5222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:14.562413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:44917 (local address 127.0.0.1:40272)
0809 13:03:14.563802 (+ 1389us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:14.563854 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:14.564018 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:14.569836 (+ 5818us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:14.569848 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:14.569964 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:14.570992 (+ 1028us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 13:03:14.570997 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:14.571031 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 13:03:14.571129 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:14.571615 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:14.571628 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:14.571640 (+ 12us) client_negotiation.cc:769] Sending connection context
0809 13:03:14.571801 (+ 161us) client_negotiation.cc:240] Negotiation successful
0809 13:03:14.571899 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1140,"thread_start_us":961,"threads_started":1}
I20260809 13:03:14.573024 5223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:14.562545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40272 (local address 127.28.155.193:44917)
0809 13:03:14.563389 (+ 844us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:14.563413 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:14.567861 (+ 4448us) server_negotiation.cc:407] Connection header received
0809 13:03:14.567950 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:14.567958 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:14.568201 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:14.568367 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:14.571292 (+ 2925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:14.571302 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:14.571318 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:03:14.571344 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:14.571415 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:03:14.571439 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:14.572541 (+ 1102us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:14.572621 (+ 80us) server_negotiation.cc:299] Negotiation successful
0809 13:03:14.572747 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":495,"threads_started":1}
I20260809 13:03:14.574185 5232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:14.564270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:33427 (local address 127.0.0.1:56398)
0809 13:03:14.570499 (+ 6229us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:14.570526 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:14.570761 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:14.571979 (+ 1218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:14.571982 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:14.572000 (+ 18us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:14.572941 (+ 941us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 13:03:14.572943 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:14.572954 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 13:03:14.572990 (+ 36us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:14.573539 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:14.573553 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:14.573577 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 13:03:14.573731 (+ 154us) client_negotiation.cc:240] Negotiation successful
0809 13:03:14.573790 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6024,"thread_start_us":8964,"threads_started":1}
I20260809 13:03:14.574222 5228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:14.564752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56398 (local address 127.28.155.194:33427)
0809 13:03:14.569837 (+ 5085us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:14.569850 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:14.570647 (+ 797us) server_negotiation.cc:407] Connection header received
0809 13:03:14.570991 (+ 344us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:14.571004 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:14.571279 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:14.571402 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:14.573157 (+ 1755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:14.573271 (+ 114us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:14.573287 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:03:14.573320 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:14.573386 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:03:14.573410 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:14.573551 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:14.573762 (+ 211us) server_negotiation.cc:299] Negotiation successful
0809 13:03:14.573881 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4852,"thread_start_us":4691,"threads_started":1}
I20260809 13:03:14.577044 5234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:14.566746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47200 (local address 127.28.155.195:35919)
0809 13:03:14.571497 (+ 4751us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:14.571505 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:14.573350 (+ 1845us) server_negotiation.cc:407] Connection header received
0809 13:03:14.573436 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:14.573447 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:14.573672 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:14.573833 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:14.575935 (+ 2102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:14.575944 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:14.575958 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:03:14.575980 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:14.576043 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:03:14.576067 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:14.576241 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:14.576503 (+ 262us) server_negotiation.cc:299] Negotiation successful
0809 13:03:14.576601 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4546,"thread_start_us":4955,"threads_started":1}
I20260809 13:03:14.577049 5226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:14.564940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:35919 (local address 127.0.0.1:47200)
0809 13:03:14.572767 (+ 7827us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:14.573126 (+ 359us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:14.573220 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:14.574893 (+ 1673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:14.574898 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:14.574922 (+ 24us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:14.575678 (+ 756us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 13:03:14.575681 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:14.575697 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 13:03:14.575741 (+ 44us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:14.576309 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:14.576313 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:14.576316 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 13:03:14.576486 (+ 170us) client_negotiation.cc:240] Negotiation successful
0809 13:03:14.576563 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7708,"thread_start_us":6620,"threads_started":1}
I20260809 13:03:14.577773 4585 tablet_service.cc:1467] Processing CreateTablet for tablet 887148b1f39644ffb7ed4a88f91ad7f5 (DEFAULT_TABLE table=test-table [id=a889a990af7343a4ba3aa3fd6264a67f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:03:14.578251 4819 tablet_service.cc:1467] Processing CreateTablet for tablet 887148b1f39644ffb7ed4a88f91ad7f5 (DEFAULT_TABLE table=test-table [id=a889a990af7343a4ba3aa3fd6264a67f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:03:14.579136 4694 heartbeater.cc:503] Master 127.28.155.254:38071 was elected leader, sending a full tablet report...
I20260809 13:03:14.579510 4585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 887148b1f39644ffb7ed4a88f91ad7f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:14.579712 4819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 887148b1f39644ffb7ed4a88f91ad7f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:14.580678 5087 tablet_service.cc:1467] Processing CreateTablet for tablet 887148b1f39644ffb7ed4a88f91ad7f5 (DEFAULT_TABLE table=test-table [id=a889a990af7343a4ba3aa3fd6264a67f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:03:14.582019 5087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 887148b1f39644ffb7ed4a88f91ad7f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:14.594614 5236 tablet_bootstrap.cc:492] T 887148b1f39644ffb7ed4a88f91ad7f5 P a327f0fbdc6c4ff5b706fbe49e302d6d: Bootstrap starting.
I20260809 13:03:14.598672 5236 tablet_bootstrap.cc:654] T 887148b1f39644ffb7ed4a88f91ad7f5 P a327f0fbdc6c4ff5b706fbe49e302d6d: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:14.600291 5236 log.cc:824] T 887148b1f39644ffb7ed4a88f91ad7f5 P a327f0fbdc6c4ff5b706fbe49e302d6d: Log is configured to *not* fsync() on all Append() calls
I20260809 13:03:14.600765 5237 tablet_bootstrap.cc:492] T 887148b1f39644ffb7ed4a88f91ad7f5 P 495d99d01482436daad8465bd2488dc5: Bootstrap starting.
I20260809 13:03:14.601207 5239 tablet_bootstrap.cc:492] T 887148b1f39644ffb7ed4a88f91ad7f5 P 739f6ee1af584d9e8fa180164e28ef42: Bootstrap starting.
I20260809 13:03:14.604768 5237 tablet_bootstrap.cc:654] T 887148b1f39644ffb7ed4a88f91ad7f5 P 495d99d01482436daad8465bd2488dc5: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:14.604902 5236 tablet_bootstrap.cc:492] T 887148b1f39644ffb7ed4a88f91ad7f5 P a327f0fbdc6c4ff5b706fbe49e302d6d: No bootstrap required, opened a new log
I20260809 13:03:14.605222 5236 ts_tablet_manager.cc:1397] T 887148b1f39644ffb7ed4a88f91ad7f5 P a327f0fbdc6c4ff5b706fbe49e302d6d: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260809 13:03:14.605331 5239 tablet_bootstrap.cc:654] T 887148b1f39644ffb7ed4a88f91ad7f5 P 739f6ee1af584d9e8fa180164e28ef42: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:14.605958 5237 log.cc:824] T 887148b1f39644ffb7ed4a88f91ad7f5 P 495d99d01482436daad8465bd2488dc5: Log is configured to *not* fsync() on all Append() calls
I20260809 13:03:14.606580 5239 log.cc:824] T 887148b1f39644ffb7ed4a88f91ad7f5 P 739f6ee1af584d9e8fa180164e28ef42: Log is configured to *not* fsync() on all Append() calls
I20260809 13:03:14.609349 5237 tablet_bootstrap.cc:492] T 887148b1f39644ffb7ed4a88f91ad7f5 P 495d99d01482436daad8465bd2488dc5: No bootstrap required, opened a new log
I20260809 13:03:14.609663 5237 ts_tablet_manager.cc:1397] T 887148b1f39644ffb7ed4a88f91ad7f5 P 495d99d01482436daad8465bd2488dc5: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260809 13:03:14.609985 5239 tablet_bootstrap.cc:492] T 887148b1f39644ffb7ed4a88f91ad7f5 P 739f6ee1af584d9e8fa180164e28ef42: No bootstrap required, opened a new log
I20260809 13:03:14.610280 5239 ts_tablet_manager.cc:1397] T 887148b1f39644ffb7ed4a88f91ad7f5 P 739f6ee1af584d9e8fa180164e28ef42: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.006s
I20260809 13:03:14.616612 5236 raft_consensus.cc:348] T 887148b1f39644ffb7ed4a88f91ad7f5 P a327f0fbdc6c4ff5b706fbe49e302d6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "739f6ee1af584d9e8fa180164e28ef42" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 44917 } } peers { permanent_uuid: "495d99d01482436daad8465bd2488dc5" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33427 } } peers { permanent_uuid: "a327f0fbdc6c4ff5b706fbe49e302d6d" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 35919 } }
I20260809 13:03:14.617149 5236 raft_consensus.cc:374] T 887148b1f39644ffb7ed4a88f91ad7f5 P a327f0fbdc6c4ff5b706fbe49e302d6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:14.617264 5236 raft_consensus.cc:729] T 887148b1f39644ffb7ed4a88f91ad7f5 P a327f0fbdc6c4ff5b706fbe49e302d6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a327f0fbdc6c4ff5b706fbe49e302d6d, State: Initialized, Role: FOLLOWER
I20260809 13:03:14.617218 5237 raft_consensus.cc:348] T 887148b1f39644ffb7ed4a88f91ad7f5 P 495d99d01482436daad8465bd2488dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "739f6ee1af584d9e8fa180164e28ef42" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 44917 } } peers { permanent_uuid: "495d99d01482436daad8465bd2488dc5" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33427 } } peers { permanent_uuid: "a327f0fbdc6c4ff5b706fbe49e302d6d" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 35919 } }
I20260809 13:03:14.617705 5237 raft_consensus.cc:374] T 887148b1f39644ffb7ed4a88f91ad7f5 P 495d99d01482436daad8465bd2488dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:14.617815 5237 raft_consensus.cc:729] T 887148b1f39644ffb7ed4a88f91ad7f5 P 495d99d01482436daad8465bd2488dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 495d99d01482436daad8465bd2488dc5, State: Initialized, Role: FOLLOWER
I20260809 13:03:14.617965 5236 consensus_queue.cc:260] T 887148b1f39644ffb7ed4a88f91ad7f5 P a327f0fbdc6c4ff5b706fbe49e302d6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "739f6ee1af584d9e8fa180164e28ef42" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 44917 } } peers { permanent_uuid: "495d99d01482436daad8465bd2488dc5" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33427 } } peers { permanent_uuid: "a327f0fbdc6c4ff5b706fbe49e302d6d" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 35919 } }
I20260809 13:03:14.618494 5237 consensus_queue.cc:260] T 887148b1f39644ffb7ed4a88f91ad7f5 P 495d99d01482436daad8465bd2488dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "739f6ee1af584d9e8fa180164e28ef42" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 44917 } } peers { permanent_uuid: "495d99d01482436daad8465bd2488dc5" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33427 } } peers { permanent_uuid: "a327f0fbdc6c4ff5b706fbe49e302d6d" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 35919 } }
I20260809 13:03:14.621101 4943 heartbeater.cc:503] Master 127.28.155.254:38071 was elected leader, sending a full tablet report...
I20260809 13:03:14.621945 5237 ts_tablet_manager.cc:1428] T 887148b1f39644ffb7ed4a88f91ad7f5 P 495d99d01482436daad8465bd2488dc5: Time spent starting tablet: real 0.012s user 0.009s sys 0.003s
I20260809 13:03:14.622121 5239 raft_consensus.cc:348] T 887148b1f39644ffb7ed4a88f91ad7f5 P 739f6ee1af584d9e8fa180164e28ef42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "739f6ee1af584d9e8fa180164e28ef42" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 44917 } } peers { permanent_uuid: "495d99d01482436daad8465bd2488dc5" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33427 } } peers { permanent_uuid: "a327f0fbdc6c4ff5b706fbe49e302d6d" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 35919 } }
I20260809 13:03:14.622650 5239 raft_consensus.cc:374] T 887148b1f39644ffb7ed4a88f91ad7f5 P 739f6ee1af584d9e8fa180164e28ef42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:14.622772 5239 raft_consensus.cc:729] T 887148b1f39644ffb7ed4a88f91ad7f5 P 739f6ee1af584d9e8fa180164e28ef42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 739f6ee1af584d9e8fa180164e28ef42, State: Initialized, Role: FOLLOWER
I20260809 13:03:14.623270 5200 heartbeater.cc:503] Master 127.28.155.254:38071 was elected leader, sending a full tablet report...
I20260809 13:03:14.623492 5239 consensus_queue.cc:260] T 887148b1f39644ffb7ed4a88f91ad7f5 P 739f6ee1af584d9e8fa180164e28ef42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "739f6ee1af584d9e8fa180164e28ef42" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 44917 } } peers { permanent_uuid: "495d99d01482436daad8465bd2488dc5" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33427 } } peers { permanent_uuid: "a327f0fbdc6c4ff5b706fbe49e302d6d" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 35919 } }
I20260809 13:03:14.623775 5236 ts_tablet_manager.cc:1428] T 887148b1f39644ffb7ed4a88f91ad7f5 P a327f0fbdc6c4ff5b706fbe49e302d6d: Time spent starting tablet: real 0.018s user 0.018s sys 0.000s
I20260809 13:03:14.625605 5239 ts_tablet_manager.cc:1428] T 887148b1f39644ffb7ed4a88f91ad7f5 P 739f6ee1af584d9e8fa180164e28ef42: Time spent starting tablet: real 0.015s user 0.012s sys 0.004s
W20260809 13:03:14.760334 5201 tablet.cc:2369] T 887148b1f39644ffb7ed4a88f91ad7f5 P a327f0fbdc6c4ff5b706fbe49e302d6d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 13:03:14.786224 4944 tablet.cc:2369] T 887148b1f39644ffb7ed4a88f91ad7f5 P 495d99d01482436daad8465bd2488dc5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 13:03:14.815618 4695 tablet.cc:2369] T 887148b1f39644ffb7ed4a88f91ad7f5 P 739f6ee1af584d9e8fa180164e28ef42: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:03:14.894183 5255 raft_consensus.cc:482] T 887148b1f39644ffb7ed4a88f91ad7f5 P 739f6ee1af584d9e8fa180164e28ef42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:03:14.894588 5255 raft_consensus.cc:504] T 887148b1f39644ffb7ed4a88f91ad7f5 P 739f6ee1af584d9e8fa180164e28ef42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "739f6ee1af584d9e8fa180164e28ef42" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 44917 } } peers { permanent_uuid: "495d99d01482436daad8465bd2488dc5" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33427 } } peers { permanent_uuid: "a327f0fbdc6c4ff5b706fbe49e302d6d" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 35919 } }
I20260809 13:03:14.896520 5255 leader_election.cc:288] T 887148b1f39644ffb7ed4a88f91ad7f5 P 739f6ee1af584d9e8fa180164e28ef42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 495d99d01482436daad8465bd2488dc5 (127.28.155.194:33427), a327f0fbdc6c4ff5b706fbe49e302d6d (127.28.155.195:35919)
I20260809 13:03:14.900332 5234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:14.897072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:56393 (local address 127.28.155.195:35919)
0809 13:03:14.897325 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:14.897333 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:14.898148 (+ 815us) server_negotiation.cc:407] Connection header received
0809 13:03:14.898349 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:14.898356 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:14.898415 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:14.898525 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:14.899676 (+ 1151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:14.899682 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:14.899686 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:03:14.899704 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:14.899743 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:03:14.899753 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:14.899885 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:14.899966 (+ 81us) server_negotiation.cc:299] Negotiation successful
0809 13:03:14.900043 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260809 13:03:14.900460 5228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:14.897040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:46657 (local address 127.28.155.194:33427)
0809 13:03:14.897267 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:14.897276 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:14.898200 (+ 924us) server_negotiation.cc:407] Connection header received
0809 13:03:14.898387 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:14.898399 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:14.898450 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:14.898558 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:14.899761 (+ 1203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:14.899767 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:14.899771 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:03:14.899797 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:14.899830 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:03:14.899841 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:14.899964 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:14.900089 (+ 125us) server_negotiation.cc:299] Negotiation successful
0809 13:03:14.900156 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 13:03:14.900552 5256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:14.896846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:35919 (local address 127.28.155.193:56393)
0809 13:03:14.898011 (+ 1165us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:14.898031 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:14.898211 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:14.898567 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:14.898574 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:14.898598 (+ 24us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:14.899466 (+ 868us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 13:03:14.899469 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:14.899483 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 13:03:14.899526 (+ 43us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:14.899851 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:14.899856 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:14.899862 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 13:03:14.900012 (+ 150us) client_negotiation.cc:240] Negotiation successful
0809 13:03:14.900067 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1004,"thread_start_us":705,"threads_started":1}
I20260809 13:03:14.901237 5257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:14.896991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:33427 (local address 127.28.155.193:46657)
0809 13:03:14.898077 (+ 1086us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:14.898097 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:14.898242 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:14.898590 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:14.898596 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:14.898620 (+ 24us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:14.899558 (+ 938us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 13:03:14.899561 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:14.899575 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 13:03:14.899611 (+ 36us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:14.899939 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:14.899943 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:14.899948 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 13:03:14.900134 (+ 186us) client_negotiation.cc:240] Negotiation successful
0809 13:03:14.900182 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":980,"thread_start_us":755,"threads_started":1}
I20260809 13:03:14.901679 5126 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "887148b1f39644ffb7ed4a88f91ad7f5" candidate_uuid: "739f6ee1af584d9e8fa180164e28ef42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a327f0fbdc6c4ff5b706fbe49e302d6d" is_pre_election: true
I20260809 13:03:14.902243 5126 raft_consensus.cc:2454] T 887148b1f39644ffb7ed4a88f91ad7f5 P a327f0fbdc6c4ff5b706fbe49e302d6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 739f6ee1af584d9e8fa180164e28ef42 in term 0.
I20260809 13:03:14.902335 4855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "887148b1f39644ffb7ed4a88f91ad7f5" candidate_uuid: "739f6ee1af584d9e8fa180164e28ef42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "495d99d01482436daad8465bd2488dc5" is_pre_election: true
I20260809 13:03:14.902911 4855 raft_consensus.cc:2454] T 887148b1f39644ffb7ed4a88f91ad7f5 P 495d99d01482436daad8465bd2488dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 739f6ee1af584d9e8fa180164e28ef42 in term 0.
I20260809 13:03:14.902938 4500 leader_election.cc:302] T 887148b1f39644ffb7ed4a88f91ad7f5 P 739f6ee1af584d9e8fa180164e28ef42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 739f6ee1af584d9e8fa180164e28ef42, a327f0fbdc6c4ff5b706fbe49e302d6d; no voters:
I20260809 13:03:14.903376 5255 raft_consensus.cc:2781] T 887148b1f39644ffb7ed4a88f91ad7f5 P 739f6ee1af584d9e8fa180164e28ef42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:03:14.903553 5255 raft_consensus.cc:482] T 887148b1f39644ffb7ed4a88f91ad7f5 P 739f6ee1af584d9e8fa180164e28ef42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:03:14.903688 5255 raft_consensus.cc:3037] T 887148b1f39644ffb7ed4a88f91ad7f5 P 739f6ee1af584d9e8fa180164e28ef42 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:14.906160 5255 raft_consensus.cc:504] T 887148b1f39644ffb7ed4a88f91ad7f5 P 739f6ee1af584d9e8fa180164e28ef42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "739f6ee1af584d9e8fa180164e28ef42" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 44917 } } peers { permanent_uuid: "495d99d01482436daad8465bd2488dc5" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33427 } } peers { permanent_uuid: "a327f0fbdc6c4ff5b706fbe49e302d6d" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 35919 } }
I20260809 13:03:14.906757 5255 leader_election.cc:288] T 887148b1f39644ffb7ed4a88f91ad7f5 P 739f6ee1af584d9e8fa180164e28ef42 [CANDIDATE]: Term 1 election: Requested vote from peers 495d99d01482436daad8465bd2488dc5 (127.28.155.194:33427), a327f0fbdc6c4ff5b706fbe49e302d6d (127.28.155.195:35919)
I20260809 13:03:14.907299 4855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "887148b1f39644ffb7ed4a88f91ad7f5" candidate_uuid: "739f6ee1af584d9e8fa180164e28ef42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "495d99d01482436daad8465bd2488dc5"
I20260809 13:03:14.907305 5126 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "887148b1f39644ffb7ed4a88f91ad7f5" candidate_uuid: "739f6ee1af584d9e8fa180164e28ef42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a327f0fbdc6c4ff5b706fbe49e302d6d"
I20260809 13:03:14.907517 5126 raft_consensus.cc:3037] T 887148b1f39644ffb7ed4a88f91ad7f5 P a327f0fbdc6c4ff5b706fbe49e302d6d [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:14.907517 4855 raft_consensus.cc:3037] T 887148b1f39644ffb7ed4a88f91ad7f5 P 495d99d01482436daad8465bd2488dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:14.910910 4855 raft_consensus.cc:2454] T 887148b1f39644ffb7ed4a88f91ad7f5 P 495d99d01482436daad8465bd2488dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 739f6ee1af584d9e8fa180164e28ef42 in term 1.
I20260809 13:03:14.910910 5126 raft_consensus.cc:2454] T 887148b1f39644ffb7ed4a88f91ad7f5 P a327f0fbdc6c4ff5b706fbe49e302d6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 739f6ee1af584d9e8fa180164e28ef42 in term 1.
I20260809 13:03:14.911363 4505 leader_election.cc:302] T 887148b1f39644ffb7ed4a88f91ad7f5 P 739f6ee1af584d9e8fa180164e28ef42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 495d99d01482436daad8465bd2488dc5, 739f6ee1af584d9e8fa180164e28ef42; no voters:
I20260809 13:03:14.911741 5255 raft_consensus.cc:2781] T 887148b1f39644ffb7ed4a88f91ad7f5 P 739f6ee1af584d9e8fa180164e28ef42 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:03:14.912163 5255 raft_consensus.cc:686] T 887148b1f39644ffb7ed4a88f91ad7f5 P 739f6ee1af584d9e8fa180164e28ef42 [term 1 LEADER]: Becoming Leader. State: Replica: 739f6ee1af584d9e8fa180164e28ef42, State: Running, Role: LEADER
I20260809 13:03:14.912776 5255 consensus_queue.cc:237] T 887148b1f39644ffb7ed4a88f91ad7f5 P 739f6ee1af584d9e8fa180164e28ef42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "739f6ee1af584d9e8fa180164e28ef42" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 44917 } } peers { permanent_uuid: "495d99d01482436daad8465bd2488dc5" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33427 } } peers { permanent_uuid: "a327f0fbdc6c4ff5b706fbe49e302d6d" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 35919 } }
I20260809 13:03:14.917670 4375 catalog_manager.cc:5495] T 887148b1f39644ffb7ed4a88f91ad7f5 P 739f6ee1af584d9e8fa180164e28ef42 reported cstate change: term changed from 0 to 1, leader changed from <none> to 739f6ee1af584d9e8fa180164e28ef42 (127.28.155.193). New cstate: current_term: 1 leader_uuid: "739f6ee1af584d9e8fa180164e28ef42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "739f6ee1af584d9e8fa180164e28ef42" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 44917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "495d99d01482436daad8465bd2488dc5" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a327f0fbdc6c4ff5b706fbe49e302d6d" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 35919 } health_report { overall_health: UNKNOWN } } }
I20260809 13:03:14.946026 5223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:14.943996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40286 (local address 127.28.155.193:44917)
0809 13:03:14.944193 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:14.944197 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:14.944217 (+ 20us) server_negotiation.cc:407] Connection header received
0809 13:03:14.944321 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:14.944325 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:14.944409 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:14.944560 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:14.945435 (+ 875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:14.945439 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:14.945442 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:03:14.945457 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:14.945491 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:03:14.945502 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:14.945615 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:14.945671 (+ 56us) server_negotiation.cc:299] Negotiation successful
0809 13:03:14.945720 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 13:03:14.954854 4855 raft_consensus.cc:1261] T 887148b1f39644ffb7ed4a88f91ad7f5 P 495d99d01482436daad8465bd2488dc5 [term 1 FOLLOWER]: Refusing update from remote peer 739f6ee1af584d9e8fa180164e28ef42: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:03:14.954854 5126 raft_consensus.cc:1261] T 887148b1f39644ffb7ed4a88f91ad7f5 P a327f0fbdc6c4ff5b706fbe49e302d6d [term 1 FOLLOWER]: Refusing update from remote peer 739f6ee1af584d9e8fa180164e28ef42: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:03:14.955930 5261 consensus_queue.cc:1035] T 887148b1f39644ffb7ed4a88f91ad7f5 P 739f6ee1af584d9e8fa180164e28ef42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a327f0fbdc6c4ff5b706fbe49e302d6d" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 35919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:03:14.956333 5255 consensus_queue.cc:1035] T 887148b1f39644ffb7ed4a88f91ad7f5 P 739f6ee1af584d9e8fa180164e28ef42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "495d99d01482436daad8465bd2488dc5" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:03:14.968990 5265 mvcc.cc:205] Tried to move back new op lower bound from 7316605316923826176 to 7316605316766765056. Current Snapshot: MvccSnapshot[applied={T|T < 7316605316923826176}]
I20260809 13:03:14.984161 4375 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49544:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:03:14.984467 4375 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49544:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:03:14.988364 4375 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 604e5fb829704064b51fad47a5379458: Sending DeleteTablet for 3 replicas of tablet 887148b1f39644ffb7ed4a88f91ad7f5
I20260809 13:03:14.989790 4585 tablet_service.cc:1514] Processing DeleteTablet for tablet 887148b1f39644ffb7ed4a88f91ad7f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:03:14 UTC) from {username='slave'} at 127.0.0.1:40272
I20260809 13:03:14.989933 4819 tablet_service.cc:1514] Processing DeleteTablet for tablet 887148b1f39644ffb7ed4a88f91ad7f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:03:14 UTC) from {username='slave'} at 127.0.0.1:56398
I20260809 13:03:14.989997 5087 tablet_service.cc:1514] Processing DeleteTablet for tablet 887148b1f39644ffb7ed4a88f91ad7f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:03:14 UTC) from {username='slave'} at 127.0.0.1:47200
I20260809 13:03:14.992676 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 4474
I20260809 13:03:15.003340 5287 tablet_replica.cc:330] T 887148b1f39644ffb7ed4a88f91ad7f5 P a327f0fbdc6c4ff5b706fbe49e302d6d: stopping tablet replica
I20260809 13:03:15.004019 5287 raft_consensus.cc:2229] T 887148b1f39644ffb7ed4a88f91ad7f5 P a327f0fbdc6c4ff5b706fbe49e302d6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:03:15.004772 5287 raft_consensus.cc:2258] T 887148b1f39644ffb7ed4a88f91ad7f5 P a327f0fbdc6c4ff5b706fbe49e302d6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:03:15.010555 5287 ts_tablet_manager.cc:1905] T 887148b1f39644ffb7ed4a88f91ad7f5 P a327f0fbdc6c4ff5b706fbe49e302d6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:03:15.022010 5223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:14.994530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40288 (local address 127.28.155.193:44917)
0809 13:03:14.994743 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:14.994751 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:15.018297 (+ 23546us) server_negotiation.cc:407] Connection header received
0809 13:03:15.018939 (+ 642us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:15.018947 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:15.019028 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:15.019121 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:15.020827 (+ 1706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:15.020836 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:15.020844 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:03:15.020873 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:15.020928 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:03:15.020950 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:15.021102 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:15.021433 (+ 331us) server_negotiation.cc:299] Negotiation successful
0809 13:03:15.021525 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 13:03:15.023255 5285 tablet_replica.cc:330] T 887148b1f39644ffb7ed4a88f91ad7f5 P 495d99d01482436daad8465bd2488dc5: stopping tablet replica
I20260809 13:03:15.023388 4683 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:15.023881 5285 raft_consensus.cc:2229] T 887148b1f39644ffb7ed4a88f91ad7f5 P 495d99d01482436daad8465bd2488dc5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:03:15.024632 5285 raft_consensus.cc:2258] T 887148b1f39644ffb7ed4a88f91ad7f5 P 495d99d01482436daad8465bd2488dc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:03:15.027660 5285 ts_tablet_manager.cc:1905] T 887148b1f39644ffb7ed4a88f91ad7f5 P 495d99d01482436daad8465bd2488dc5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:03:15.028265 5287 ts_tablet_manager.cc:1918] T 887148b1f39644ffb7ed4a88f91ad7f5 P a327f0fbdc6c4ff5b706fbe49e302d6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:03:15.028625 5287 log.cc:1196] T 887148b1f39644ffb7ed4a88f91ad7f5 P a327f0fbdc6c4ff5b706fbe49e302d6d: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-2/wal/wals/887148b1f39644ffb7ed4a88f91ad7f5
I20260809 13:03:15.029418 5287 ts_tablet_manager.cc:1939] T 887148b1f39644ffb7ed4a88f91ad7f5 P a327f0fbdc6c4ff5b706fbe49e302d6d: Deleting consensus metadata
I20260809 13:03:15.032439 4347 catalog_manager.cc:4841] TS a327f0fbdc6c4ff5b706fbe49e302d6d (127.28.155.195:35919): tablet 887148b1f39644ffb7ed4a88f91ad7f5 (table test-table [id=a889a990af7343a4ba3aa3fd6264a67f]) successfully deleted
I20260809 13:03:15.038415 5285 ts_tablet_manager.cc:1918] T 887148b1f39644ffb7ed4a88f91ad7f5 P 495d99d01482436daad8465bd2488dc5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:03:15.038694 5285 log.cc:1196] T 887148b1f39644ffb7ed4a88f91ad7f5 P 495d99d01482436daad8465bd2488dc5: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786280548611909-29295-0/minicluster-data/ts-1/wal/wals/887148b1f39644ffb7ed4a88f91ad7f5
I20260809 13:03:15.039556 5285 ts_tablet_manager.cc:1939] T 887148b1f39644ffb7ed4a88f91ad7f5 P 495d99d01482436daad8465bd2488dc5: Deleting consensus metadata
I20260809 13:03:15.042349 4354 catalog_manager.cc:4841] TS 495d99d01482436daad8465bd2488dc5 (127.28.155.194:33427): tablet 887148b1f39644ffb7ed4a88f91ad7f5 (table test-table [id=a889a990af7343a4ba3aa3fd6264a67f]) successfully deleted
I20260809 13:03:15.147647 5282 tablet_replica.cc:330] T 887148b1f39644ffb7ed4a88f91ad7f5 P 739f6ee1af584d9e8fa180164e28ef42: stopping tablet replica
I20260809 13:03:15.148193 5282 raft_consensus.cc:2229] T 887148b1f39644ffb7ed4a88f91ad7f5 P 739f6ee1af584d9e8fa180164e28ef42 [term 1 LEADER]: Raft consensus shutting down.
I20260809 13:03:15.148939 5282 raft_consensus.cc:2258] T 887148b1f39644ffb7ed4a88f91ad7f5 P 739f6ee1af584d9e8fa180164e28ef42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:03:15.149716 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 4474
I20260809 13:03:15.176730 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 4707
W20260809 13:03:15.176652 4354 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.155.193:44917 (error 108)
I20260809 13:03:15.178874 5293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:15.178034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:44917 (local address 127.0.0.1:40290)
0809 13:03:15.178506 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:15.178627 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:44917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":237,"threads_started":1}
W20260809 13:03:15.179147 4354 catalog_manager.cc:4584] TS 739f6ee1af584d9e8fa180164e28ef42 (127.28.155.193:44917): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 887148b1f39644ffb7ed4a88f91ad7f5: Network error: Client connection negotiation failed: client connection to 127.28.155.193:44917: connect: Connection refused (error 111)
I20260809 13:03:15.180312 5228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:15.177727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56410 (local address 127.28.155.194:33427)
0809 13:03:15.177934 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:15.177943 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:15.177967 (+ 24us) server_negotiation.cc:407] Connection header received
0809 13:03:15.178040 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:15.178045 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:15.178185 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:15.178310 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:15.179774 (+ 1464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:15.179778 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:15.179781 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:03:15.179797 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:15.179829 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:03:15.179841 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:15.179946 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:15.180061 (+ 115us) server_negotiation.cc:299] Negotiation successful
0809 13:03:15.180110 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 13:03:15.181025 4938 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:15.232929 5293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:15.232356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:44917 (local address 127.0.0.1:40300)
0809 13:03:15.232631 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:15.232750 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:44917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260809 13:03:15.234113 5293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:15.233709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:44917 (local address 127.0.0.1:40314)
0809 13:03:15.233884 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:15.233959 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:44917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 13:03:15.271631 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 4707
I20260809 13:03:15.295379 5293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:15.294810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:44917 (local address 127.0.0.1:49024)
0809 13:03:15.295114 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:15.295219 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:44917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142}
I20260809 13:03:15.296597 5293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:15.296180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:44917 (local address 127.0.0.1:49026)
0809 13:03:15.296317 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:15.296385 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:44917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 13:03:15.300275 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 4948
I20260809 13:03:15.303344 5234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:15.301120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33096 (local address 127.28.155.195:35919)
0809 13:03:15.301297 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:15.301302 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:15.301322 (+ 20us) server_negotiation.cc:407] Connection header received
0809 13:03:15.301424 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:15.301428 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:15.301535 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:15.301621 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:15.302549 (+ 928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:15.302553 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:15.302557 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:03:15.302574 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:15.302609 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:03:15.302621 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:15.302797 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:15.302899 (+ 102us) server_negotiation.cc:299] Negotiation successful
0809 13:03:15.302967 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 13:03:15.304064 5195 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:15.377660 5293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:15.377042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:44917 (local address 127.0.0.1:49042)
0809 13:03:15.377349 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:15.377467 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:44917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260809 13:03:15.378876 5293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:15.378403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:44917 (local address 127.0.0.1:49046)
0809 13:03:15.378624 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:15.378711 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:44917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260809 13:03:15.400720 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 4948
I20260809 13:03:15.432898 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 4319
I20260809 13:03:15.434242 4420 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:15.547344 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 4319
2026-08-09T13:03:15Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (3083 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260809 13:03:15.599303 29295 mini_oidc.cc:152] Starting JWKS server
I20260809 13:03:15.602207 29295 webserver.cc:460] Webserver started at https://127.0.0.1:43441/ using document root <none> and password file <none>
I20260809 13:03:15.602545 29295 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 13:03:15.603210 29295 webserver.cc:460] Webserver started at http://127.0.0.1:44545/ using document root <none> and password file <none>
2026-08-09T13:03:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:03:15Z Disabled control of system clock
I20260809 13:03:15.641494 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:36945
--webserver_interface=127.28.155.254
--webserver_port=0
--builtin_ntp_servers=127.28.155.212:35465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:36945
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43441/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786280548611909-29295-0/testchainca.cert with env {}
W20260809 13:03:15.991748 5313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:15.992103 5313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:15.992271 5313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:15.999918 5313 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:03:16.000046 5313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:16.000118 5313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:16.000221 5313 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:03:16.000331 5313 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 13:03:16.000453 5313 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 13:03:16.000547 5313 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:43441/jwks.json
I20260809 13:03:16.011531 5313 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:35465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:36945
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:36945
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43441/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786280548611909-29295-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:16.013127 5313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:16.014562 5313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:16.027153 5321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:16.027354 5325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:16.027980 5322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:16.028352 5313 server_base.cc:1034] running on GCE node
I20260809 13:03:16.029291 5313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:16.030772 5313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:16.032017 5313 hybrid_clock.cc:648] HybridClock initialized: now 1786280596031961 us; error 27 us; skew 500 ppm
I20260809 13:03:16.032404 5313 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 13:03:16.034971 5313 webserver.cc:460] Webserver started at http://127.28.155.254:41465/ using document root <none> and password file <none>
I20260809 13:03:16.035738 5313 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:16.035866 5313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:16.036237 5313 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:16.039405 5313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "4eb8da465cd74136ace5e8e8166e1530"
format_stamp: "Formatted at 2026-08-09 13:03:16 on dist-test-slave-jq4t"
server_key: "3932be1bc5d3fbb91c2d18f66df17810"
server_key_iv: "b2f2d16c2e7b3856d82166555b9a9acb"
server_key_version: "encryptionkey@0"
I20260809 13:03:16.040266 5313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "4eb8da465cd74136ace5e8e8166e1530"
format_stamp: "Formatted at 2026-08-09 13:03:16 on dist-test-slave-jq4t"
server_key: "3932be1bc5d3fbb91c2d18f66df17810"
server_key_iv: "b2f2d16c2e7b3856d82166555b9a9acb"
server_key_version: "encryptionkey@0"
I20260809 13:03:16.045956 5313 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 13:03:16.049827 5334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:16.051366 5313 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:03:16.051596 5313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "4eb8da465cd74136ace5e8e8166e1530"
format_stamp: "Formatted at 2026-08-09 13:03:16 on dist-test-slave-jq4t"
server_key: "3932be1bc5d3fbb91c2d18f66df17810"
server_key_iv: "b2f2d16c2e7b3856d82166555b9a9acb"
server_key_version: "encryptionkey@0"
I20260809 13:03:16.051847 5313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:16.069005 5313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:16.069898 5313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:16.070233 5313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:16.089985 5313 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:36945
I20260809 13:03:16.090009 5429 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:36945 every 8 connection(s)
I20260809 13:03:16.091481 5313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:03:16.095276 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 5313
I20260809 13:03:16.095539 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:03:16.095584 5430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:16.096211 29295 external_mini_cluster.cc:1428] Setting key 13189431eff9d193360732dc47db523a
I20260809 13:03:16.112113 5430 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4eb8da465cd74136ace5e8e8166e1530: Bootstrap starting.
I20260809 13:03:16.112381 5433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:16.098262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49068 (local address 127.28.155.254:36945)
0809 13:03:16.099483 (+ 1221us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:16.099499 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:16.099568 (+ 69us) server_negotiation.cc:407] Connection header received
0809 13:03:16.101350 (+ 1782us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:16.101385 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:16.101999 (+ 614us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:16.102465 (+ 466us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:16.103073 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:16.105198 (+ 2125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:16.106601 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:16.107721 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:16.107922 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:16.109483 (+ 1561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:16.109495 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:16.109515 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:03:16.110264 (+ 749us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:16.110363 (+ 99us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:03:16.110391 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:16.110521 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:16.110694 (+ 173us) server_negotiation.cc:299] Negotiation successful
0809 13:03:16.111053 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":678,"thread_start_us":413,"threads_started":1}
I20260809 13:03:16.116338 5430 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4eb8da465cd74136ace5e8e8166e1530: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:16.116885 29295 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 13:03:16.117731 5430 log.cc:824] T 00000000000000000000000000000000 P 4eb8da465cd74136ace5e8e8166e1530: Log is configured to *not* fsync() on all Append() calls
I20260809 13:03:16.121183 5430 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4eb8da465cd74136ace5e8e8166e1530: No bootstrap required, opened a new log
I20260809 13:03:16.128773 5430 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4eb8da465cd74136ace5e8e8166e1530 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4eb8da465cd74136ace5e8e8166e1530" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 36945 } }
I20260809 13:03:16.129145 5430 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4eb8da465cd74136ace5e8e8166e1530 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:16.129223 5430 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4eb8da465cd74136ace5e8e8166e1530 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eb8da465cd74136ace5e8e8166e1530, State: Initialized, Role: FOLLOWER
I20260809 13:03:16.129721 5430 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4eb8da465cd74136ace5e8e8166e1530 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4eb8da465cd74136ace5e8e8166e1530" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 36945 } }
I20260809 13:03:16.129930 5430 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4eb8da465cd74136ace5e8e8166e1530 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:03:16.130035 5430 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4eb8da465cd74136ace5e8e8166e1530 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:03:16.130177 5430 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4eb8da465cd74136ace5e8e8166e1530 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:16.132548 5430 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4eb8da465cd74136ace5e8e8166e1530 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4eb8da465cd74136ace5e8e8166e1530" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 36945 } }
I20260809 13:03:16.133172 5430 leader_election.cc:302] T 00000000000000000000000000000000 P 4eb8da465cd74136ace5e8e8166e1530 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4eb8da465cd74136ace5e8e8166e1530; no voters:
I20260809 13:03:16.133801 5430 leader_election.cc:288] T 00000000000000000000000000000000 P 4eb8da465cd74136ace5e8e8166e1530 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:03:16.133989 5438 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4eb8da465cd74136ace5e8e8166e1530 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:03:16.134753 5438 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4eb8da465cd74136ace5e8e8166e1530 [term 1 LEADER]: Becoming Leader. State: Replica: 4eb8da465cd74136ace5e8e8166e1530, State: Running, Role: LEADER
I20260809 13:03:16.135349 5438 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4eb8da465cd74136ace5e8e8166e1530 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4eb8da465cd74136ace5e8e8166e1530" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 36945 } }
I20260809 13:03:16.136023 5430 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4eb8da465cd74136ace5e8e8166e1530 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:03:16.142195 5439 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4eb8da465cd74136ace5e8e8166e1530 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4eb8da465cd74136ace5e8e8166e1530" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4eb8da465cd74136ace5e8e8166e1530" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 36945 } } }
I20260809 13:03:16.142160 5441 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4eb8da465cd74136ace5e8e8166e1530 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4eb8da465cd74136ace5e8e8166e1530. Latest consensus state: current_term: 1 leader_uuid: "4eb8da465cd74136ace5e8e8166e1530" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4eb8da465cd74136ace5e8e8166e1530" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 36945 } } }
I20260809 13:03:16.142678 5439 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4eb8da465cd74136ace5e8e8166e1530 [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:16.142720 5441 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4eb8da465cd74136ace5e8e8166e1530 [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:16.144544 5468 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:03:16.149605 5468 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:03:16.159471 5468 catalog_manager.cc:1347] Generated new cluster ID: cd9b61e079ab443787a52e22310229ad
I20260809 13:03:16.159612 5468 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:03:16.173321 5468 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:03:16.174649 5468 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:03:16.182158 5468 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4eb8da465cd74136ace5e8e8166e1530: Generated new TSK 0
I20260809 13:03:16.183020 5468 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 13:03:16.229708 5486 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260809 13:03:16.229905 5486 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 13:03:16.232034 5433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:16.200274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49074 (local address 127.28.155.254:36945)
0809 13:03:16.200589 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:16.200598 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:16.201077 (+ 479us) server_negotiation.cc:407] Connection header received
0809 13:03:16.201548 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:16.201552 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:16.201632 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:16.201752 (+ 120us) server_negotiation.cc:226] Negotiated authn=JWT
0809 13:03:16.202482 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:16.203277 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:16.205606 (+ 2329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:16.206164 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:16.206281 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:16.206995 (+ 714us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 13:03:16.231435 (+ 24440us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43441/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 13:03:16.231774 (+ 339us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49074: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43441/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":97}
W20260809 13:03:16.232208 5433 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49074: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43441/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260809 13:03:16.234334 5483 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:16.200169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:36945 (local address 127.0.0.1:49074)
0809 13:03:16.200950 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:16.200972 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:16.201182 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:16.201833 (+ 651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:16.201839 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:16.201854 (+ 15us) client_negotiation.cc:189] Negotiated authn=JWT
0809 13:03:16.202315 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:16.202330 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:16.203427 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:16.203434 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:16.205408 (+ 1974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:16.205426 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:16.206378 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:16.206385 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:16.206588 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:16.206669 (+ 81us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 13:03:16.231809 (+ 25140us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43441/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 13:03:16.232209 (+ 400us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.28.155.254:36945: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43441/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":398,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.28.155.254:36945: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43441/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260809 13:03:16.236428 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 5313
I20260809 13:03:16.237730 5422 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:16.336467 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 5313
2026-08-09T13:03:16Z chronyd exiting
I20260809 13:03:16.398705 29295 test_util.cc:175] -----------------------------------------------
I20260809 13:03:16.398861 29295 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786280548611909-29295-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (804 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260809 13:03:16.402953 29295 mini_oidc.cc:152] Starting JWKS server
I20260809 13:03:16.404970 29295 webserver.cc:460] Webserver started at https://127.0.0.1:34133/ using document root <none> and password file <none>
I20260809 13:03:16.405192 29295 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 13:03:16.405830 29295 webserver.cc:460] Webserver started at http://127.0.0.1:41783/ using document root <none> and password file <none>
2026-08-09T13:03:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:03:16Z Disabled control of system clock
I20260809 13:03:16.443202 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:40827
--webserver_interface=127.28.155.254
--webserver_port=0
--builtin_ntp_servers=127.28.155.212:38857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:40827
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34133/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786280548611909-29295-0/testchainca.cert with env {}
W20260809 13:03:16.792445 5500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:16.792863 5500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:16.793045 5500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:16.800386 5500 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:03:16.800594 5500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:16.800696 5500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:16.800813 5500 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:03:16.800910 5500 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 13:03:16.801020 5500 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 13:03:16.801102 5500 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34133/jwks.json
I20260809 13:03:16.811741 5500 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:38857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:40827
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:40827
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34133/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786280548611909-29295-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:16.813205 5500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:16.814613 5500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:16.827250 5510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:16.827301 5512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:16.827333 5517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:16.828222 5500 server_base.cc:1034] running on GCE node
I20260809 13:03:16.829190 5500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:16.830722 5500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:16.831992 5500 hybrid_clock.cc:648] HybridClock initialized: now 1786280596831941 us; error 46 us; skew 500 ppm
I20260809 13:03:16.832376 5500 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 13:03:16.834834 5500 webserver.cc:460] Webserver started at http://127.28.155.254:32841/ using document root <none> and password file <none>
I20260809 13:03:16.835585 5500 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:16.835729 5500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:16.836100 5500 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:16.839231 5500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "2c5e3cae59f74f908fe33c47c222bd2a"
format_stamp: "Formatted at 2026-08-09 13:03:16 on dist-test-slave-jq4t"
server_key: "56caeeca8b095b4c1580c9f755cb7cfd"
server_key_iv: "55007d82a0b0337988c8270b0e99a857"
server_key_version: "encryptionkey@0"
I20260809 13:03:16.840077 5500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "2c5e3cae59f74f908fe33c47c222bd2a"
format_stamp: "Formatted at 2026-08-09 13:03:16 on dist-test-slave-jq4t"
server_key: "56caeeca8b095b4c1580c9f755cb7cfd"
server_key_iv: "55007d82a0b0337988c8270b0e99a857"
server_key_version: "encryptionkey@0"
I20260809 13:03:16.846832 5500 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.004s
I20260809 13:03:16.850495 5528 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:16.852030 5500 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 13:03:16.852326 5500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "2c5e3cae59f74f908fe33c47c222bd2a"
format_stamp: "Formatted at 2026-08-09 13:03:16 on dist-test-slave-jq4t"
server_key: "56caeeca8b095b4c1580c9f755cb7cfd"
server_key_iv: "55007d82a0b0337988c8270b0e99a857"
server_key_version: "encryptionkey@0"
I20260809 13:03:16.852654 5500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:16.877843 5500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:16.878755 5500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:16.879106 5500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:16.898751 5500 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:40827
I20260809 13:03:16.898759 5621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:40827 every 8 connection(s)
I20260809 13:03:16.900187 5500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:03:16.904141 5622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:16.907514 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 5500
I20260809 13:03:16.907747 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:03:16.908680 29295 external_mini_cluster.cc:1428] Setting key 7ce0c4e0a12371663faae3dd7fe156d7
I20260809 13:03:16.917461 5622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c5e3cae59f74f908fe33c47c222bd2a: Bootstrap starting.
I20260809 13:03:16.920940 5622 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2c5e3cae59f74f908fe33c47c222bd2a: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:16.922187 5622 log.cc:824] T 00000000000000000000000000000000 P 2c5e3cae59f74f908fe33c47c222bd2a: Log is configured to *not* fsync() on all Append() calls
I20260809 13:03:16.923339 5625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:16.910912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43208 (local address 127.28.155.254:40827)
0809 13:03:16.911996 (+ 1084us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:16.912008 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:16.912054 (+ 46us) server_negotiation.cc:407] Connection header received
0809 13:03:16.913901 (+ 1847us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:16.913931 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:16.914424 (+ 493us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:16.914833 (+ 409us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:16.915442 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:16.916852 (+ 1410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:16.918284 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:16.919009 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:16.919216 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:16.920559 (+ 1343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:16.920567 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:16.920582 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:03:16.921200 (+ 618us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:16.921305 (+ 105us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:03:16.921330 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:16.921477 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:16.921740 (+ 263us) server_negotiation.cc:299] Negotiation successful
0809 13:03:16.922060 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":625,"thread_start_us":397,"threads_started":1}
I20260809 13:03:16.925607 5622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c5e3cae59f74f908fe33c47c222bd2a: No bootstrap required, opened a new log
I20260809 13:03:16.927508 29295 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 13:03:16.934983 5622 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2c5e3cae59f74f908fe33c47c222bd2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c5e3cae59f74f908fe33c47c222bd2a" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 40827 } }
I20260809 13:03:16.935426 5622 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2c5e3cae59f74f908fe33c47c222bd2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:16.935508 5622 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2c5e3cae59f74f908fe33c47c222bd2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c5e3cae59f74f908fe33c47c222bd2a, State: Initialized, Role: FOLLOWER
I20260809 13:03:16.936008 5622 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c5e3cae59f74f908fe33c47c222bd2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c5e3cae59f74f908fe33c47c222bd2a" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 40827 } }
I20260809 13:03:16.936225 5622 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2c5e3cae59f74f908fe33c47c222bd2a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:03:16.936332 5622 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2c5e3cae59f74f908fe33c47c222bd2a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:03:16.936453 5622 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2c5e3cae59f74f908fe33c47c222bd2a [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:16.938776 5622 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2c5e3cae59f74f908fe33c47c222bd2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c5e3cae59f74f908fe33c47c222bd2a" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 40827 } }
I20260809 13:03:16.939263 5622 leader_election.cc:302] T 00000000000000000000000000000000 P 2c5e3cae59f74f908fe33c47c222bd2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2c5e3cae59f74f908fe33c47c222bd2a; no voters:
I20260809 13:03:16.939822 5622 leader_election.cc:288] T 00000000000000000000000000000000 P 2c5e3cae59f74f908fe33c47c222bd2a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:03:16.940039 5627 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2c5e3cae59f74f908fe33c47c222bd2a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:03:16.940999 5627 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2c5e3cae59f74f908fe33c47c222bd2a [term 1 LEADER]: Becoming Leader. State: Replica: 2c5e3cae59f74f908fe33c47c222bd2a, State: Running, Role: LEADER
I20260809 13:03:16.941668 5627 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c5e3cae59f74f908fe33c47c222bd2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c5e3cae59f74f908fe33c47c222bd2a" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 40827 } }
I20260809 13:03:16.942294 5622 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2c5e3cae59f74f908fe33c47c222bd2a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:03:16.944814 5628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c5e3cae59f74f908fe33c47c222bd2a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2c5e3cae59f74f908fe33c47c222bd2a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c5e3cae59f74f908fe33c47c222bd2a" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 40827 } } }
I20260809 13:03:16.945261 5628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c5e3cae59f74f908fe33c47c222bd2a [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:16.945533 5629 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c5e3cae59f74f908fe33c47c222bd2a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c5e3cae59f74f908fe33c47c222bd2a. Latest consensus state: current_term: 1 leader_uuid: "2c5e3cae59f74f908fe33c47c222bd2a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c5e3cae59f74f908fe33c47c222bd2a" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 40827 } } }
I20260809 13:03:16.946117 5629 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c5e3cae59f74f908fe33c47c222bd2a [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:16.949267 5640 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:03:16.955076 5640 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:03:16.964680 5640 catalog_manager.cc:1347] Generated new cluster ID: 652000963b284962b48b0f4f114265ab
I20260809 13:03:16.964808 5640 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:03:16.980727 5640 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:03:16.982123 5640 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:03:16.990944 5640 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2c5e3cae59f74f908fe33c47c222bd2a: Generated new TSK 0
I20260809 13:03:16.991798 5640 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 13:03:17.029925 5673 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260809 13:03:17.030079 5673 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 13:03:17.031472 5625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:17.010166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43218 (local address 127.28.155.254:40827)
0809 13:03:17.010377 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:17.010384 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:17.010736 (+ 352us) server_negotiation.cc:407] Connection header received
0809 13:03:17.010983 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:17.010989 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:17.011102 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:17.011276 (+ 174us) server_negotiation.cc:226] Negotiated authn=JWT
0809 13:03:17.011775 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:17.012953 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:17.014412 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:17.015139 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:17.015280 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:17.015798 (+ 518us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 13:03:17.030690 (+ 14892us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34133/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 13:03:17.031139 (+ 449us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43218: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34133/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":70}
W20260809 13:03:17.031608 5625 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43218: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34133/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260809 13:03:17.031899 5669 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:17.010000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:40827 (local address 127.0.0.1:43218)
0809 13:03:17.010623 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:17.010644 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:17.010769 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:17.011314 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:17.011318 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:17.011329 (+ 11us) client_negotiation.cc:189] Negotiated authn=JWT
0809 13:03:17.011590 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:17.011598 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:17.013101 (+ 1503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:17.013105 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:17.014249 (+ 1144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:17.014260 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:17.015304 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:17.015309 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:17.015446 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:17.015479 (+ 33us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 13:03:17.031035 (+ 15556us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34133/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 13:03:17.031441 (+ 406us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.28.155.254:40827: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34133/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":341,"threads_started":1}
I20260809 13:03:17.033181 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 5500
I20260809 13:03:17.034500 5613 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:17.130693 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 5500
2026-08-09T13:03:17Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (794 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260809 13:03:17.197737 29295 mini_oidc.cc:152] Starting JWKS server
I20260809 13:03:17.199702 29295 webserver.cc:460] Webserver started at https://127.0.0.1:41155/ using document root <none> and password file <none>
I20260809 13:03:17.200004 29295 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 13:03:17.200687 29295 webserver.cc:460] Webserver started at http://127.0.0.1:41569/ using document root <none> and password file <none>
2026-08-09T13:03:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:03:17Z Disabled control of system clock
I20260809 13:03:17.237730 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:43325
--webserver_interface=127.28.155.254
--webserver_port=0
--builtin_ntp_servers=127.28.155.212:45961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:43325
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41155/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 13:03:17.588165 5685 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:17.588536 5685 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:17.588690 5685 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:17.596269 5685 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:03:17.596405 5685 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:17.596446 5685 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:17.596573 5685 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:03:17.596640 5685 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 13:03:17.596707 5685 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 13:03:17.596755 5685 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41155/jwks.json
I20260809 13:03:17.607301 5685 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:45961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:43325
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:43325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41155/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:17.608807 5685 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:17.610740 5685 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:17.623296 5696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:17.623436 5701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:17.623492 5698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:17.624440 5685 server_base.cc:1034] running on GCE node
I20260809 13:03:17.625304 5685 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:17.626852 5685 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:17.628096 5685 hybrid_clock.cc:648] HybridClock initialized: now 1786280597628039 us; error 53 us; skew 500 ppm
I20260809 13:03:17.628520 5685 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 13:03:17.633908 5685 webserver.cc:460] Webserver started at http://127.28.155.254:35095/ using document root <none> and password file <none>
I20260809 13:03:17.634698 5685 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:17.634848 5685 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:17.635233 5685 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:17.638446 5685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "21fd8bfbd9394bfe95f25a3204fd0492"
format_stamp: "Formatted at 2026-08-09 13:03:17 on dist-test-slave-jq4t"
server_key: "46c78ff771b0b890adea68a1201352e4"
server_key_iv: "f0a33c9c5b9acc2108f21b928bdf7ba2"
server_key_version: "encryptionkey@0"
I20260809 13:03:17.639341 5685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "21fd8bfbd9394bfe95f25a3204fd0492"
format_stamp: "Formatted at 2026-08-09 13:03:17 on dist-test-slave-jq4t"
server_key: "46c78ff771b0b890adea68a1201352e4"
server_key_iv: "f0a33c9c5b9acc2108f21b928bdf7ba2"
server_key_version: "encryptionkey@0"
I20260809 13:03:17.644930 5685 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 13:03:17.648636 5711 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:17.650126 5685 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:03:17.650336 5685 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "21fd8bfbd9394bfe95f25a3204fd0492"
format_stamp: "Formatted at 2026-08-09 13:03:17 on dist-test-slave-jq4t"
server_key: "46c78ff771b0b890adea68a1201352e4"
server_key_iv: "f0a33c9c5b9acc2108f21b928bdf7ba2"
server_key_version: "encryptionkey@0"
I20260809 13:03:17.650595 5685 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:17.676045 5685 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:17.677065 5685 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:17.677438 5685 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:17.698278 5685 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:43325
I20260809 13:03:17.698300 5795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:43325 every 8 connection(s)
I20260809 13:03:17.699756 5685 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:03:17.701155 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 5685
I20260809 13:03:17.701399 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:03:17.702250 29295 external_mini_cluster.cc:1428] Setting key 6ceda5dd5b9a92ba87c0428b0a3978ce
I20260809 13:03:17.704998 5796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:17.717585 5801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:17.704431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40140 (local address 127.28.155.254:43325)
0809 13:03:17.705870 (+ 1439us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:17.705882 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:17.706003 (+ 121us) server_negotiation.cc:407] Connection header received
0809 13:03:17.707842 (+ 1839us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:17.707864 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:17.708323 (+ 459us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:17.708749 (+ 426us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:17.709368 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:17.710729 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:17.712757 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:17.713427 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:17.713578 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:17.714959 (+ 1381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:17.714968 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:17.714985 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:03:17.715607 (+ 622us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:17.715681 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:03:17.715702 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:17.715808 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:17.716063 (+ 255us) server_negotiation.cc:299] Negotiation successful
0809 13:03:17.716456 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":840,"thread_start_us":531,"threads_started":1}
I20260809 13:03:17.718871 5796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21fd8bfbd9394bfe95f25a3204fd0492: Bootstrap starting.
I20260809 13:03:17.721726 29295 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 13:03:17.722532 5796 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 21fd8bfbd9394bfe95f25a3204fd0492: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:17.723654 5796 log.cc:824] T 00000000000000000000000000000000 P 21fd8bfbd9394bfe95f25a3204fd0492: Log is configured to *not* fsync() on all Append() calls
I20260809 13:03:17.727067 5796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21fd8bfbd9394bfe95f25a3204fd0492: No bootstrap required, opened a new log
I20260809 13:03:17.735272 5796 raft_consensus.cc:348] T 00000000000000000000000000000000 P 21fd8bfbd9394bfe95f25a3204fd0492 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21fd8bfbd9394bfe95f25a3204fd0492" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 43325 } }
I20260809 13:03:17.735734 5796 raft_consensus.cc:374] T 00000000000000000000000000000000 P 21fd8bfbd9394bfe95f25a3204fd0492 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:17.735862 5796 raft_consensus.cc:729] T 00000000000000000000000000000000 P 21fd8bfbd9394bfe95f25a3204fd0492 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21fd8bfbd9394bfe95f25a3204fd0492, State: Initialized, Role: FOLLOWER
I20260809 13:03:17.736585 5796 consensus_queue.cc:260] T 00000000000000000000000000000000 P 21fd8bfbd9394bfe95f25a3204fd0492 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21fd8bfbd9394bfe95f25a3204fd0492" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 43325 } }
I20260809 13:03:17.736855 5796 raft_consensus.cc:388] T 00000000000000000000000000000000 P 21fd8bfbd9394bfe95f25a3204fd0492 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:03:17.737042 5796 raft_consensus.cc:482] T 00000000000000000000000000000000 P 21fd8bfbd9394bfe95f25a3204fd0492 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:03:17.737231 5796 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 21fd8bfbd9394bfe95f25a3204fd0492 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:17.740038 5796 raft_consensus.cc:504] T 00000000000000000000000000000000 P 21fd8bfbd9394bfe95f25a3204fd0492 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21fd8bfbd9394bfe95f25a3204fd0492" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 43325 } }
I20260809 13:03:17.740777 5796 leader_election.cc:302] T 00000000000000000000000000000000 P 21fd8bfbd9394bfe95f25a3204fd0492 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 21fd8bfbd9394bfe95f25a3204fd0492; no voters:
I20260809 13:03:17.741380 5796 leader_election.cc:288] T 00000000000000000000000000000000 P 21fd8bfbd9394bfe95f25a3204fd0492 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:03:17.741571 5803 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 21fd8bfbd9394bfe95f25a3204fd0492 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:03:17.742347 5803 raft_consensus.cc:686] T 00000000000000000000000000000000 P 21fd8bfbd9394bfe95f25a3204fd0492 [term 1 LEADER]: Becoming Leader. State: Replica: 21fd8bfbd9394bfe95f25a3204fd0492, State: Running, Role: LEADER
I20260809 13:03:17.743034 5803 consensus_queue.cc:237] T 00000000000000000000000000000000 P 21fd8bfbd9394bfe95f25a3204fd0492 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21fd8bfbd9394bfe95f25a3204fd0492" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 43325 } }
I20260809 13:03:17.743811 5796 sys_catalog.cc:564] T 00000000000000000000000000000000 P 21fd8bfbd9394bfe95f25a3204fd0492 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:03:17.746419 5809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21fd8bfbd9394bfe95f25a3204fd0492 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21fd8bfbd9394bfe95f25a3204fd0492. Latest consensus state: current_term: 1 leader_uuid: "21fd8bfbd9394bfe95f25a3204fd0492" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21fd8bfbd9394bfe95f25a3204fd0492" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 43325 } } }
I20260809 13:03:17.747998 5809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21fd8bfbd9394bfe95f25a3204fd0492 [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:17.747279 5806 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21fd8bfbd9394bfe95f25a3204fd0492 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "21fd8bfbd9394bfe95f25a3204fd0492" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21fd8bfbd9394bfe95f25a3204fd0492" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 43325 } } }
I20260809 13:03:17.748926 5806 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21fd8bfbd9394bfe95f25a3204fd0492 [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:17.754160 5823 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:03:17.759356 5823 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:03:17.769733 5823 catalog_manager.cc:1347] Generated new cluster ID: 39a890c256ff4e208836df1f8ac9500e
I20260809 13:03:17.769876 5823 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:03:17.790066 5823 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:03:17.792160 5823 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:03:17.802376 5823 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 21fd8bfbd9394bfe95f25a3204fd0492: Generated new TSK 0
I20260809 13:03:17.803683 5823 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 13:03:17.831164 5801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:17.822618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40152 (local address 127.28.155.254:43325)
0809 13:03:17.822942 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:17.822952 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:17.823598 (+ 646us) server_negotiation.cc:407] Connection header received
0809 13:03:17.823892 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:17.823896 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:17.823983 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:17.824171 (+ 188us) server_negotiation.cc:226] Negotiated authn=JWT
0809 13:03:17.824786 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:17.825575 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:17.826992 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:17.827491 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:17.827643 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:17.828229 (+ 586us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 13:03:17.830395 (+ 2166us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41155/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 13:03:17.830795 (+ 400us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:40152: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41155/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":64}
W20260809 13:03:17.831347 5801 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:40152: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41155/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260809 13:03:17.831754 5854 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:17.822441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:43325 (local address 127.0.0.1:40152)
0809 13:03:17.823478 (+ 1037us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:17.823496 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:17.823683 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:17.824193 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:17.824198 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:17.824211 (+ 13us) client_negotiation.cc:189] Negotiated authn=JWT
0809 13:03:17.824605 (+ 394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:17.824616 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:17.825736 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:17.825742 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:17.826835 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:17.826847 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:17.827715 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:17.827723 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:17.827891 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:17.827927 (+ 36us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 13:03:17.830627 (+ 2700us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41155/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 13:03:17.830927 (+ 300us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.28.155.254:43325: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41155/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":891,"thread_start_us":721,"threads_started":1}
I20260809 13:03:17.832772 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 5685
I20260809 13:03:17.834350 5789 generic_service.cc:196] Checking for leaks (request via RPC)
E20260809 13:03:17.844367 5855 webserver.cc:533] Webserver: sslize failed:
E20260809 13:03:17.844534 5855 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 13:03:17.931766 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 5685
2026-08-09T13:03:17Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (801 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-09T13:03:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:03:18Z Disabled control of system clock
I20260809 13:03:18.038062 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:35385
--webserver_interface=127.28.155.254
--webserver_port=0
--builtin_ntp_servers=127.28.155.212:36453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:35385
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786280548611909-29295-0/testchainca.cert with env {}
W20260809 13:03:18.399338 5864 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:18.399699 5864 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:18.399796 5864 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:18.407538 5864 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:03:18.407677 5864 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:18.407718 5864 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:18.407773 5864 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:03:18.407833 5864 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 13:03:18.407905 5864 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 13:03:18.407941 5864 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260809 13:03:18.419602 5864 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:36453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:35385
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:35385
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786280548611909-29295-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:18.421209 5864 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:18.422660 5864 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:18.435546 5873 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:18.435531 5875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:18.435684 5880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:18.436506 5864 server_base.cc:1034] running on GCE node
I20260809 13:03:18.437479 5864 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:18.439123 5864 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:18.440373 5864 hybrid_clock.cc:648] HybridClock initialized: now 1786280598440326 us; error 45 us; skew 500 ppm
I20260809 13:03:18.440796 5864 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 13:03:18.443313 5864 webserver.cc:460] Webserver started at http://127.28.155.254:44645/ using document root <none> and password file <none>
I20260809 13:03:18.444114 5864 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:18.444264 5864 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:18.444684 5864 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:18.447758 5864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "9cd2dcd8dd624ff397ec6ffc4516a1e5"
format_stamp: "Formatted at 2026-08-09 13:03:18 on dist-test-slave-jq4t"
server_key: "28ed8a300c3e68d89a5031c58839797d"
server_key_iv: "b7c736fb8f47a03f585969e27d042f87"
server_key_version: "encryptionkey@0"
I20260809 13:03:18.448684 5864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "9cd2dcd8dd624ff397ec6ffc4516a1e5"
format_stamp: "Formatted at 2026-08-09 13:03:18 on dist-test-slave-jq4t"
server_key: "28ed8a300c3e68d89a5031c58839797d"
server_key_iv: "b7c736fb8f47a03f585969e27d042f87"
server_key_version: "encryptionkey@0"
I20260809 13:03:18.454103 5864 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260809 13:03:18.458055 5890 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:18.459751 5864 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260809 13:03:18.459957 5864 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "9cd2dcd8dd624ff397ec6ffc4516a1e5"
format_stamp: "Formatted at 2026-08-09 13:03:18 on dist-test-slave-jq4t"
server_key: "28ed8a300c3e68d89a5031c58839797d"
server_key_iv: "b7c736fb8f47a03f585969e27d042f87"
server_key_version: "encryptionkey@0"
I20260809 13:03:18.460207 5864 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:18.474864 5864 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:18.475756 5864 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:18.476073 5864 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:18.496822 5864 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:35385
I20260809 13:03:18.496845 5966 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:35385 every 8 connection(s)
I20260809 13:03:18.498287 5864 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:03:18.502331 5967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:18.504227 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 5864
I20260809 13:03:18.504441 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:03:18.505332 29295 external_mini_cluster.cc:1428] Setting key 02c7a01a261442f2b07a1befa2135357
I20260809 13:03:18.516801 5967 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9cd2dcd8dd624ff397ec6ffc4516a1e5: Bootstrap starting.
I20260809 13:03:18.519313 5971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:18.507361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53378 (local address 127.28.155.254:35385)
0809 13:03:18.508408 (+ 1047us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:18.508421 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:18.508463 (+ 42us) server_negotiation.cc:407] Connection header received
0809 13:03:18.510174 (+ 1711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:18.510196 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:18.510651 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:18.511058 (+ 407us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:18.511625 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:18.512938 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:18.514338 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:18.515158 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:18.515367 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:18.516760 (+ 1393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:18.516767 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:18.516781 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:03:18.517414 (+ 633us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:18.517504 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:03:18.517533 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:18.517665 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:18.517926 (+ 261us) server_negotiation.cc:299] Negotiation successful
0809 13:03:18.518294 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":620,"thread_start_us":385,"threads_started":1}
I20260809 13:03:18.520591 5967 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9cd2dcd8dd624ff397ec6ffc4516a1e5: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:18.522094 5967 log.cc:824] T 00000000000000000000000000000000 P 9cd2dcd8dd624ff397ec6ffc4516a1e5: Log is configured to *not* fsync() on all Append() calls
I20260809 13:03:18.523768 29295 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 13:03:18.525413 5967 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9cd2dcd8dd624ff397ec6ffc4516a1e5: No bootstrap required, opened a new log
I20260809 13:03:18.534341 5967 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9cd2dcd8dd624ff397ec6ffc4516a1e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cd2dcd8dd624ff397ec6ffc4516a1e5" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 35385 } }
I20260809 13:03:18.534763 5967 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9cd2dcd8dd624ff397ec6ffc4516a1e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:18.534866 5967 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9cd2dcd8dd624ff397ec6ffc4516a1e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cd2dcd8dd624ff397ec6ffc4516a1e5, State: Initialized, Role: FOLLOWER
I20260809 13:03:18.535477 5967 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9cd2dcd8dd624ff397ec6ffc4516a1e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cd2dcd8dd624ff397ec6ffc4516a1e5" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 35385 } }
I20260809 13:03:18.535723 5967 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9cd2dcd8dd624ff397ec6ffc4516a1e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:03:18.535883 5967 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9cd2dcd8dd624ff397ec6ffc4516a1e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:03:18.536087 5967 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9cd2dcd8dd624ff397ec6ffc4516a1e5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:18.538411 5967 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9cd2dcd8dd624ff397ec6ffc4516a1e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cd2dcd8dd624ff397ec6ffc4516a1e5" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 35385 } }
I20260809 13:03:18.538967 5967 leader_election.cc:302] T 00000000000000000000000000000000 P 9cd2dcd8dd624ff397ec6ffc4516a1e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9cd2dcd8dd624ff397ec6ffc4516a1e5; no voters:
I20260809 13:03:18.539626 5967 leader_election.cc:288] T 00000000000000000000000000000000 P 9cd2dcd8dd624ff397ec6ffc4516a1e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:03:18.539801 5974 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9cd2dcd8dd624ff397ec6ffc4516a1e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:03:18.540576 5974 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9cd2dcd8dd624ff397ec6ffc4516a1e5 [term 1 LEADER]: Becoming Leader. State: Replica: 9cd2dcd8dd624ff397ec6ffc4516a1e5, State: Running, Role: LEADER
I20260809 13:03:18.541100 5974 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9cd2dcd8dd624ff397ec6ffc4516a1e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cd2dcd8dd624ff397ec6ffc4516a1e5" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 35385 } }
I20260809 13:03:18.542188 5967 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9cd2dcd8dd624ff397ec6ffc4516a1e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:03:18.544178 5977 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9cd2dcd8dd624ff397ec6ffc4516a1e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9cd2dcd8dd624ff397ec6ffc4516a1e5. Latest consensus state: current_term: 1 leader_uuid: "9cd2dcd8dd624ff397ec6ffc4516a1e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cd2dcd8dd624ff397ec6ffc4516a1e5" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 35385 } } }
I20260809 13:03:18.544206 5975 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9cd2dcd8dd624ff397ec6ffc4516a1e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9cd2dcd8dd624ff397ec6ffc4516a1e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cd2dcd8dd624ff397ec6ffc4516a1e5" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 35385 } } }
I20260809 13:03:18.544644 5975 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9cd2dcd8dd624ff397ec6ffc4516a1e5 [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:18.544644 5977 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9cd2dcd8dd624ff397ec6ffc4516a1e5 [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:18.547247 5981 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:03:18.552841 5981 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:03:18.562774 5981 catalog_manager.cc:1347] Generated new cluster ID: 5589851342454ed3b0ca952d1906a7d9
I20260809 13:03:18.562922 5981 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:03:18.585414 5981 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:03:18.587373 5981 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:03:18.600627 5981 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9cd2dcd8dd624ff397ec6ffc4516a1e5: Generated new TSK 0
I20260809 13:03:18.601830 5981 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 13:03:18.673851 5971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:18.618810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53380 (local address 127.28.155.254:35385)
0809 13:03:18.619030 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:18.619037 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:18.619415 (+ 378us) server_negotiation.cc:407] Connection header received
0809 13:03:18.619640 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:18.619647 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:18.619760 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:18.619934 (+ 174us) server_negotiation.cc:226] Negotiated authn=JWT
0809 13:03:18.620411 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:18.621647 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:18.623082 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:18.623814 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:18.623953 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:18.624507 (+ 554us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 13:03:18.673046 (+ 48539us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 13:03:18.673503 (+ 457us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53380: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":83}
W20260809 13:03:18.674037 5971 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53380: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260809 13:03:18.674017 6015 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:18.618634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:35385 (local address 127.0.0.1:53380)
0809 13:03:18.619303 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:18.619320 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:18.619450 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:18.619955 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:18.619958 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:18.619968 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0809 13:03:18.620254 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:18.620262 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:18.621807 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:18.621812 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:18.622925 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:18.622937 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:18.623995 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:18.623999 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:18.624132 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:18.624169 (+ 37us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 13:03:18.673380 (+ 49211us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 13:03:18.673665 (+ 285us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.28.155.254:35385: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":347,"threads_started":1}
I20260809 13:03:18.675487 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 5864
I20260809 13:03:18.677055 5961 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:18.780805 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 5864
2026-08-09T13:03:18Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (824 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (445 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (1612 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:03:20 dist-test-slave-jq4t krb5kdc[6045](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:03:20 dist-test-slave-jq4t krb5kdc[6045](info): set up 2 sockets
Aug 09 13:03:20 dist-test-slave-jq4t krb5kdc[6045](info): commencing operation
krb5kdc: starting...
W20260809 13:03:22.182076 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.299s user 0.004s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:03:22 dist-test-slave-jq4t krb5kdc[6045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280602, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:03:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:03:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
I20260809 13:03:22.458372 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:40147
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:37475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:40147
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:22.819330 6079 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:22.819756 6079 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:22.819944 6079 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:22.827841 6079 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:03:22.828052 6079 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:22.828169 6079 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:22.828277 6079 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:03:22.828363 6079 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:03:22.839054 6079 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:37475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:40147
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:40147
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:22.840682 6079 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:22.842133 6079 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:22.855118 6089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:22.855194 6090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:22.855149 6102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:22.856391 6079 server_base.cc:1034] running on GCE node
I20260809 13:03:22.857328 6079 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:22.858911 6079 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:22.860210 6079 hybrid_clock.cc:648] HybridClock initialized: now 1786280602860164 us; error 67 us; skew 500 ppm
I20260809 13:03:22.860697 6079 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:22 dist-test-slave-jq4t krb5kdc[6045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280602, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:22.867012 6079 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:03:22.868840 6079 webserver.cc:460] Webserver started at http://127.28.155.254:35645/ using document root <none> and password file <none>
I20260809 13:03:22.869638 6079 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:22.869802 6079 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:22.870168 6079 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:22.873735 6079 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "100409eec63e493daeca3fdbf0478a47"
format_stamp: "Formatted at 2026-08-09 13:03:22 on dist-test-slave-jq4t"
server_key: "6dead263f6a8d51a49bd25125dcd9e52"
server_key_iv: "b015977056efdcfa42d025f8b0ad8abd"
server_key_version: "encryptionkey@0"
I20260809 13:03:22.874603 6079 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "100409eec63e493daeca3fdbf0478a47"
format_stamp: "Formatted at 2026-08-09 13:03:22 on dist-test-slave-jq4t"
server_key: "6dead263f6a8d51a49bd25125dcd9e52"
server_key_iv: "b015977056efdcfa42d025f8b0ad8abd"
server_key_version: "encryptionkey@0"
I20260809 13:03:22.880389 6079 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260809 13:03:22.884374 6116 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:22.886315 6079 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260809 13:03:22.886482 6079 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "100409eec63e493daeca3fdbf0478a47"
format_stamp: "Formatted at 2026-08-09 13:03:22 on dist-test-slave-jq4t"
server_key: "6dead263f6a8d51a49bd25125dcd9e52"
server_key_iv: "b015977056efdcfa42d025f8b0ad8abd"
server_key_version: "encryptionkey@0"
I20260809 13:03:22.886713 6079 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:22.899891 6079 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:22.904769 6079 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:22.905048 6079 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:22.924606 6079 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:40147
I20260809 13:03:22.924572 6216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:40147 every 8 connection(s)
I20260809 13:03:22.926386 6079 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:03:22.930516 6218 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:22.936496 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 6079
I20260809 13:03:22.936749 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:03:22.937623 29295 external_mini_cluster.cc:1428] Setting key 47c0f849dc82ff3063970f3877e7b478
I20260809 13:03:22.943173 6218 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 100409eec63e493daeca3fdbf0478a47: Bootstrap starting.
I20260809 13:03:22.946465 6218 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 100409eec63e493daeca3fdbf0478a47: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:22.947611 6218 log.cc:824] T 00000000000000000000000000000000 P 100409eec63e493daeca3fdbf0478a47: Log is configured to *not* fsync() on all Append() calls
I20260809 13:03:22.950713 6218 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 100409eec63e493daeca3fdbf0478a47: No bootstrap required, opened a new log
Aug 09 13:03:22 dist-test-slave-jq4t krb5kdc[6045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280602, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:03:22.961539 6218 raft_consensus.cc:348] T 00000000000000000000000000000000 P 100409eec63e493daeca3fdbf0478a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "100409eec63e493daeca3fdbf0478a47" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 40147 } }
I20260809 13:03:22.962109 6218 raft_consensus.cc:374] T 00000000000000000000000000000000 P 100409eec63e493daeca3fdbf0478a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:22.962250 6218 raft_consensus.cc:729] T 00000000000000000000000000000000 P 100409eec63e493daeca3fdbf0478a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 100409eec63e493daeca3fdbf0478a47, State: Initialized, Role: FOLLOWER
I20260809 13:03:22.963022 6218 consensus_queue.cc:260] T 00000000000000000000000000000000 P 100409eec63e493daeca3fdbf0478a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "100409eec63e493daeca3fdbf0478a47" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 40147 } }
I20260809 13:03:22.963294 6226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:22.940053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36588 (local address 127.28.155.254:40147)
0809 13:03:22.941014 (+ 961us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:22.941030 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:22.941086 (+ 56us) server_negotiation.cc:407] Connection header received
0809 13:03:22.942932 (+ 1846us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:22.942956 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:22.943431 (+ 475us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:22.943830 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:22.945432 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:22.946835 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:22.948212 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:22.949027 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:22.949255 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:22.953627 (+ 4372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:22.953644 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:22.953666 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:22.953720 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:22.958083 (+ 4363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:22.958846 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:22.958861 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:22.958872 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:22.959132 (+ 260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:22.959504 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:22.959509 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:22.959513 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:22.960396 (+ 883us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:22.960744 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:22.961170 (+ 426us) server_negotiation.cc:299] Negotiation successful
0809 13:03:22.961675 (+ 505us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":735,"thread_start_us":492,"threads_started":1}
I20260809 13:03:22.963369 6218 raft_consensus.cc:388] T 00000000000000000000000000000000 P 100409eec63e493daeca3fdbf0478a47 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:03:22.963517 6218 raft_consensus.cc:482] T 00000000000000000000000000000000 P 100409eec63e493daeca3fdbf0478a47 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:03:22.963728 6218 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 100409eec63e493daeca3fdbf0478a47 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:22.967034 6218 raft_consensus.cc:504] T 00000000000000000000000000000000 P 100409eec63e493daeca3fdbf0478a47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "100409eec63e493daeca3fdbf0478a47" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 40147 } }
I20260809 13:03:22.967631 6218 leader_election.cc:302] T 00000000000000000000000000000000 P 100409eec63e493daeca3fdbf0478a47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 100409eec63e493daeca3fdbf0478a47; no voters:
I20260809 13:03:22.968291 6218 leader_election.cc:288] T 00000000000000000000000000000000 P 100409eec63e493daeca3fdbf0478a47 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:03:22.968463 6231 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 100409eec63e493daeca3fdbf0478a47 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:03:22.969280 6231 raft_consensus.cc:686] T 00000000000000000000000000000000 P 100409eec63e493daeca3fdbf0478a47 [term 1 LEADER]: Becoming Leader. State: Replica: 100409eec63e493daeca3fdbf0478a47, State: Running, Role: LEADER
I20260809 13:03:22.969872 6231 consensus_queue.cc:237] T 00000000000000000000000000000000 P 100409eec63e493daeca3fdbf0478a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "100409eec63e493daeca3fdbf0478a47" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 40147 } }
I20260809 13:03:22.970733 6218 sys_catalog.cc:564] T 00000000000000000000000000000000 P 100409eec63e493daeca3fdbf0478a47 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:03:22.973438 6233 sys_catalog.cc:455] T 00000000000000000000000000000000 P 100409eec63e493daeca3fdbf0478a47 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "100409eec63e493daeca3fdbf0478a47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "100409eec63e493daeca3fdbf0478a47" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 40147 } } }
I20260809 13:03:22.973407 6236 sys_catalog.cc:455] T 00000000000000000000000000000000 P 100409eec63e493daeca3fdbf0478a47 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 100409eec63e493daeca3fdbf0478a47. Latest consensus state: current_term: 1 leader_uuid: "100409eec63e493daeca3fdbf0478a47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "100409eec63e493daeca3fdbf0478a47" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 40147 } } }
I20260809 13:03:22.973922 6236 sys_catalog.cc:458] T 00000000000000000000000000000000 P 100409eec63e493daeca3fdbf0478a47 [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:22.973922 6233 sys_catalog.cc:458] T 00000000000000000000000000000000 P 100409eec63e493daeca3fdbf0478a47 [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:22.982390 6244 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:03:22.988560 6244 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:03:22.999423 6244 catalog_manager.cc:1347] Generated new cluster ID: 9c3e74bdff1a42628bcac2581004764f
I20260809 13:03:22.999552 6244 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:03:23.026479 6244 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:03:23.028112 6244 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:03:23.041316 6244 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 100409eec63e493daeca3fdbf0478a47: Generated new TSK 0
I20260809 13:03:23.042539 6244 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
I20260809 13:03:23.115875 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:0
--local_ip_for_outbound_sockets=127.28.155.193
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:40147
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:37475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:23.483609 6273 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:23.483942 6273 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:23.484050 6273 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:23.491851 6273 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:23.492028 6273 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:23.492153 6273 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:03:23.502465 6273 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:37475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:40147
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:23.503831 6273 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:23.505232 6273 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:23.518831 6282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:23.518877 6283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:23.518946 6285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:23.519754 6273 server_base.cc:1034] running on GCE node
I20260809 13:03:23.520399 6273 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:23.521445 6273 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:23.522706 6273 hybrid_clock.cc:648] HybridClock initialized: now 1786280603522665 us; error 54 us; skew 500 ppm
I20260809 13:03:23.523092 6273 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:23 dist-test-slave-jq4t krb5kdc[6045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280603, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:23.526515 6273 init.cc:377] Logged in from keytab as kudu/127.28.155.193@KRBTEST.COM (short username kudu)
I20260809 13:03:23.528271 6273 webserver.cc:460] Webserver started at http://127.28.155.193:35047/ using document root <none> and password file <none>
I20260809 13:03:23.529114 6273 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:23.529273 6273 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:23.529631 6273 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:23.532903 6273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-0/data/instance:
uuid: "e60d8652fbcb415cbd20a67ecdbb3e47"
format_stamp: "Formatted at 2026-08-09 13:03:23 on dist-test-slave-jq4t"
server_key: "330a328f05c24c28e8313e4676104a2f"
server_key_iv: "4eff27e5d47205c038440ad63e79adcd"
server_key_version: "encryptionkey@0"
I20260809 13:03:23.533762 6273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance:
uuid: "e60d8652fbcb415cbd20a67ecdbb3e47"
format_stamp: "Formatted at 2026-08-09 13:03:23 on dist-test-slave-jq4t"
server_key: "330a328f05c24c28e8313e4676104a2f"
server_key_iv: "4eff27e5d47205c038440ad63e79adcd"
server_key_version: "encryptionkey@0"
I20260809 13:03:23.539078 6273 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260809 13:03:23.542698 6296 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:23.543991 6273 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 13:03:23.544205 6273 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "e60d8652fbcb415cbd20a67ecdbb3e47"
format_stamp: "Formatted at 2026-08-09 13:03:23 on dist-test-slave-jq4t"
server_key: "330a328f05c24c28e8313e4676104a2f"
server_key_iv: "4eff27e5d47205c038440ad63e79adcd"
server_key_version: "encryptionkey@0"
I20260809 13:03:23.544440 6273 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:23.570181 6273 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:23.575075 6273 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:23.575403 6273 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:23.576458 6273 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:03:23.577956 6273 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:03:23.578033 6273 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:23.578212 6273 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:03:23.578275 6273 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:23.612005 6273 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:42929
I20260809 13:03:23.612056 6501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:42929 every 8 connection(s)
I20260809 13:03:23.613394 6273 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:03:23.614441 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 6273
I20260809 13:03:23.614656 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance
I20260809 13:03:23.615466 29295 external_mini_cluster.cc:1428] Setting key 192018a52fe86602c21b146c5c3a6005
Aug 09 13:03:23 dist-test-slave-jq4t krb5kdc[6045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280603, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:03:23.634721 6507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:23.616239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:47191 (local address 127.28.155.254:40147)
0809 13:03:23.616749 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:23.616755 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:23.617911 (+ 1156us) server_negotiation.cc:407] Connection header received
0809 13:03:23.619793 (+ 1882us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:23.619802 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:23.619896 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:23.620023 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:23.621596 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:23.622778 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:23.624348 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:23.625093 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:23.625239 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:23.628871 (+ 3632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:23.628877 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:23.628882 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:23.628924 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:23.631566 (+ 2642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:23.632302 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:23.632307 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:23.632311 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:23.632443 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:23.632949 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:23.632954 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:23.632957 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:23.633223 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:23.633390 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:23.634080 (+ 690us) server_negotiation.cc:299] Negotiation successful
0809 13:03:23.634318 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":266,"threads_started":1}
I20260809 13:03:23.635715 6509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:23.616840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:40147 (local address 127.28.155.193:47191)
0809 13:03:23.617727 (+ 887us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:23.617779 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:23.619521 (+ 1742us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:23.620221 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:23.620229 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:23.620829 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:23.621414 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:23.621431 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:23.622964 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:23.622967 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:23.624199 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:23.624211 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:23.625298 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:23.625303 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:23.625495 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:23.626218 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:23.626241 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:23.628652 (+ 2411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:23.631713 (+ 3061us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:23.631722 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:23.631737 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:23.632170 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:23.632618 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:23.632623 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:23.632627 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:23.632823 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:23.633364 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:23.633373 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:23.633702 (+ 329us) client_negotiation.cc:769] Sending connection context
0809 13:03:23.633963 (+ 261us) client_negotiation.cc:240] Negotiation successful
0809 13:03:23.634497 (+ 534us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":374,"threads_started":1}
I20260809 13:03:23.637579 6503 heartbeater.cc:347] Connected to a master server at 127.28.155.254:40147
I20260809 13:03:23.637928 6503 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:23.638712 6503 heartbeater.cc:511] Master 127.28.155.254:40147 requested a full tablet report, sending...
I20260809 13:03:23.641062 6154 ts_manager.cc:194] Registered new tserver with Master: e60d8652fbcb415cbd20a67ecdbb3e47 (127.28.155.193:42929)
WARNING: no policy specified for kudu/127.28.155.194@KRBTEST.COM; defaulting to no policy
I20260809 13:03:23.642640 6154 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.193@KRBTEST.COM'} at 127.28.155.193:47191
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
I20260809 13:03:23.674185 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:0
--local_ip_for_outbound_sockets=127.28.155.194
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:40147
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:37475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:24.023624 6513 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:24.024012 6513 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:24.024201 6513 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:24.031641 6513 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:24.031806 6513 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:24.032011 6513 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:03:24.042302 6513 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:37475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:40147
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:24.043756 6513 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:24.045368 6513 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:24.059500 6521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:24.059468 6522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:24.059497 6525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:24.060212 6513 server_base.cc:1034] running on GCE node
I20260809 13:03:24.060962 6513 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:24.061946 6513 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:24.063182 6513 hybrid_clock.cc:648] HybridClock initialized: now 1786280604063125 us; error 54 us; skew 500 ppm
I20260809 13:03:24.063506 6513 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:24 dist-test-slave-jq4t krb5kdc[6045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280604, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:24.066797 6513 init.cc:377] Logged in from keytab as kudu/127.28.155.194@KRBTEST.COM (short username kudu)
I20260809 13:03:24.068316 6513 webserver.cc:460] Webserver started at http://127.28.155.194:40767/ using document root <none> and password file <none>
I20260809 13:03:24.069090 6513 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:24.069247 6513 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:24.069588 6513 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:24.072969 6513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-1/data/instance:
uuid: "fff3fe6f0a5447dca271ce7344a7e7da"
format_stamp: "Formatted at 2026-08-09 13:03:24 on dist-test-slave-jq4t"
server_key: "5934dea80e97c849a8f76ac7fabc18a4"
server_key_iv: "c756421c75359bb23c7bdb71a36a1279"
server_key_version: "encryptionkey@0"
I20260809 13:03:24.073799 6513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance:
uuid: "fff3fe6f0a5447dca271ce7344a7e7da"
format_stamp: "Formatted at 2026-08-09 13:03:24 on dist-test-slave-jq4t"
server_key: "5934dea80e97c849a8f76ac7fabc18a4"
server_key_iv: "c756421c75359bb23c7bdb71a36a1279"
server_key_version: "encryptionkey@0"
I20260809 13:03:24.079149 6513 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 13:03:24.083002 6535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:24.084419 6513 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 13:03:24.084638 6513 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "fff3fe6f0a5447dca271ce7344a7e7da"
format_stamp: "Formatted at 2026-08-09 13:03:24 on dist-test-slave-jq4t"
server_key: "5934dea80e97c849a8f76ac7fabc18a4"
server_key_iv: "c756421c75359bb23c7bdb71a36a1279"
server_key_version: "encryptionkey@0"
I20260809 13:03:24.084880 6513 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:24.111665 6513 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:24.116328 6513 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:24.116696 6513 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:24.117765 6513 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:03:24.119256 6513 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:03:24.119370 6513 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:24.119534 6513 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:03:24.119620 6513 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:24.155634 6513 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:34963
I20260809 13:03:24.155690 6742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:34963 every 8 connection(s)
I20260809 13:03:24.157050 6513 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:03:24.162156 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 6513
I20260809 13:03:24.162372 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance
I20260809 13:03:24.162851 29295 external_mini_cluster.cc:1428] Setting key 731ef48224bde26382dd40edd096328e
Aug 09 13:03:24 dist-test-slave-jq4t krb5kdc[6045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280604, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:03:24.181252 6747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:24.159974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:58211 (local address 127.28.155.254:40147)
0809 13:03:24.160594 (+ 620us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:24.160599 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:24.161640 (+ 1041us) server_negotiation.cc:407] Connection header received
0809 13:03:24.163847 (+ 2207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:24.163854 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:24.163932 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:24.164070 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:24.166038 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:24.167284 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:24.169362 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:24.170150 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:24.170311 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:24.174189 (+ 3878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:24.174197 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:24.174205 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:24.174255 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:24.177273 (+ 3018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:24.178254 (+ 981us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:24.178258 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:24.178260 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:24.178408 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:24.178903 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:24.178906 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:24.178908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:24.179187 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:24.179304 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:24.180427 (+ 1123us) server_negotiation.cc:299] Negotiation successful
0809 13:03:24.180708 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":330,"threads_started":1}
I20260809 13:03:24.182730 6748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:24.160641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:40147 (local address 127.28.155.194:58211)
0809 13:03:24.161435 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:24.161490 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:24.163502 (+ 2012us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:24.164318 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:24.164329 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:24.165202 (+ 873us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:24.165847 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:24.165866 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:24.167467 (+ 1601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:24.167471 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:24.169189 (+ 1718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:24.169204 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:24.170414 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:24.170420 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:24.170733 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:24.171530 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:24.171555 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:24.173925 (+ 2370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:24.177423 (+ 3498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:24.177436 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:24.177456 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:24.178123 (+ 667us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:24.178521 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:24.178527 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:24.178532 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:24.178782 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:24.179344 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:24.179357 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:24.179913 (+ 556us) client_negotiation.cc:769] Sending connection context
0809 13:03:24.180253 (+ 340us) client_negotiation.cc:240] Negotiation successful
0809 13:03:24.180937 (+ 684us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":312,"threads_started":1}
I20260809 13:03:24.184634 6743 heartbeater.cc:347] Connected to a master server at 127.28.155.254:40147
I20260809 13:03:24.184993 6743 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:24.186000 6743 heartbeater.cc:511] Master 127.28.155.254:40147 requested a full tablet report, sending...
I20260809 13:03:24.187764 6154 ts_manager.cc:194] Registered new tserver with Master: fff3fe6f0a5447dca271ce7344a7e7da (127.28.155.194:34963)
I20260809 13:03:24.188818 6154 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.194@KRBTEST.COM'} at 127.28.155.194:58211
WARNING: no policy specified for kudu/127.28.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
I20260809 13:03:24.227340 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:0
--local_ip_for_outbound_sockets=127.28.155.195
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:40147
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:37475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:24.581337 6751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:24.581653 6751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:24.581756 6751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:24.589356 6751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:24.589470 6751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:24.589593 6751 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:03:24.599802 6751 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:37475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:40147
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:24.601189 6751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:24.602591 6751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:24.616451 6762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:24.616427 6760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:24.616964 6759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:24.618242 6751 server_base.cc:1034] running on GCE node
I20260809 13:03:24.618937 6751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:24.620007 6751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:24.621244 6751 hybrid_clock.cc:648] HybridClock initialized: now 1786280604621202 us; error 54 us; skew 500 ppm
I20260809 13:03:24.621614 6751 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:24 dist-test-slave-jq4t krb5kdc[6045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280604, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:24.624997 6751 init.cc:377] Logged in from keytab as kudu/127.28.155.195@KRBTEST.COM (short username kudu)
I20260809 13:03:24.626523 6751 webserver.cc:460] Webserver started at http://127.28.155.195:38765/ using document root <none> and password file <none>
I20260809 13:03:24.627241 6751 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:24.627437 6751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:24.627784 6751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:24.631071 6751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-2/data/instance:
uuid: "df8c349f691b4e0780048ef9a9538f0b"
format_stamp: "Formatted at 2026-08-09 13:03:24 on dist-test-slave-jq4t"
server_key: "59ce37339658dac7f7cd6aea6188bd95"
server_key_iv: "8523d4000f30190987b47c7bf25b3391"
server_key_version: "encryptionkey@0"
I20260809 13:03:24.631930 6751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance:
uuid: "df8c349f691b4e0780048ef9a9538f0b"
format_stamp: "Formatted at 2026-08-09 13:03:24 on dist-test-slave-jq4t"
server_key: "59ce37339658dac7f7cd6aea6188bd95"
server_key_iv: "8523d4000f30190987b47c7bf25b3391"
server_key_version: "encryptionkey@0"
I20260809 13:03:24.637554 6751 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 13:03:24.641436 6777 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:24.642843 6751 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:03:24.643054 6751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "df8c349f691b4e0780048ef9a9538f0b"
format_stamp: "Formatted at 2026-08-09 13:03:24 on dist-test-slave-jq4t"
server_key: "59ce37339658dac7f7cd6aea6188bd95"
server_key_iv: "8523d4000f30190987b47c7bf25b3391"
server_key_version: "encryptionkey@0"
I20260809 13:03:24.643302 6751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:24.646461 6503 heartbeater.cc:503] Master 127.28.155.254:40147 was elected leader, sending a full tablet report...
I20260809 13:03:24.665911 6751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:24.670204 6751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:24.670524 6751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:24.671624 6751 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:03:24.673125 6751 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:03:24.673204 6751 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:24.673297 6751 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:03:24.673343 6751 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:24.708887 6751 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:42469
I20260809 13:03:24.708941 6975 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:42469 every 8 connection(s)
I20260809 13:03:24.710330 6751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:03:24.715165 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 6751
I20260809 13:03:24.715395 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance
I20260809 13:03:24.715919 29295 external_mini_cluster.cc:1428] Setting key 73e41d19bc72f0eddde740c04ba297bf
Aug 09 13:03:24 dist-test-slave-jq4t krb5kdc[6045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280604, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:03:24.734146 6983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:24.713125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:40049 (local address 127.28.155.254:40147)
0809 13:03:24.714856 (+ 1731us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:24.714864 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:24.715163 (+ 299us) server_negotiation.cc:407] Connection header received
0809 13:03:24.717650 (+ 2487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:24.717656 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:24.717761 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:24.717887 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:24.719925 (+ 2038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:24.720783 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:24.722362 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:24.722780 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:24.722872 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:24.727006 (+ 4134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:24.727012 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:24.727016 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:24.727055 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:24.730401 (+ 3346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:24.731540 (+ 1139us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:24.731546 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:24.731549 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:24.731725 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:24.732370 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:24.732374 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:24.732378 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:24.732787 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:24.732925 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:24.733661 (+ 736us) server_negotiation.cc:299] Negotiation successful
0809 13:03:24.733850 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1572,"thread_start_us":1438,"threads_started":1}
I20260809 13:03:24.735201 6984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:24.713875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:40147 (local address 127.28.155.195:40049)
0809 13:03:24.714937 (+ 1062us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:24.715011 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:24.717300 (+ 2289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:24.718202 (+ 902us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:24.718211 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:24.719066 (+ 855us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:24.719767 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:24.719785 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:24.720913 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:24.720917 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:24.722232 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:24.722245 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:24.722982 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:24.722996 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:24.723205 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:24.724191 (+ 986us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:24.724222 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:24.726724 (+ 2502us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:24.730643 (+ 3919us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:24.730655 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:24.730675 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:24.731378 (+ 703us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:24.731894 (+ 516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:24.731900 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:24.731903 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:24.732228 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:24.732929 (+ 701us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:24.732935 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:24.733303 (+ 368us) client_negotiation.cc:769] Sending connection context
0809 13:03:24.733570 (+ 267us) client_negotiation.cc:240] Negotiation successful
0809 13:03:24.734017 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":763,"thread_start_us":507,"threads_started":1}
I20260809 13:03:24.736855 6977 heartbeater.cc:347] Connected to a master server at 127.28.155.254:40147
I20260809 13:03:24.737214 6977 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:24.738061 6977 heartbeater.cc:511] Master 127.28.155.254:40147 requested a full tablet report, sending...
I20260809 13:03:24.739668 6154 ts_manager.cc:194] Registered new tserver with Master: df8c349f691b4e0780048ef9a9538f0b (127.28.155.195:42469)
I20260809 13:03:24.740636 6154 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.195@KRBTEST.COM'} at 127.28.155.195:40049
I20260809 13:03:24.745087 29295 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/test-admin.keytab.
Aug 09 13:03:24 dist-test-slave-jq4t krb5kdc[6045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280604, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:24.780375 29295 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260809 13:03:24.786065 6992 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:24.783391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51358 (local address 127.28.155.193:42929)
0809 13:03:24.784091 (+ 700us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:24.784099 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:24.784128 (+ 29us) server_negotiation.cc:407] Connection header received
0809 13:03:24.784196 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:24.784202 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:24.784423 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:24.784662 (+ 239us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:24.785625 (+ 963us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51358: BlockingRecv error: recv got EOF from 127.0.0.1:51358 (error 108)
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":358,"threads_started":1}
W20260809 13:03:24.786100 29295 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/krb5cc' of type FILE
Aug 09 13:03:24 dist-test-slave-jq4t krb5kdc[6045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280604, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:24.787842 29295 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 13:03:24 dist-test-slave-jq4t krb5kdc[6045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280604, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:24.789417 29295 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 13:03:24 dist-test-slave-jq4t krb5kdc[6045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280604, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.193@KRBTEST.COM
I20260809 13:03:24.805528 6992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:24.791276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51366 (local address 127.28.155.193:42929)
0809 13:03:24.791508 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:24.791513 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:24.791595 (+ 82us) server_negotiation.cc:407] Connection header received
0809 13:03:24.791751 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:24.791754 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:24.791817 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:24.791897 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:24.792958 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:24.793983 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:24.795208 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:24.795793 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:24.795893 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:24.799744 (+ 3851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:24.799758 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:24.799774 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:24.799810 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:24.802834 (+ 3024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:24.803551 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:24.803558 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:24.803561 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:24.803681 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:24.803992 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:24.803995 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:24.803997 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:24.804354 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:24.804762 (+ 408us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:24.804907 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 13:03:24.805174 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
W20260809 13:03:24.811740 6992 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:24.809829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51374 (local address 127.28.155.193:42929)
0809 13:03:24.810059 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:24.810066 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:24.810283 (+ 217us) server_negotiation.cc:407] Connection header received
0809 13:03:24.810485 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:24.810489 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:24.810552 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:24.810655 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:24.811468 (+ 813us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51374: BlockingRecv error: recv got EOF from 127.0.0.1:51374 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260809 13:03:24.811962 29295 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/krb5cc' of type FILE
Aug 09 13:03:24 dist-test-slave-jq4t krb5kdc[6045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280604, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:24.813649 29295 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 13:03:24 dist-test-slave-jq4t krb5kdc[6045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280604, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:24.815083 29295 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 13:03:24 dist-test-slave-jq4t krb5kdc[6045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280604, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.193@KRBTEST.COM
I20260809 13:03:24.830358 6992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:24.816525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51378 (local address 127.28.155.193:42929)
0809 13:03:24.816750 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:24.816757 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:24.817029 (+ 272us) server_negotiation.cc:407] Connection header received
0809 13:03:24.817230 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:24.817235 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:24.817309 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:24.817420 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:24.818472 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:24.819214 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:24.820453 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:24.820980 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:24.821137 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:24.825021 (+ 3884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:24.825026 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:24.825029 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:24.825065 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:24.827650 (+ 2585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:24.828304 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:24.828311 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:24.828315 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:24.828459 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:24.828911 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:24.828916 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:24.828919 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:24.829214 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:24.829500 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:24.829827 (+ 327us) server_negotiation.cc:299] Negotiation successful
0809 13:03:24.830062 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
W20260809 13:03:24.835427 6992 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:24.833308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51388 (local address 127.28.155.193:42929)
0809 13:03:24.833545 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:24.833553 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:24.833837 (+ 284us) server_negotiation.cc:407] Connection header received
0809 13:03:24.834019 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:24.834032 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:24.834117 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:24.834223 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:24.835160 (+ 937us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51388: BlockingRecv error: recv got EOF from 127.0.0.1:51388 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
W20260809 13:03:24.835690 29295 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786280548611909-29295-0/krb5kdc/krb5cc' of type FILE
Aug 09 13:03:24 dist-test-slave-jq4t krb5kdc[6045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280604, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:24.837431 29295 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 13:03:24 dist-test-slave-jq4t krb5kdc[6045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280604, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:24.838799 29295 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 13:03:24 dist-test-slave-jq4t krb5kdc[6045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280604, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.193@KRBTEST.COM
I20260809 13:03:24.853744 6992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:24.840400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51394 (local address 127.28.155.193:42929)
0809 13:03:24.840665 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:24.840670 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:24.840774 (+ 104us) server_negotiation.cc:407] Connection header received
0809 13:03:24.840922 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:24.840925 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:24.840987 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:24.841072 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:24.842027 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:24.842762 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:24.843998 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:24.844414 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:24.844588 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:24.848400 (+ 3812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:24.848405 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:24.848408 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:24.848442 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:24.851216 (+ 2774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:24.851832 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:24.851836 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:24.851838 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:24.851999 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:24.852338 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:24.852342 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:24.852344 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:24.852713 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:24.852978 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:24.853264 (+ 286us) server_negotiation.cc:299] Negotiation successful
0809 13:03:24.853460 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130}
I20260809 13:03:24.855554 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 6273
I20260809 13:03:24.867336 6992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:24.856315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51398 (local address 127.28.155.193:42929)
0809 13:03:24.856604 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:24.856610 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:24.856828 (+ 218us) server_negotiation.cc:407] Connection header received
0809 13:03:24.856947 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:24.856950 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:24.857010 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:24.857089 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:24.857969 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:24.858650 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:24.859793 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:24.860229 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:24.860321 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:24.862450 (+ 2129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:24.862455 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:24.862458 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:24.862488 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:24.864960 (+ 2472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:24.865563 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:24.865567 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:24.865569 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:24.865699 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:24.866063 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:24.866067 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:24.866069 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:24.866331 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:24.866559 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:24.866775 (+ 216us) server_negotiation.cc:299] Negotiation successful
0809 13:03:24.866951 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 13:03:24.867986 6494 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:24.954679 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 6273
I20260809 13:03:24.977974 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 6513
Aug 09 13:03:24 dist-test-slave-jq4t krb5kdc[6045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280604, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.194@KRBTEST.COM
I20260809 13:03:24.996030 7017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:24.979142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57686 (local address 127.28.155.194:34963)
0809 13:03:24.979759 (+ 617us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:24.979766 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:24.979794 (+ 28us) server_negotiation.cc:407] Connection header received
0809 13:03:24.979859 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:24.979866 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:24.980158 (+ 292us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:24.980302 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:24.981579 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:24.982769 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:24.984151 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:24.984865 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:24.984983 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:24.989376 (+ 4393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:24.989402 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:24.989418 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:24.989477 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:24.992776 (+ 3299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:24.993588 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:24.993596 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:24.993599 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:24.993749 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:24.994181 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:24.994188 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:24.994196 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:24.994615 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:24.994975 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:24.995359 (+ 384us) server_negotiation.cc:299] Negotiation successful
0809 13:03:24.995684 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":315,"threads_started":1}
I20260809 13:03:24.997565 6738 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:25.084621 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 6513
I20260809 13:03:25.116268 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 6751
Aug 09 13:03:25 dist-test-slave-jq4t krb5kdc[6045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280604, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.195@KRBTEST.COM
I20260809 13:03:25.133222 7019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:25.117549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37172 (local address 127.28.155.195:42469)
0809 13:03:25.118263 (+ 714us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:25.118271 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:25.118301 (+ 30us) server_negotiation.cc:407] Connection header received
0809 13:03:25.118371 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:25.118378 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:25.118602 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:25.118742 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:25.119912 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:25.121145 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:25.122436 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:25.123029 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:25.123137 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:25.127291 (+ 4154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:25.127305 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:25.127320 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:25.127362 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:25.130420 (+ 3058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:25.131155 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:25.131162 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:25.131164 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:25.131295 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:25.131636 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:25.131639 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:25.131641 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:25.132012 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:25.132264 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:25.132558 (+ 294us) server_negotiation.cc:299] Negotiation successful
0809 13:03:25.132888 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":379,"threads_started":1}
I20260809 13:03:25.134630 6967 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:25.223035 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 6751
I20260809 13:03:25.248358 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 6079
I20260809 13:03:25.249693 6206 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:25.359987 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 6079
2026-08-09T13:03:25Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4534 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:03:25 dist-test-slave-jq4t krb5kdc[7026](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:03:25 dist-test-slave-jq4t krb5kdc[7026](info): set up 2 sockets
Aug 09 13:03:25 dist-test-slave-jq4t krb5kdc[7026](info): commencing operation
krb5kdc: starting...
W20260809 13:03:26.706050 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.289s user 0.002s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:03:26 dist-test-slave-jq4t krb5kdc[7026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280606, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:03:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:03:26Z Disabled control of system clock
WARNING: no policy specified for oryx/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.254.keytab.
Entry for principal oryx/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.254.keytab.
I20260809 13:03:26.984648 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:42999
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.254.keytab
--principal=oryx/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:37737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:42999
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:27.350349 7048 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:27.350751 7048 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:27.350963 7048 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:27.358341 7048 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:03:27.358512 7048 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:27.358636 7048 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:27.358747 7048 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:03:27.358839 7048 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:03:27.368994 7048 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:37737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:42999
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.254.keytab
--principal=oryx/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:42999
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:27.370575 7048 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:27.372066 7048 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:27.387353 7053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:27.387437 7058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:27.387316 7055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:27.388628 7048 server_base.cc:1034] running on GCE node
I20260809 13:03:27.389500 7048 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:27.391103 7048 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:27.392356 7048 hybrid_clock.cc:648] HybridClock initialized: now 1786280607392304 us; error 73 us; skew 500 ppm
I20260809 13:03:27.392786 7048 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:27 dist-test-slave-jq4t krb5kdc[7026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280607, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:27.396220 7048 init.cc:377] Logged in from keytab as oryx/127.28.155.254@KRBTEST.COM (short username oryx)
I20260809 13:03:27.397955 7048 webserver.cc:460] Webserver started at http://127.28.155.254:35257/ using document root <none> and password file <none>
I20260809 13:03:27.398671 7048 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:27.398782 7048 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:27.399051 7048 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:27.402400 7048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "b317f0a53c51431c85e6fe16a219c490"
format_stamp: "Formatted at 2026-08-09 13:03:27 on dist-test-slave-jq4t"
server_key: "940a05350fde24ba50e3b54b840644a0"
server_key_iv: "5b146f4aa6b388128dd3d104c72d9650"
server_key_version: "encryptionkey@0"
I20260809 13:03:27.403240 7048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "b317f0a53c51431c85e6fe16a219c490"
format_stamp: "Formatted at 2026-08-09 13:03:27 on dist-test-slave-jq4t"
server_key: "940a05350fde24ba50e3b54b840644a0"
server_key_iv: "5b146f4aa6b388128dd3d104c72d9650"
server_key_version: "encryptionkey@0"
I20260809 13:03:27.409287 7048 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260809 13:03:27.413367 7072 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:27.414958 7048 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260809 13:03:27.415196 7048 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "b317f0a53c51431c85e6fe16a219c490"
format_stamp: "Formatted at 2026-08-09 13:03:27 on dist-test-slave-jq4t"
server_key: "940a05350fde24ba50e3b54b840644a0"
server_key_iv: "5b146f4aa6b388128dd3d104c72d9650"
server_key_version: "encryptionkey@0"
I20260809 13:03:27.415433 7048 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:27.430786 7048 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:27.435719 7048 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:27.436102 7048 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:27.457448 7048 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:42999
I20260809 13:03:27.457499 7153 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:42999 every 8 connection(s)
I20260809 13:03:27.459021 7048 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:03:27.463060 7154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:27.464377 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 7048
I20260809 13:03:27.464643 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:03:27.465636 29295 external_mini_cluster.cc:1428] Setting key be202f1f25f40e907ac99f61ae2c6e8a
I20260809 13:03:27.477226 7154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490: Bootstrap starting.
Aug 09 13:03:27 dist-test-slave-jq4t krb5kdc[7026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280606, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM
I20260809 13:03:27.480793 7154 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:27.482013 7154 log.cc:824] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490: Log is configured to *not* fsync() on all Append() calls
I20260809 13:03:27.485484 7154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490: No bootstrap required, opened a new log
I20260809 13:03:27.490530 7159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:27.467984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38658 (local address 127.28.155.254:42999)
0809 13:03:27.468942 (+ 958us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:27.468955 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:27.468998 (+ 43us) server_negotiation.cc:407] Connection header received
0809 13:03:27.470697 (+ 1699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:27.470722 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:27.471160 (+ 438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:27.471577 (+ 417us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:27.473225 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:27.474592 (+ 1367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:27.475983 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:27.476803 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:27.477005 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:27.481371 (+ 4366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:27.481380 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:27.481397 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:27.481439 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:27.484968 (+ 3529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:27.485929 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:27.485938 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:27.485947 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:27.486215 (+ 268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:27.486923 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:27.486929 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:27.486932 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:27.487749 (+ 817us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:27.488104 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:27.488879 (+ 775us) server_negotiation.cc:299] Negotiation successful
0809 13:03:27.489360 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":731,"thread_start_us":491,"threads_started":1}
I20260809 13:03:27.495198 7154 raft_consensus.cc:348] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } }
I20260809 13:03:27.495618 7154 raft_consensus.cc:374] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:27.495757 7154 raft_consensus.cc:729] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b317f0a53c51431c85e6fe16a219c490, State: Initialized, Role: FOLLOWER
I20260809 13:03:27.496371 7154 consensus_queue.cc:260] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } }
I20260809 13:03:27.496713 7154 raft_consensus.cc:388] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:03:27.496887 7154 raft_consensus.cc:482] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:03:27.497126 7154 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:27.499517 7154 raft_consensus.cc:504] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } }
I20260809 13:03:27.500104 7154 leader_election.cc:302] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b317f0a53c51431c85e6fe16a219c490; no voters:
I20260809 13:03:27.500890 7154 leader_election.cc:288] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:03:27.501046 7161 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:03:27.501911 7161 raft_consensus.cc:686] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [term 1 LEADER]: Becoming Leader. State: Replica: b317f0a53c51431c85e6fe16a219c490, State: Running, Role: LEADER
I20260809 13:03:27.502508 7161 consensus_queue.cc:237] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } }
I20260809 13:03:27.503337 7154 sys_catalog.cc:564] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:03:27.505565 7162 sys_catalog.cc:455] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b317f0a53c51431c85e6fe16a219c490" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } }
I20260809 13:03:27.506110 7162 sys_catalog.cc:458] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:27.506294 7163 sys_catalog.cc:455] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b317f0a53c51431c85e6fe16a219c490. Latest consensus state: current_term: 1 leader_uuid: "b317f0a53c51431c85e6fe16a219c490" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } }
I20260809 13:03:27.506940 7163 sys_catalog.cc:458] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:27.509518 7171 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:03:27.515744 7171 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:03:27.526461 7171 catalog_manager.cc:1347] Generated new cluster ID: e9f390c010254238bb371f7000fec8b2
I20260809 13:03:27.526626 7171 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:03:27.539108 7171 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:03:27.540665 7171 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:03:27.550411 7171 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490: Generated new TSK 0
I20260809 13:03:27.551453 7171 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.28.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.193.keytab.
Entry for principal oryx/127.28.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.193.keytab.
I20260809 13:03:27.622483 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:0
--local_ip_for_outbound_sockets=127.28.155.193
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:42999
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.193.keytab
--principal=oryx/127.28.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:37737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:27.978397 7200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:27.978729 7200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:27.978892 7200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:27.986446 7200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:27.986600 7200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:27.986799 7200 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:03:27.997296 7200 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:37737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.193.keytab
--principal=oryx/127.28.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:42999
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:27.998867 7200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:28.000289 7200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:28.015221 7213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:28.015305 7207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:28.015249 7210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:28.016227 7200 server_base.cc:1034] running on GCE node
I20260809 13:03:28.017118 7200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:28.018198 7200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:28.019541 7200 hybrid_clock.cc:648] HybridClock initialized: now 1786280608019484 us; error 51 us; skew 500 ppm
I20260809 13:03:28.020013 7200 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:28 dist-test-slave-jq4t krb5kdc[7026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280608, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:28.028113 7200 init.cc:377] Logged in from keytab as oryx/127.28.155.193@KRBTEST.COM (short username oryx)
I20260809 13:03:28.030035 7200 webserver.cc:460] Webserver started at http://127.28.155.193:42665/ using document root <none> and password file <none>
I20260809 13:03:28.030810 7200 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:28.030997 7200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:28.031328 7200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:28.034580 7200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/data/instance:
uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254"
format_stamp: "Formatted at 2026-08-09 13:03:28 on dist-test-slave-jq4t"
server_key: "efd1e55e04fd4ab9ca66d5cbd6480c0a"
server_key_iv: "b01fb6d7a8bb19f10afd6b1bf29ef3dd"
server_key_version: "encryptionkey@0"
I20260809 13:03:28.035445 7200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance:
uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254"
format_stamp: "Formatted at 2026-08-09 13:03:28 on dist-test-slave-jq4t"
server_key: "efd1e55e04fd4ab9ca66d5cbd6480c0a"
server_key_iv: "b01fb6d7a8bb19f10afd6b1bf29ef3dd"
server_key_version: "encryptionkey@0"
I20260809 13:03:28.041193 7200 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260809 13:03:28.044946 7223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:28.046424 7200 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:03:28.046627 7200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254"
format_stamp: "Formatted at 2026-08-09 13:03:28 on dist-test-slave-jq4t"
server_key: "efd1e55e04fd4ab9ca66d5cbd6480c0a"
server_key_iv: "b01fb6d7a8bb19f10afd6b1bf29ef3dd"
server_key_version: "encryptionkey@0"
I20260809 13:03:28.046880 7200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:28.063109 7200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:28.067464 7200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:28.067777 7200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:28.068924 7200 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:03:28.070417 7200 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:03:28.070530 7200 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:28.070677 7200 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:03:28.070755 7200 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:28.106473 7200 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:45137
I20260809 13:03:28.106516 7408 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:45137 every 8 connection(s)
I20260809 13:03:28.107906 7200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:03:28.111307 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 7200
I20260809 13:03:28.111558 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance
I20260809 13:03:28.112227 29295 external_mini_cluster.cc:1428] Setting key c5fbcf742ed76093e04cffe1fc622620
Aug 09 13:03:28 dist-test-slave-jq4t krb5kdc[7026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280608, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM
I20260809 13:03:28.131656 7411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:28.110914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:39199 (local address 127.28.155.254:42999)
0809 13:03:28.111499 (+ 585us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:28.111507 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:28.112751 (+ 1244us) server_negotiation.cc:407] Connection header received
0809 13:03:28.114949 (+ 2198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:28.114956 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:28.115053 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:28.115184 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:28.116799 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:28.117997 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:28.119823 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:28.120601 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:28.120752 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:28.125425 (+ 4673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:28.125430 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:28.125434 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:28.125471 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:28.128243 (+ 2772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:28.129119 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:28.129124 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:28.129126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:28.129252 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:28.129748 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:28.129752 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:28.129754 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:28.130038 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:28.130204 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:28.130999 (+ 795us) server_negotiation.cc:299] Negotiation successful
0809 13:03:28.131259 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":276,"threads_started":1}
I20260809 13:03:28.132836 7412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:28.111649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.28.155.193:39199)
0809 13:03:28.112568 (+ 919us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:28.112616 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:28.114667 (+ 2051us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:28.115399 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:28.115408 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:28.115948 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:28.116624 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:28.116645 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:28.118192 (+ 1547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:28.118196 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:28.119668 (+ 1472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:28.119682 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:28.120832 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:28.120855 (+ 23us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:28.121150 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:28.121981 (+ 831us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:28.122014 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:28.125147 (+ 3133us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:28.128422 (+ 3275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:28.128433 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:28.128451 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:28.128974 (+ 523us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:28.129371 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:28.129376 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:28.129380 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:28.129618 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:28.130177 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:28.130185 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:28.130576 (+ 391us) client_negotiation.cc:769] Sending connection context
0809 13:03:28.130860 (+ 284us) client_negotiation.cc:240] Negotiation successful
0809 13:03:28.131463 (+ 603us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":355,"threads_started":1}
I20260809 13:03:28.134876 7409 heartbeater.cc:347] Connected to a master server at 127.28.155.254:42999
I20260809 13:03:28.135239 7409 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:28.136168 7409 heartbeater.cc:511] Master 127.28.155.254:42999 requested a full tablet report, sending...
I20260809 13:03:28.138859 7096 ts_manager.cc:194] Registered new tserver with Master: 1ccb3277a9cf4b91bbaaad4d2ed54254 (127.28.155.193:45137)
WARNING: no policy specified for oryx/127.28.155.194@KRBTEST.COM; defaulting to no policy
I20260809 13:03:28.141022 7096 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.28.155.193@KRBTEST.COM'} at 127.28.155.193:39199
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.194.keytab.
Entry for principal oryx/127.28.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.194.keytab.
I20260809 13:03:28.176266 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:0
--local_ip_for_outbound_sockets=127.28.155.194
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:42999
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.194.keytab
--principal=oryx/127.28.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:37737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:28.531226 7417 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:28.531528 7417 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:28.531677 7417 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:28.539175 7417 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:28.539299 7417 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:28.539422 7417 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:03:28.549552 7417 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:37737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.194.keytab
--principal=oryx/127.28.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:42999
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:28.551031 7417 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:28.552531 7417 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:28.566648 7442 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:28.566591 7437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:28.567173 7438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:28.567533 7417 server_base.cc:1034] running on GCE node
I20260809 13:03:28.568212 7417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:28.569296 7417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:28.570508 7417 hybrid_clock.cc:648] HybridClock initialized: now 1786280608570454 us; error 43 us; skew 500 ppm
I20260809 13:03:28.570863 7417 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:28 dist-test-slave-jq4t krb5kdc[7026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280608, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:28.574285 7417 init.cc:377] Logged in from keytab as oryx/127.28.155.194@KRBTEST.COM (short username oryx)
I20260809 13:03:28.576005 7417 webserver.cc:460] Webserver started at http://127.28.155.194:36107/ using document root <none> and password file <none>
I20260809 13:03:28.576840 7417 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:28.576982 7417 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:28.577318 7417 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:28.580536 7417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/data/instance:
uuid: "a378f6f5259e4da08bc57e1749f81d45"
format_stamp: "Formatted at 2026-08-09 13:03:28 on dist-test-slave-jq4t"
server_key: "0f7b341617a3773fcfb13becbbbce09f"
server_key_iv: "5bfed4a13f4363489828c380e85ceecf"
server_key_version: "encryptionkey@0"
I20260809 13:03:28.581430 7417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance:
uuid: "a378f6f5259e4da08bc57e1749f81d45"
format_stamp: "Formatted at 2026-08-09 13:03:28 on dist-test-slave-jq4t"
server_key: "0f7b341617a3773fcfb13becbbbce09f"
server_key_iv: "5bfed4a13f4363489828c380e85ceecf"
server_key_version: "encryptionkey@0"
I20260809 13:03:28.586926 7417 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 13:03:28.590559 7451 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:28.591971 7417 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 13:03:28.592162 7417 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "a378f6f5259e4da08bc57e1749f81d45"
format_stamp: "Formatted at 2026-08-09 13:03:28 on dist-test-slave-jq4t"
server_key: "0f7b341617a3773fcfb13becbbbce09f"
server_key_iv: "5bfed4a13f4363489828c380e85ceecf"
server_key_version: "encryptionkey@0"
I20260809 13:03:28.592381 7417 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:28.616448 7417 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:28.621795 7417 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:28.622123 7417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:28.623235 7417 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:03:28.624755 7417 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:03:28.624837 7417 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:28.624994 7417 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:03:28.625048 7417 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:28.661032 7417 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:39059
I20260809 13:03:28.661113 7621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:39059 every 8 connection(s)
I20260809 13:03:28.662407 7417 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:03:28.664681 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 7417
I20260809 13:03:28.664884 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance
I20260809 13:03:28.665553 29295 external_mini_cluster.cc:1428] Setting key 25511e3c3d895d15e59b11c69196cab5
Aug 09 13:03:28 dist-test-slave-jq4t krb5kdc[7026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280608, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM
I20260809 13:03:28.688570 7624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:28.665266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:45101 (local address 127.28.155.254:42999)
0809 13:03:28.665810 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:28.665818 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:28.666977 (+ 1159us) server_negotiation.cc:407] Connection header received
0809 13:03:28.669652 (+ 2675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:28.669657 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:28.669725 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:28.669821 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:28.672065 (+ 2244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:28.672901 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:28.675502 (+ 2601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:28.675971 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:28.676085 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:28.681026 (+ 4941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:28.681036 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:28.681043 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:28.681093 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:28.684975 (+ 3882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:28.685773 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:28.685783 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:28.685789 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:28.685980 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:28.686430 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:28.686437 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:28.686443 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:28.686857 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:28.687014 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:28.687746 (+ 732us) server_negotiation.cc:299] Negotiation successful
0809 13:03:28.688019 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":268,"threads_started":1}
I20260809 13:03:28.689375 7625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:28.665885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.28.155.194:45101)
0809 13:03:28.666800 (+ 915us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:28.666842 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:28.669345 (+ 2503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:28.670126 (+ 781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:28.670140 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:28.671000 (+ 860us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:28.671866 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:28.671901 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:28.673073 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:28.673080 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:28.675307 (+ 2227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:28.675327 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:28.676234 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:28.676245 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:28.676612 (+ 367us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:28.677437 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:28.677474 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:28.680737 (+ 3263us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:28.685134 (+ 4397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:28.685142 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:28.685156 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:28.685629 (+ 473us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:28.686112 (+ 483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:28.686116 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:28.686118 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:28.686319 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:28.686989 (+ 670us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:28.686995 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:28.687348 (+ 353us) client_negotiation.cc:769] Sending connection context
0809 13:03:28.687608 (+ 260us) client_negotiation.cc:240] Negotiation successful
0809 13:03:28.688064 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":611,"thread_start_us":353,"threads_started":1}
I20260809 13:03:28.691044 7622 heartbeater.cc:347] Connected to a master server at 127.28.155.254:42999
I20260809 13:03:28.691422 7622 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:28.692337 7622 heartbeater.cc:511] Master 127.28.155.254:42999 requested a full tablet report, sending...
I20260809 13:03:28.694026 7096 ts_manager.cc:194] Registered new tserver with Master: a378f6f5259e4da08bc57e1749f81d45 (127.28.155.194:39059)
I20260809 13:03:28.694906 7096 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.28.155.194@KRBTEST.COM'} at 127.28.155.194:45101
WARNING: no policy specified for oryx/127.28.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.195.keytab.
Entry for principal oryx/127.28.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.195.keytab.
I20260809 13:03:28.729259 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:0
--local_ip_for_outbound_sockets=127.28.155.195
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:42999
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.195.keytab
--principal=oryx/127.28.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:37737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:29.085528 7630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:29.085938 7630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:29.086110 7630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:29.093830 7630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:29.094027 7630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:29.094201 7630 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:03:29.105093 7630 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:37737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.195.keytab
--principal=oryx/127.28.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:42999
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:29.106760 7630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:29.108132 7630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:29.122995 7641 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:29.123040 7642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:29.123071 7644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:29.124095 7630 server_base.cc:1034] running on GCE node
I20260809 13:03:29.125007 7630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:29.126089 7630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:29.127334 7630 hybrid_clock.cc:648] HybridClock initialized: now 1786280609127282 us; error 45 us; skew 500 ppm
I20260809 13:03:29.127687 7630 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:29 dist-test-slave-jq4t krb5kdc[7026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280609, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:29.131145 7630 init.cc:377] Logged in from keytab as oryx/127.28.155.195@KRBTEST.COM (short username oryx)
I20260809 13:03:29.132948 7630 webserver.cc:460] Webserver started at http://127.28.155.195:39911/ using document root <none> and password file <none>
I20260809 13:03:29.133832 7630 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:29.133977 7630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:29.134330 7630 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:29.137689 7630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/data/instance:
uuid: "91632a26834d43f3a8fca18e454b405f"
format_stamp: "Formatted at 2026-08-09 13:03:29 on dist-test-slave-jq4t"
server_key: "bdfaee4b5e7f99c487a7dc4b2ddf11c7"
server_key_iv: "c6fd65f2f0ebc52929e21ca1d054a265"
server_key_version: "encryptionkey@0"
I20260809 13:03:29.138572 7630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance:
uuid: "91632a26834d43f3a8fca18e454b405f"
format_stamp: "Formatted at 2026-08-09 13:03:29 on dist-test-slave-jq4t"
server_key: "bdfaee4b5e7f99c487a7dc4b2ddf11c7"
server_key_iv: "c6fd65f2f0ebc52929e21ca1d054a265"
server_key_version: "encryptionkey@0"
I20260809 13:03:29.144443 7630 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260809 13:03:29.144585 7409 heartbeater.cc:503] Master 127.28.155.254:42999 was elected leader, sending a full tablet report...
I20260809 13:03:29.148808 7658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:29.150324 7630 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:03:29.150626 7630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "91632a26834d43f3a8fca18e454b405f"
format_stamp: "Formatted at 2026-08-09 13:03:29 on dist-test-slave-jq4t"
server_key: "bdfaee4b5e7f99c487a7dc4b2ddf11c7"
server_key_iv: "c6fd65f2f0ebc52929e21ca1d054a265"
server_key_version: "encryptionkey@0"
I20260809 13:03:29.150854 7630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:29.174396 7630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:29.178820 7630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:29.179092 7630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:29.180096 7630 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:03:29.181615 7630 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:03:29.181694 7630 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:29.181782 7630 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:03:29.181828 7630 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:29.218139 7630 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:44473
I20260809 13:03:29.218195 7873 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:44473 every 8 connection(s)
I20260809 13:03:29.219743 7630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:03:29.226933 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 7630
I20260809 13:03:29.227133 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance
I20260809 13:03:29.227658 29295 external_mini_cluster.cc:1428] Setting key 97d0c4617455b3eead8df66107f53bed
Aug 09 13:03:29 dist-test-slave-jq4t krb5kdc[7026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280609, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM
I20260809 13:03:29.242238 7878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:29.222534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:46293 (local address 127.28.155.254:42999)
0809 13:03:29.223040 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:29.223045 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:29.223951 (+ 906us) server_negotiation.cc:407] Connection header received
0809 13:03:29.225938 (+ 1987us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:29.225945 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:29.226061 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:29.226184 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:29.227988 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:29.229037 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:29.231087 (+ 2050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:29.231566 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:29.231699 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:29.235316 (+ 3617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:29.235321 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:29.235331 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:29.235365 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:29.238700 (+ 3335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:29.239519 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:29.239525 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:29.239533 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:29.239664 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:29.240137 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:29.240143 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:29.240146 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:29.240457 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:29.240685 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:29.241544 (+ 859us) server_negotiation.cc:299] Negotiation successful
0809 13:03:29.241800 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":398,"thread_start_us":260,"threads_started":1}
I20260809 13:03:29.243368 7879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:29.223014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.28.155.195:46293)
0809 13:03:29.223769 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:29.223815 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:29.225646 (+ 1831us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:29.226442 (+ 796us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:29.226450 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:29.227104 (+ 654us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:29.227800 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:29.227821 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:29.229206 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:29.229210 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:29.230928 (+ 1718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:29.230942 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:29.231806 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:29.231814 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:29.232057 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:29.232763 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:29.232787 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:29.235104 (+ 2317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:29.238869 (+ 3765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:29.238886 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:29.238907 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:29.239391 (+ 484us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:29.239785 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:29.239790 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:29.239794 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:29.240019 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:29.240653 (+ 634us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:29.240662 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:29.241135 (+ 473us) client_negotiation.cc:769] Sending connection context
0809 13:03:29.241441 (+ 306us) client_negotiation.cc:240] Negotiation successful
0809 13:03:29.242064 (+ 623us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":290,"threads_started":1}
I20260809 13:03:29.244752 7874 heartbeater.cc:347] Connected to a master server at 127.28.155.254:42999
I20260809 13:03:29.245092 7874 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:29.245890 7874 heartbeater.cc:511] Master 127.28.155.254:42999 requested a full tablet report, sending...
I20260809 13:03:29.247478 7096 ts_manager.cc:194] Registered new tserver with Master: 91632a26834d43f3a8fca18e454b405f (127.28.155.195:44473)
I20260809 13:03:29.248314 7096 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.28.155.195@KRBTEST.COM'} at 127.28.155.195:46293
I20260809 13:03:29.255872 29295 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.28.155.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.155.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.155.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.253.keytab.
Entry for principal oryx/127.28.155.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.253.keytab.
I20260809 13:03:29.317010 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.253:40247
--webserver_interface=127.28.155.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.253.keytab
--principal=oryx/127.28.155.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:37737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:42999,127.28.155.253:40247
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:29.683593 7884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:29.683921 7884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:29.684031 7884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:29.691479 7884 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:03:29.691598 7884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:29.691645 7884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:29.691702 7884 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:03:29.691748 7884 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:03:29.697891 7622 heartbeater.cc:503] Master 127.28.155.254:42999 was elected leader, sending a full tablet report...
I20260809 13:03:29.703032 7884 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:37737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:42999,127.28.155.253:40247
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.253.keytab
--principal=oryx/127.28.155.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.253:40247
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.28.155.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
W20260809 13:03:29.703440 7884 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.28.155.254:42999,127.28.155.253:40247'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260809 13:03:29.704633 7884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:29.705982 7884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:29.718109 7901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:29.718164 7904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:29.718071 7899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:29.719367 7884 server_base.cc:1034] running on GCE node
I20260809 13:03:29.720275 7884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:29.721899 7884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:29.723124 7884 hybrid_clock.cc:648] HybridClock initialized: now 1786280609723051 us; error 55 us; skew 500 ppm
I20260809 13:03:29.723471 7884 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:29 dist-test-slave-jq4t krb5kdc[7026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280609, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:29.726790 7884 init.cc:377] Logged in from keytab as oryx/127.28.155.253@KRBTEST.COM (short username oryx)
I20260809 13:03:29.728327 7884 webserver.cc:460] Webserver started at http://127.28.155.253:44901/ using document root <none> and password file <none>
I20260809 13:03:29.729125 7884 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:29.729249 7884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:29.729609 7884 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:29.732852 7884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-1/data/instance:
uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff"
format_stamp: "Formatted at 2026-08-09 13:03:29 on dist-test-slave-jq4t"
server_key: "5debff81b7269c6951f36d7403ac75d4"
server_key_iv: "25b50a79e21e68c2552c8b6a19dfb63e"
server_key_version: "encryptionkey@0"
I20260809 13:03:29.733793 7884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-1/wal/instance:
uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff"
format_stamp: "Formatted at 2026-08-09 13:03:29 on dist-test-slave-jq4t"
server_key: "5debff81b7269c6951f36d7403ac75d4"
server_key_iv: "25b50a79e21e68c2552c8b6a19dfb63e"
server_key_version: "encryptionkey@0"
I20260809 13:03:29.739451 7884 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 13:03:29.743249 7916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:29.744802 7884 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:03:29.744994 7884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-1/wal
uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff"
format_stamp: "Formatted at 2026-08-09 13:03:29 on dist-test-slave-jq4t"
server_key: "5debff81b7269c6951f36d7403ac75d4"
server_key_iv: "25b50a79e21e68c2552c8b6a19dfb63e"
server_key_version: "encryptionkey@0"
I20260809 13:03:29.745222 7884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:29.768460 7884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:29.773360 7884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:29.773670 7884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:29.793074 7884 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.253:40247
I20260809 13:03:29.793100 7994 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.253:40247 every 8 connection(s)
I20260809 13:03:29.794507 7884 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-1/data/info.pb
I20260809 13:03:29.794903 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 7884
I20260809 13:03:29.799551 7995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:29.808697 7995 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 13:03:29 dist-test-slave-jq4t krb5kdc[7026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280606, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.28.155.253@KRBTEST.COM
Aug 09 13:03:29 dist-test-slave-jq4t krb5kdc[7026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280609, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.253@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM
I20260809 13:03:29.821952 7998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:29.797731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40844 (local address 127.28.155.253:40247)
0809 13:03:29.798557 (+ 826us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:29.798572 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:29.798625 (+ 53us) server_negotiation.cc:407] Connection header received
0809 13:03:29.801049 (+ 2424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:29.801078 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:29.801589 (+ 511us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:29.802046 (+ 457us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:29.803538 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:29.805698 (+ 2160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:29.806995 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:29.808074 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:29.808269 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:29.813349 (+ 5080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:29.813361 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:29.813379 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:29.813434 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:29.817263 (+ 3829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:29.817995 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:29.818004 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:29.818018 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:29.818190 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:29.818602 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:29.818607 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:29.818610 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:29.819169 (+ 559us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:29.819486 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:29.820044 (+ 558us) server_negotiation.cc:299] Negotiation successful
0809 13:03:29.820465 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":594,"thread_start_us":354,"threads_started":1}
I20260809 13:03:29.828044 8005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:29.811619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38660 (local address 127.28.155.254:42999)
0809 13:03:29.813538 (+ 1919us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:29.813545 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:29.813566 (+ 21us) server_negotiation.cc:407] Connection header received
0809 13:03:29.813636 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:29.813641 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:29.813733 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:29.813852 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:29.815345 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:29.816616 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:29.818063 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:29.818561 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:29.818702 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:29.822700 (+ 3998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:29.822704 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:29.822708 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:29.822746 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:29.825605 (+ 2859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:29.826329 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:29.826333 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:29.826335 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:29.826455 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:29.826779 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:29.826782 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:29.826784 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:29.827114 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:29.827231 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:29.827610 (+ 379us) server_negotiation.cc:299] Negotiation successful
0809 13:03:29.827790 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1780,"thread_start_us":1672,"threads_started":1}
I20260809 13:03:29.828080 8000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:29.811582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.0.0.1:38660)
0809 13:03:29.812378 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:29.812427 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:29.812648 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:29.813941 (+ 1293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:29.813946 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:29.814778 (+ 832us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:29.815121 (+ 343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:29.815139 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:29.816753 (+ 1614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:29.816757 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:29.817906 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:29.817919 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:29.818755 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:29.818761 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:29.818936 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:29.819654 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:29.819671 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:29.822498 (+ 2827us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:29.825752 (+ 3254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:29.825762 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:29.825767 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:29.826221 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:29.826557 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:29.826561 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:29.826563 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:29.826692 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:29.827218 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:29.827224 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:29.827370 (+ 146us) client_negotiation.cc:769] Sending connection context
0809 13:03:29.827525 (+ 155us) client_negotiation.cc:240] Negotiation successful
0809 13:03:29.827784 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":338,"threads_started":1}
I20260809 13:03:29.830097 7995 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 13:03:29 dist-test-slave-jq4t krb5kdc[7026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280609, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.253@KRBTEST.COM for oryx/127.28.155.253@KRBTEST.COM
I20260809 13:03:29.842419 8000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:29.830930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:40247 (local address 127.0.0.1:40848)
0809 13:03:29.831135 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:29.831158 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:29.831245 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:29.831490 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:29.831493 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:29.831805 (+ 312us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:29.831940 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:29.831947 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:29.833146 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:29.833150 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:29.833989 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:29.833999 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:29.834631 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:29.834635 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:29.834755 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:29.835245 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:29.835261 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:29.837458 (+ 2197us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:29.840152 (+ 2694us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:29.840155 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:29.840158 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:29.840575 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:29.840933 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:29.840936 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:29.840938 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:29.841071 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:29.841518 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:29.841522 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:29.841639 (+ 117us) client_negotiation.cc:769] Sending connection context
0809 13:03:29.841745 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 13:03:29.842035 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 13:03:29.842589 7998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:29.830957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40848 (local address 127.28.155.253:40247)
0809 13:03:29.831125 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:29.831130 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:29.831214 (+ 84us) server_negotiation.cc:407] Connection header received
0809 13:03:29.831326 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:29.831330 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:29.831384 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:29.831461 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:29.832050 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:29.832830 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:29.834117 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:29.834507 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:29.834603 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:29.837645 (+ 3042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:29.837650 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:29.837653 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:29.837683 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:29.840021 (+ 2338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:29.840682 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:29.840685 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:29.840687 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:29.840828 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:29.841158 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:29.841161 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:29.841163 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:29.841410 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:29.841528 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:29.841844 (+ 316us) server_negotiation.cc:299] Negotiation successful
0809 13:03:29.842193 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":87,"server-negotiator.queue_time_us":64}
I20260809 13:03:29.847354 7995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff: Bootstrap starting.
I20260809 13:03:29.850922 7995 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:29.852041 7995 log.cc:824] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff: Log is configured to *not* fsync() on all Append() calls
I20260809 13:03:29.854799 7995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff: No bootstrap required, opened a new log
I20260809 13:03:29.861902 7995 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } }
I20260809 13:03:29.862237 7995 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:29.862334 7995 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8adab2e3f7e248bd899bb7ad2d3d7bff, State: Initialized, Role: FOLLOWER
I20260809 13:03:29.862951 7995 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } }
I20260809 13:03:29.863821 8009 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } } }
I20260809 13:03:29.864137 8009 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [sys.catalog]: This master's current role is: FOLLOWER
I20260809 13:03:29.864907 7995 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [sys.catalog]: configured and running, proceeding with master startup.
W20260809 13:03:29.874081 8022 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 13:03:29.874236 8022 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 13:03:29.877100 7884 master_runner.cc:428] Detected that this master 8adab2e3f7e248bd899bb7ad2d3d7bff is joining an existing cluster
I20260809 13:03:29.877211 7884 master_runner.cc:432] Initiating AddMaster RPC to add 127.28.155.253:40247
I20260809 13:03:29.898782 8033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:29.881812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.0.0.1:38672)
0809 13:03:29.882575 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:29.882598 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:29.882808 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:29.883444 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:29.883451 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:29.884237 (+ 786us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:29.884762 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:29.884783 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:29.886340 (+ 1557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:29.886353 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:29.888216 (+ 1863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:29.888235 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:29.889660 (+ 1425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:29.889668 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:29.889876 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:29.890691 (+ 815us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:29.890723 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:29.891602 (+ 879us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:29.895324 (+ 3722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:29.895329 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:29.895332 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:29.895837 (+ 505us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:29.896307 (+ 470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:29.896317 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:29.896321 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:29.896562 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:29.897418 (+ 856us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:29.897423 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:29.897631 (+ 208us) client_negotiation.cc:769] Sending connection context
0809 13:03:29.897791 (+ 160us) client_negotiation.cc:240] Negotiation successful
0809 13:03:29.898213 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":1322,"threads_started":1}
I20260809 13:03:29.899940 8005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:29.881835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38672 (local address 127.28.155.254:42999)
0809 13:03:29.882064 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:29.882072 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:29.882688 (+ 616us) server_negotiation.cc:407] Connection header received
0809 13:03:29.882964 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:29.882972 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:29.883098 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:29.883176 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:29.884971 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:29.886146 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:29.888414 (+ 2268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:29.889205 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:29.889347 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:29.891817 (+ 2470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:29.891821 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:29.891825 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:29.891858 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:29.895152 (+ 3294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:29.895970 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:29.895976 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:29.895980 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:29.896151 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:29.896852 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:29.896857 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:29.896860 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:29.897276 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:29.899106 (+ 1830us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:29.899294 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 13:03:29.899560 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
WARNING: no policy specified for oryx/127.28.155.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.155.252@KRBTEST.COM" created.
I20260809 13:03:29.920033 7998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:29.882928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40862 (local address 127.28.155.253:40247)
0809 13:03:29.883136 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:29.883142 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:29.894210 (+ 11068us) server_negotiation.cc:407] Connection header received
0809 13:03:29.894390 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:29.894395 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:29.894495 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:29.894606 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:29.896628 (+ 2022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:29.897765 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:29.899691 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:29.900400 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:29.900557 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:29.905787 (+ 5230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:29.905800 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:29.905805 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:29.905839 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:29.911034 (+ 5195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:29.917022 (+ 5988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:29.917028 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:29.917031 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:29.917226 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:29.917710 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:29.917720 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:29.917722 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:29.918289 (+ 567us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:29.918503 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:29.919170 (+ 667us) server_negotiation.cc:299] Negotiation successful
0809 13:03:29.919604 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":162,"server-negotiator.queue_time_us":61}
I20260809 13:03:29.920075 8034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:29.882517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:40247 (local address 127.0.0.1:40862)
0809 13:03:29.894074 (+ 11557us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:29.894097 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:29.894256 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:29.894789 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:29.894793 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:29.896030 (+ 1237us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:29.896451 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:29.896464 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:29.897957 (+ 1493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:29.897961 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:29.899545 (+ 1584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:29.899560 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:29.900738 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:29.900746 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:29.900871 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:29.904086 (+ 3215us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:29.904137 (+ 51us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:29.905583 (+ 1446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:29.916143 (+ 10560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:29.916152 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:29.916158 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:29.916861 (+ 703us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:29.917375 (+ 514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:29.917379 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:29.917384 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:29.917577 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:29.918666 (+ 1089us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:29.918671 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:29.918846 (+ 175us) client_negotiation.cc:769] Sending connection context
0809 13:03:29.919022 (+ 176us) client_negotiation.cc:240] Negotiation successful
0809 13:03:29.919393 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11370,"thread_start_us":11820,"threads_started":1}
Aug 09 13:03:29 dist-test-slave-jq4t krb5kdc[7026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280607, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.254@KRBTEST.COM for oryx/127.28.155.253@KRBTEST.COM
I20260809 13:03:29.948378 8037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:29.908254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40864 (local address 127.28.155.253:40247)
0809 13:03:29.912252 (+ 3998us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:29.912264 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:29.917227 (+ 4963us) server_negotiation.cc:407] Connection header received
0809 13:03:29.917661 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:29.917667 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:29.917764 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:29.917915 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:29.930636 (+ 12721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:29.932074 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:29.934484 (+ 2410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:29.935243 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:29.935386 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:29.940348 (+ 4962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:29.940360 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:29.940369 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:29.940430 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:29.944934 (+ 4504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:29.946009 (+ 1075us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:29.946013 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:29.946016 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:29.946190 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:29.946719 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:29.946723 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:29.946725 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:29.947049 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:29.947208 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:29.947831 (+ 623us) server_negotiation.cc:299] Negotiation successful
0809 13:03:29.948047 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":381,"server-negotiator.queue_time_us":3791,"thread_start_us":4025,"threads_started":1}
I20260809 13:03:29.948586 8036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:29.908243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:40247 (local address 127.0.0.1:40864)
0809 13:03:29.917082 (+ 8839us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:29.917134 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:29.917411 (+ 277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:29.918023 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:29.918033 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:29.929238 (+ 11205us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:29.929665 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:29.929684 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:29.932306 (+ 2622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:29.932317 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:29.934281 (+ 1964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:29.934307 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:29.935475 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:29.935484 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:29.935764 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:29.936707 (+ 943us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:29.936736 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:29.940023 (+ 3287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:29.945131 (+ 5108us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:29.945149 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:29.945157 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:29.945835 (+ 678us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:29.946312 (+ 477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:29.946319 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:29.946322 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:29.946547 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:29.947192 (+ 645us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:29.947201 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:29.947435 (+ 234us) client_negotiation.cc:769] Sending connection context
0809 13:03:29.947683 (+ 248us) client_negotiation.cc:240] Negotiation successful
0809 13:03:29.948101 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8360,"thread_start_us":8146,"threads_started":1}
I20260809 13:03:29.950908 7096 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.28.155.253:40247: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff"
member_type: NON_VOTER
last_known_addr {
host: "127.28.155.253"
port: 40247
}
attrs {
promote: true
}
}
dest_uuid: "b317f0a53c51431c85e6fe16a219c490"
cas_config_opid_index: -1
I20260809 13:03:29.952418 7096 consensus_queue.cc:237] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: NON_VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: true } }
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.155.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.252.keytab.
Entry for principal oryx/127.28.155.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.252.keytab.
I20260809 13:03:29.957441 7956 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:29.958411 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.252:39567
--webserver_interface=127.28.155.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.252.keytab
--principal=oryx/127.28.155.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:37737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:42999,127.28.155.253:40247,127.28.155.252:39567
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 13:03:29.961572 7956 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [term 1 FOLLOWER]: Refusing update from remote peer b317f0a53c51431c85e6fe16a219c490: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260809 13:03:29.967638 8042 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 8adab2e3f7e248bd899bb7ad2d3d7bff (127.28.155.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: NON_VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: true } } }
I20260809 13:03:29.968251 8041 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: NON_VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:03:29.971498 8042 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.28.155.253:40247
I20260809 13:03:29.972338 8042 sys_catalog.cc:455] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b317f0a53c51431c85e6fe16a219c490" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: NON_VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: true } } }
I20260809 13:03:29.972601 8042 sys_catalog.cc:458] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:29.972669 7884 master.cc:537] Master@127.28.155.253:40247 shutting down...
W20260809 13:03:29.978078 7076 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260809 13:03:29.986654 7884 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [term 1 FOLLOWER]: Raft consensus shutting down.
W20260809 13:03:29.986938 7076 consensus_peers.cc:487] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 -> Peer 8adab2e3f7e248bd899bb7ad2d3d7bff (127.28.155.253:40247): Couldn't send request to peer 8adab2e3f7e248bd899bb7ad2d3d7bff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 13:03:29.987190 7884 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:03:29.987417 7884 tablet_replica.cc:330] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff: stopping tablet replica
I20260809 13:03:29.995203 7884 master.cc:552] Master@127.28.155.253:40247 shutdown complete.
I20260809 13:03:29.995400 7884 master_runner.cc:305] Clearing existing system tablet
I20260809 13:03:29.996115 7884 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:29.996259 7884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:30.000207 7884 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 13:03:30.002470 8051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:30.002957 7884 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:30.003332 7884 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 13:03:30.003453 7884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-1/wal
uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff"
format_stamp: "Formatted at 2026-08-09 13:03:29 on dist-test-slave-jq4t"
server_key: "5debff81b7269c6951f36d7403ac75d4"
server_key_iv: "25b50a79e21e68c2552c8b6a19dfb63e"
server_key_version: "encryptionkey@0"
I20260809 13:03:30.010591 7884 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:03:30.018639 7884 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 13:03:30.018896 7884 log.cc:1196] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260809 13:03:30.019445 7884 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff: Deleting consensus metadata
I20260809 13:03:30.019740 7884 master_runner.cc:315] Copying system tablet from 127.28.155.254:42999
I20260809 13:03:30.027724 7884 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff: tablet copy: Beginning tablet copy session from remote peer at address 127.28.155.254:42999
I20260809 13:03:30.049310 8005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:30.029008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38682 (local address 127.28.155.254:42999)
0809 13:03:30.029213 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:30.029220 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:30.033264 (+ 4044us) server_negotiation.cc:407] Connection header received
0809 13:03:30.033511 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:30.033518 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:30.033618 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:30.033745 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:30.034888 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.036078 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.037992 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.038728 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.038865 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:30.041544 (+ 2679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:30.041552 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:30.041557 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:30.041602 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:30.045743 (+ 4141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:30.046715 (+ 972us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:30.046721 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:30.046725 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:30.046903 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:30.047382 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:30.047387 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:30.047391 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:30.047802 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:30.047976 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:30.048620 (+ 644us) server_negotiation.cc:299] Negotiation successful
0809 13:03:30.048894 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 13:03:30.049556 8063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:30.028938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.0.0.1:38682)
0809 13:03:30.033084 (+ 4146us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:30.033107 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:30.033314 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:30.033800 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:30.033804 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:30.034402 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:30.034706 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:30.034720 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.036246 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.036251 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:30.037806 (+ 1555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:30.037827 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.038924 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.038933 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:30.039146 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:30.039972 (+ 826us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:30.040003 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:30.041282 (+ 1279us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:30.045927 (+ 4645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:30.045933 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:30.045937 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:30.046558 (+ 621us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:30.047034 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:30.047039 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:30.047042 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:30.047244 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:30.047953 (+ 709us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:30.047961 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:30.048209 (+ 248us) client_negotiation.cc:769] Sending connection context
0809 13:03:30.048430 (+ 221us) client_negotiation.cc:240] Negotiation successful
0809 13:03:30.048916 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3971,"thread_start_us":3793,"threads_started":1}
I20260809 13:03:30.050876 7130 tablet_copy_service.cc:140] P b317f0a53c51431c85e6fe16a219c490: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 8adab2e3f7e248bd899bb7ad2d3d7bff ({username='oryx', principal='oryx/127.28.155.253@KRBTEST.COM'} at 127.0.0.1:38682)
I20260809 13:03:30.051429 7130 tablet_copy_service.cc:161] P b317f0a53c51431c85e6fe16a219c490: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 8adab2e3f7e248bd899bb7ad2d3d7bff at {username='oryx', principal='oryx/127.28.155.253@KRBTEST.COM'} at 127.0.0.1:38682: session id = 8adab2e3f7e248bd899bb7ad2d3d7bff-00000000000000000000000000000000
I20260809 13:03:30.056886 7130 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 13:03:30.059968 7884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 13:03:30.067888 7884 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff: tablet copy: Starting download of 0 data blocks...
I20260809 13:03:30.068344 7884 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff: tablet copy: Starting download of 1 WAL segments...
I20260809 13:03:30.072773 7884 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 13:03:30.078171 7130 tablet_copy_service.cc:342] P b317f0a53c51431c85e6fe16a219c490: Request end of tablet copy session 8adab2e3f7e248bd899bb7ad2d3d7bff-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.28.155.253@KRBTEST.COM'} at 127.0.0.1:38682
I20260809 13:03:30.078517 7130 tablet_copy_service.cc:433] P b317f0a53c51431c85e6fe16a219c490: ending tablet copy session 8adab2e3f7e248bd899bb7ad2d3d7bff-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 8adab2e3f7e248bd899bb7ad2d3d7bff
I20260809 13:03:30.091833 7884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:30.095293 8065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:30.095722 8066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:30.101871 7884 server_base.cc:1034] running on GCE node
W20260809 13:03:30.102312 8069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:30.102797 7884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:30.112514 7884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:30.113976 7884 hybrid_clock.cc:648] HybridClock initialized: now 1786280610113885 us; error 65 us; skew 500 ppm
I20260809 13:03:30.114256 7884 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:30 dist-test-slave-jq4t krb5kdc[7026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280610, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:30.116803 7884 init.cc:377] Logged in from keytab as oryx/127.28.155.253@KRBTEST.COM (short username oryx)
I20260809 13:03:30.124519 7884 webserver.cc:460] Webserver started at http://127.28.155.253:39189/ using document root <none> and password file <none>
I20260809 13:03:30.124963 7884 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:30.125061 7884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:30.128386 7884 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260809 13:03:30.130548 8081 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:30.131496 7884 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 13:03:30.131654 7884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-1/wal
uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff"
format_stamp: "Formatted at 2026-08-09 13:03:29 on dist-test-slave-jq4t"
server_key: "5debff81b7269c6951f36d7403ac75d4"
server_key_iv: "25b50a79e21e68c2552c8b6a19dfb63e"
server_key_version: "encryptionkey@0"
I20260809 13:03:30.131832 7884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:30.158821 7884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:30.163321 7884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:30.191049 7884 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.253:40247
I20260809 13:03:30.191119 8164 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.253:40247 every 8 connection(s)
I20260809 13:03:30.192340 7884 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-1/data/info.pb
I20260809 13:03:30.198998 8168 sys_catalog.cc:263] Verifying existing consensus state
I20260809 13:03:30.203948 8168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff: Bootstrap starting.
I20260809 13:03:30.226277 8168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 13:03:30.226958 8168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff: Bootstrap complete.
I20260809 13:03:30.228248 8168 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: NON_VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: true } }
I20260809 13:03:30.228636 8168 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8adab2e3f7e248bd899bb7ad2d3d7bff, State: Initialized, Role: LEARNER
I20260809 13:03:30.228930 8168 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: NON_VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: true } }
I20260809 13:03:30.229861 8171 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: NON_VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: true } } }
I20260809 13:03:30.230225 8168 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:03:30.230362 8171 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [sys.catalog]: This master's current role is: LEARNER
I20260809 13:03:30.241222 8192 catalog_manager.cc:1259] Loaded cluster ID: e9f390c010254238bb371f7000fec8b2
I20260809 13:03:30.241348 8192 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff: loading cluster ID for follower catalog manager: success
I20260809 13:03:30.245048 8192 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff: acquiring CA information for follower catalog manager: success
I20260809 13:03:30.248229 8192 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 13:03:30.251044 7874 heartbeater.cc:503] Master 127.28.155.254:42999 was elected leader, sending a full tablet report...
W20260809 13:03:30.416266 8049 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:30.416656 8049 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:30.416769 8049 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:30.424440 8049 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:03:30.424634 8049 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:30.424696 8049 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:30.424758 8049 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:03:30.424804 8049 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:03:30.435709 8049 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:37737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:42999,127.28.155.253:40247,127.28.155.252:39567
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.252.keytab
--principal=oryx/127.28.155.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.252:39567
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.28.155.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:30.437160 8049 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:30.438520 8049 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:30.451335 8202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:30.451364 8203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:30.451290 8205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:30.452368 8049 server_base.cc:1034] running on GCE node
I20260809 13:03:30.453398 8049 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:30.455152 8049 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:30.456385 8049 hybrid_clock.cc:648] HybridClock initialized: now 1786280610456331 us; error 53 us; skew 500 ppm
I20260809 13:03:30.456799 8049 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:30 dist-test-slave-jq4t krb5kdc[7026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280610, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:30.460423 8049 init.cc:377] Logged in from keytab as oryx/127.28.155.252@KRBTEST.COM (short username oryx)
I20260809 13:03:30.471625 8049 webserver.cc:460] Webserver started at http://127.28.155.252:45803/ using document root <none> and password file <none>
I20260809 13:03:30.472704 8049 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:30.472890 8049 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:30.473248 8049 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:30.476986 8049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-2/data/instance:
uuid: "7a67b38a17ca4b74bd025ea37b49c361"
format_stamp: "Formatted at 2026-08-09 13:03:30 on dist-test-slave-jq4t"
server_key: "0d6c0371b6bae53bc8f5a3580ee84917"
server_key_iv: "b94c2b7dfe0ca7c4606c2db6fd694373"
server_key_version: "encryptionkey@0"
I20260809 13:03:30.477900 8049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-2/wal/instance:
uuid: "7a67b38a17ca4b74bd025ea37b49c361"
format_stamp: "Formatted at 2026-08-09 13:03:30 on dist-test-slave-jq4t"
server_key: "0d6c0371b6bae53bc8f5a3580ee84917"
server_key_iv: "b94c2b7dfe0ca7c4606c2db6fd694373"
server_key_version: "encryptionkey@0"
I20260809 13:03:30.483976 8049 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260809 13:03:30.488339 8217 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:30.490008 8049 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 13:03:30.490239 8049 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-2/wal
uuid: "7a67b38a17ca4b74bd025ea37b49c361"
format_stamp: "Formatted at 2026-08-09 13:03:30 on dist-test-slave-jq4t"
server_key: "0d6c0371b6bae53bc8f5a3580ee84917"
server_key_iv: "b94c2b7dfe0ca7c4606c2db6fd694373"
server_key_version: "encryptionkey@0"
I20260809 13:03:30.490477 8049 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:30.509672 8228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:30.502643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:40247 (local address 127.0.0.1:40880)
0809 13:03:30.503215 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:30.503245 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:30.503420 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:30.503905 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:30.503909 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:30.503933 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:03:30.504097 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:30.504104 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.506001 (+ 1897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.506005 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:30.507300 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:30.507315 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.508960 (+ 1645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.508964 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:30.509160 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:30.509214 (+ 54us) client_negotiation.cc:769] Sending connection context
0809 13:03:30.509299 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 13:03:30.509415 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":231,"threads_started":1}
I20260809 13:03:30.509941 8229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:30.502853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40880 (local address 127.28.155.253:40247)
0809 13:03:30.503495 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:30.503503 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:30.503527 (+ 24us) server_negotiation.cc:407] Connection header received
0809 13:03:30.503607 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:30.503612 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:30.503706 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:30.503837 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:03:30.504283 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.505834 (+ 1551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.507466 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.508729 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.508882 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:30.509144 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:30.509340 (+ 196us) server_negotiation.cc:299] Negotiation successful
0809 13:03:30.509478 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":496,"thread_start_us":372,"threads_started":1}
I20260809 13:03:30.511198 8127 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260809 13:03:30.511824 8171 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [sys.catalog]: SysCatalogTable state changed. Reason: New leader b317f0a53c51431c85e6fe16a219c490. Latest consensus state: current_term: 1 leader_uuid: "b317f0a53c51431c85e6fe16a219c490" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: NON_VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: true } } }
I20260809 13:03:30.512127 8171 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [sys.catalog]: This master's current role is: LEARNER
I20260809 13:03:30.545807 8049 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:30.550463 8049 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:30.550800 8049 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:30.571403 8049 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.252:39567
I20260809 13:03:30.571444 8317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.252:39567 every 8 connection(s)
I20260809 13:03:30.573021 8049 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-2/data/info.pb
I20260809 13:03:30.577113 8318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:30.583230 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 8049
I20260809 13:03:30.584633 8318 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 13:03:30 dist-test-slave-jq4t krb5kdc[7026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280610, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.252@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM
Aug 09 13:03:30 dist-test-slave-jq4t krb5kdc[7026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280606, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.28.155.252@KRBTEST.COM
I20260809 13:03:30.605559 8324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:30.588027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38686 (local address 127.28.155.254:42999)
0809 13:03:30.588559 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:30.588568 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:30.589107 (+ 539us) server_negotiation.cc:407] Connection header received
0809 13:03:30.589723 (+ 616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:30.589731 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:30.589815 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:30.589945 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:30.591264 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.592067 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.593658 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.594078 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.594226 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:30.598556 (+ 4330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:30.598561 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:30.598564 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:30.598600 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:30.601733 (+ 3133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:30.602817 (+ 1084us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:30.602821 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:30.602824 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:30.602992 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:30.603550 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:30.603555 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:30.603557 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:30.603878 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:30.604008 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:30.605006 (+ 998us) server_negotiation.cc:299] Negotiation successful
0809 13:03:30.605200 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":257,"threads_started":1}
I20260809 13:03:30.606880 8325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:30.587965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.0.0.1:38686)
0809 13:03:30.588949 (+ 984us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:30.588991 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:30.589474 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:30.590019 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:30.590025 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:30.590700 (+ 675us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:30.591091 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:30.591108 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.592216 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.592221 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:30.593515 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:30.593527 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.594364 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.594372 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:30.594579 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:30.595408 (+ 829us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:30.595443 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:30.598351 (+ 2908us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:30.601969 (+ 3618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:30.601980 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:30.602008 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:30.602672 (+ 664us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:30.603111 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:30.603118 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:30.603124 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:30.603402 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:30.604023 (+ 621us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:30.604032 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:30.604553 (+ 521us) client_negotiation.cc:769] Sending connection context
0809 13:03:30.604824 (+ 271us) client_negotiation.cc:240] Negotiation successful
0809 13:03:30.605372 (+ 548us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":763,"thread_start_us":599,"threads_started":1}
I20260809 13:03:30.607017 8322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:30.585990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35716 (local address 127.28.155.252:39567)
0809 13:03:30.586790 (+ 800us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:30.586804 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:30.586846 (+ 42us) server_negotiation.cc:407] Connection header received
0809 13:03:30.589463 (+ 2617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:30.589484 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:30.589714 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:30.589930 (+ 216us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:30.591547 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.592803 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.594073 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.594695 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.594855 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:30.599912 (+ 5057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:30.599921 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:30.599934 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:30.599970 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:30.603473 (+ 3503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:30.604270 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:30.604276 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:30.604278 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:30.604461 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:30.604922 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:30.604926 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:30.604929 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:30.605345 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:30.605640 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:30.606331 (+ 691us) server_negotiation.cc:299] Negotiation successful
0809 13:03:30.606595 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":343,"threads_started":1}
I20260809 13:03:30.608647 8318 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 13:03:30 dist-test-slave-jq4t krb5kdc[7026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280610, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.252@KRBTEST.COM for oryx/127.28.155.253@KRBTEST.COM
I20260809 13:03:30.622651 8325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:30.609558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:40247 (local address 127.0.0.1:40888)
0809 13:03:30.609756 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:30.609781 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:30.609868 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:30.610363 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:30.610368 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:30.610723 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:30.610880 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:30.610888 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.611918 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.611921 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:30.612929 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:30.612941 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.613653 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.613657 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:30.613786 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:30.614401 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:30.614418 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:30.616747 (+ 2329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:30.620138 (+ 3391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:30.620142 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:30.620153 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:30.620724 (+ 571us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:30.621159 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:30.621162 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:30.621164 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:30.621301 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:30.621844 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:30.621848 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:30.621998 (+ 150us) client_negotiation.cc:769] Sending connection context
0809 13:03:30.622143 (+ 145us) client_negotiation.cc:240] Negotiation successful
0809 13:03:30.622400 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260809 13:03:30.622772 8229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:30.609696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40888 (local address 127.28.155.253:40247)
0809 13:03:30.610066 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:30.610070 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:30.610087 (+ 17us) server_negotiation.cc:407] Connection header received
0809 13:03:30.610140 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:30.610143 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:30.610204 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:30.610329 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:30.611030 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.611800 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.613080 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.613526 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.613629 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:30.616966 (+ 3337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:30.616971 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:30.616975 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:30.617014 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:30.619959 (+ 2945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:30.620857 (+ 898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:30.620861 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:30.620864 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:30.621037 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:30.621398 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:30.621401 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:30.621403 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:30.621710 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:30.621835 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:30.622302 (+ 467us) server_negotiation.cc:299] Negotiation successful
0809 13:03:30.622518 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256}
I20260809 13:03:30.623986 8318 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.252" port: 39567 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 13:03:30 dist-test-slave-jq4t krb5kdc[7026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280610, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.252@KRBTEST.COM for oryx/127.28.155.252@KRBTEST.COM
I20260809 13:03:30.637498 8325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:30.624765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:39567 (local address 127.0.0.1:35722)
0809 13:03:30.624958 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:30.624978 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:30.625100 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:30.625383 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:30.625387 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:30.625788 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:30.625937 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:30.625945 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.626899 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.626906 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:30.627809 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:30.627827 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.628564 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.628569 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:30.628789 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:30.629420 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:30.629438 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:30.631834 (+ 2396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:30.635158 (+ 3324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:30.635162 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:30.635165 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:30.635535 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:30.635866 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:30.635869 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:30.635871 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:30.636021 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:30.636570 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:30.636574 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:30.636793 (+ 219us) client_negotiation.cc:769] Sending connection context
0809 13:03:30.636945 (+ 152us) client_negotiation.cc:240] Negotiation successful
0809 13:03:30.637181 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260809 13:03:30.637583 8322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:30.624789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35722 (local address 127.28.155.252:39567)
0809 13:03:30.624979 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:30.624985 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:30.625034 (+ 49us) server_negotiation.cc:407] Connection header received
0809 13:03:30.625219 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:30.625223 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:30.625274 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:30.625366 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:30.626071 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.626776 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.627992 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.628394 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.628557 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:30.632023 (+ 3466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:30.632028 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:30.632031 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:30.632070 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:30.635000 (+ 2930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:30.635638 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:30.635641 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:30.635644 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:30.635773 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:30.636110 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:30.636113 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:30.636115 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:30.636395 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:30.636618 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:30.637045 (+ 427us) server_negotiation.cc:299] Negotiation successful
0809 13:03:30.637321 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":74,"server-negotiator.queue_time_us":49}
I20260809 13:03:30.642624 8318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361: Bootstrap starting.
I20260809 13:03:30.646396 8318 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:30.647770 8318 log.cc:824] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361: Log is configured to *not* fsync() on all Append() calls
I20260809 13:03:30.651459 8318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361: No bootstrap required, opened a new log
I20260809 13:03:30.659382 8318 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 39567 } }
I20260809 13:03:30.659802 8318 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:30.659947 8318 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a67b38a17ca4b74bd025ea37b49c361, State: Initialized, Role: FOLLOWER
I20260809 13:03:30.660670 8318 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 39567 } }
I20260809 13:03:30.662282 8328 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 39567 } } }
I20260809 13:03:30.662670 8328 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 13:03:30.663609 8318 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 13:03:30.673229 8348 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 13:03:30.673430 8348 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 13:03:30.677690 8049 master_runner.cc:428] Detected that this master 7a67b38a17ca4b74bd025ea37b49c361 is joining an existing cluster
I20260809 13:03:30.677847 8049 master_runner.cc:432] Initiating AddMaster RPC to add 127.28.155.252:39567
I20260809 13:03:30.703632 8229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:30.682497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40900 (local address 127.28.155.253:40247)
0809 13:03:30.682776 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:30.682784 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:30.683802 (+ 1018us) server_negotiation.cc:407] Connection header received
0809 13:03:30.684186 (+ 384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:30.684193 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:30.684293 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:30.684371 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:30.686273 (+ 1902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.687439 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.690100 (+ 2661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.690769 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.690872 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:30.694386 (+ 3514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:30.694393 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:30.694398 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:30.694457 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:30.698610 (+ 4153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:30.699557 (+ 947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:30.699563 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:30.699568 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:30.699732 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:30.700294 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:30.700301 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:30.700305 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:30.700771 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:30.700925 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:30.702948 (+ 2023us) server_negotiation.cc:299] Negotiation successful
0809 13:03:30.703236 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131}
I20260809 13:03:30.703850 8324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:30.682613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38696 (local address 127.28.155.254:42999)
0809 13:03:30.682825 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:30.682831 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:30.684283 (+ 1452us) server_negotiation.cc:407] Connection header received
0809 13:03:30.684597 (+ 314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:30.684602 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:30.684688 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:30.684764 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:30.686320 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.687449 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.690030 (+ 2581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.690740 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.690866 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:30.694387 (+ 3521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:30.694393 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:30.694398 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:30.694441 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:30.698887 (+ 4446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:30.700225 (+ 1338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:30.700234 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:30.700238 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:30.701307 (+ 1069us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:30.701886 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:30.701891 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:30.701894 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:30.702292 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:30.702440 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:30.703149 (+ 709us) server_negotiation.cc:299] Negotiation successful
0809 13:03:30.703419 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 13:03:30.705219 8363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:30.683006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.0.0.1:38696)
0809 13:03:30.684187 (+ 1181us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:30.684204 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:30.684376 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:30.685005 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:30.685010 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:30.685693 (+ 683us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:30.686148 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:30.686161 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.687661 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.687666 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:30.689821 (+ 2155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:30.689841 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.691350 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.691361 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:30.691553 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:30.692577 (+ 1024us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:30.692602 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:30.694132 (+ 1530us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:30.699092 (+ 4960us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:30.699373 (+ 281us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:30.699378 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:30.700057 (+ 679us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:30.701481 (+ 1424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:30.701485 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:30.701499 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:30.701735 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:30.702547 (+ 812us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:30.702551 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:30.702809 (+ 258us) client_negotiation.cc:769] Sending connection context
0809 13:03:30.704021 (+ 1212us) client_negotiation.cc:240] Negotiation successful
0809 13:03:30.704549 (+ 528us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1036,"mutex_wait_us":215,"spinlock_wait_cycles":31616,"thread_start_us":751,"threads_started":1}
I20260809 13:03:30.705245 8361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:30.682817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:40247 (local address 127.0.0.1:40900)
0809 13:03:30.683656 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:30.683695 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:30.683991 (+ 296us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:30.684651 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:30.684656 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:30.685562 (+ 906us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:30.686071 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:30.686090 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.687661 (+ 1571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.687666 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:30.689937 (+ 2271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:30.689949 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.691208 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.691214 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:30.691537 (+ 323us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:30.692446 (+ 909us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:30.692509 (+ 63us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:30.694132 (+ 1623us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:30.698793 (+ 4661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:30.698805 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:30.698809 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:30.699373 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:30.699899 (+ 526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:30.699904 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:30.699911 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:30.700153 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:30.701030 (+ 877us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:30.701034 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:30.702584 (+ 1550us) client_negotiation.cc:769] Sending connection context
0809 13:03:30.704028 (+ 1444us) client_negotiation.cc:240] Negotiation successful
0809 13:03:30.704743 (+ 715us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":685,"mutex_wait_us":552,"spinlock_wait_cycles":49920,"thread_start_us":514,"threads_started":1}
I20260809 13:03:30.706548 8322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:30.684716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35732 (local address 127.28.155.252:39567)
0809 13:03:30.684931 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:30.684937 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:30.689356 (+ 4419us) server_negotiation.cc:407] Connection header received
0809 13:03:30.689575 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:30.689580 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:30.689657 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:30.689732 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:30.691213 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.692433 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.694623 (+ 2190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.695407 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.695507 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:30.698364 (+ 2857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:30.698372 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:30.698378 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:30.698413 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:30.702387 (+ 3974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:30.703316 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:30.703324 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:30.703330 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:30.703462 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:30.704408 (+ 946us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:30.704417 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:30.704421 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:30.704888 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:30.705088 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:30.705894 (+ 806us) server_negotiation.cc:299] Negotiation successful
0809 13:03:30.706165 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":34,"server-negotiator.queue_time_us":68}
I20260809 13:03:30.707548 8364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:30.684265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:39567 (local address 127.0.0.1:35732)
0809 13:03:30.689257 (+ 4992us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:30.689282 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:30.689446 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:30.689923 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:30.689927 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:30.690664 (+ 737us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:30.691084 (+ 420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:30.691097 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.692725 (+ 1628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.692734 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:30.694436 (+ 1702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:30.694453 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.695950 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.695958 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:30.696133 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:30.696818 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:30.696841 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:30.698161 (+ 1320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:30.702626 (+ 4465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:30.702631 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:30.702634 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:30.703186 (+ 552us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:30.703595 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:30.703600 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:30.703604 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:30.704274 (+ 670us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:30.705142 (+ 868us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:30.705150 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:30.705332 (+ 182us) client_negotiation.cc:769] Sending connection context
0809 13:03:30.706725 (+ 1393us) client_negotiation.cc:240] Negotiation successful
0809 13:03:30.707044 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4843,"spinlock_wait_cycles":1408,"thread_start_us":4412,"threads_started":1}
I20260809 13:03:30.713889 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 7200
Aug 09 13:03:30 dist-test-slave-jq4t krb5kdc[7026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280607, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.254@KRBTEST.COM for oryx/127.28.155.252@KRBTEST.COM
I20260809 13:03:30.727200 8228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:30.711367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:39567 (local address 127.0.0.1:35734)
0809 13:03:30.711572 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:30.711593 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:30.711705 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:30.712186 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:30.712191 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:30.712685 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:30.712833 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:30.712842 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.714139 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.714145 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:30.715644 (+ 1499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:30.715663 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.716433 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.716438 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:30.716684 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:30.717309 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:30.717328 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:30.720007 (+ 2679us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:30.724228 (+ 4221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:30.724233 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:30.724237 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:30.724755 (+ 518us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:30.725209 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:30.725214 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:30.725218 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:30.725435 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:30.726167 (+ 732us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:30.726174 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:30.726363 (+ 189us) client_negotiation.cc:769] Sending connection context
0809 13:03:30.726533 (+ 170us) client_negotiation.cc:240] Negotiation successful
0809 13:03:30.726851 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 13:03:30.728996 8322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:30.711403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35734 (local address 127.28.155.252:39567)
0809 13:03:30.711570 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:30.711576 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:30.711647 (+ 71us) server_negotiation.cc:407] Connection header received
0809 13:03:30.711859 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:30.711871 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:30.711996 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:30.712104 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:30.712996 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.713972 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.715793 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.716258 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.716409 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:30.720261 (+ 3852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:30.720270 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:30.720276 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:30.720324 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:30.724083 (+ 3759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:30.724879 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:30.724884 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:30.724888 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:30.725096 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:30.725599 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:30.725605 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:30.725609 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:30.726024 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:30.726183 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:30.726684 (+ 501us) server_negotiation.cc:299] Negotiation successful
0809 13:03:30.728733 (+ 2049us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
Aug 09 13:03:30 dist-test-slave-jq4t krb5kdc[7026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280606, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.28.155.193@KRBTEST.COM
I20260809 13:03:30.730924 7096 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.28.155.252:39567: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361"
member_type: NON_VOTER
last_known_addr {
host: "127.28.155.252"
port: 39567
}
attrs {
promote: true
}
}
dest_uuid: "b317f0a53c51431c85e6fe16a219c490"
cas_config_opid_index: 5
I20260809 13:03:30.732195 7096 consensus_queue.cc:237] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: NON_VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: true } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: NON_VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: true } }
I20260809 13:03:30.734267 8226 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 7a67b38a17ca4b74bd025ea37b49c361 (127.28.155.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: NON_VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: true } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: NON_VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: true } } }
I20260809 13:03:30.735011 8127 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [term 1 LEARNER]: Refusing update from remote peer b317f0a53c51431c85e6fe16a219c490: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 13:03:30.737696 8265 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:30.744041 8265 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [term 1 FOLLOWER]: Refusing update from remote peer b317f0a53c51431c85e6fe16a219c490: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 13:03:30.748767 8226 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.28.155.252:39567
I20260809 13:03:30.748970 8367 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: NON_VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260809 13:03:30.749532 8049 master.cc:537] Master@127.28.155.252:39567 shutting down...
I20260809 13:03:30.754500 8365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:30.717862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58252 (local address 127.28.155.193:45137)
0809 13:03:30.718655 (+ 793us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:30.718664 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:30.718693 (+ 29us) server_negotiation.cc:407] Connection header received
0809 13:03:30.718766 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:30.718778 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:30.719083 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:30.721246 (+ 2163us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:30.721614 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.723359 (+ 1745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.725346 (+ 1987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.726054 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.726839 (+ 785us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:30.738066 (+ 11227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:30.738094 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:30.738116 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:30.738185 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:30.745871 (+ 7686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:30.748438 (+ 2567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:30.748451 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:30.748455 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:30.748696 (+ 241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:30.749776 (+ 1080us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:30.749781 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:30.749784 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:30.750340 (+ 556us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:30.753535 (+ 3195us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:30.753728 (+ 193us) server_negotiation.cc:299] Negotiation successful
0809 13:03:30.754066 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":576,"thread_start_us":355,"threads_started":1}
I20260809 13:03:30.756076 7398 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:30.755424 8366 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: NON_VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.001s
I20260809 13:03:30.754228 8127 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 7a67b38a17ca4b74bd025ea37b49c361 (127.28.155.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: NON_VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: true } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: NON_VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: true } } }
I20260809 13:03:30.757853 8367 sys_catalog.cc:455] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b317f0a53c51431c85e6fe16a219c490" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: NON_VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: true } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: NON_VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: true } } }
I20260809 13:03:30.758265 8367 sys_catalog.cc:458] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:30.761483 8171 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b317f0a53c51431c85e6fe16a219c490" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: NON_VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: true } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: NON_VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: true } } }
I20260809 13:03:30.761822 8171 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [sys.catalog]: This master's current role is: LEARNER
I20260809 13:03:30.762076 8226 raft_consensus.cc:1050] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490: attempting to promote NON_VOTER 8adab2e3f7e248bd899bb7ad2d3d7bff to VOTER
I20260809 13:03:30.766531 8049 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:03:30.767130 8049 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:03:30.767431 8049 tablet_replica.cc:330] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361: stopping tablet replica
I20260809 13:03:30.770879 8226 consensus_queue.cc:237] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: false } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: NON_VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: true } }
I20260809 13:03:30.773703 8127 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [term 1 LEARNER]: Refusing update from remote peer b317f0a53c51431c85e6fe16a219c490: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260809 13:03:30.774679 8367 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260809 13:03:30.777292 8368 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 8adab2e3f7e248bd899bb7ad2d3d7bff (127.28.155.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: false } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: NON_VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: true } } }
I20260809 13:03:30.778239 8127 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 8adab2e3f7e248bd899bb7ad2d3d7bff (127.28.155.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: false } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: NON_VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: true } } }
W20260809 13:03:30.778690 7074 connection.cc:698] client connection to 127.28.155.252:39567 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260809 13:03:30.780439 8228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:30.779889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:39567 (local address 127.0.0.1:35740)
0809 13:03:30.780098 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:30.780228 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:39567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260809 13:03:30.780838 7074 consensus_peers.cc:487] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 -> Peer 7a67b38a17ca4b74bd025ea37b49c361 (127.28.155.252:39567): Couldn't send request to peer 7a67b38a17ca4b74bd025ea37b49c361. Status: Network error: Client connection negotiation failed: client connection to 127.28.155.252:39567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 13:03:30.782272 8368 sys_catalog.cc:455] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b317f0a53c51431c85e6fe16a219c490" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: false } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: NON_VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: true } } }
I20260809 13:03:30.782703 8368 sys_catalog.cc:458] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:30.782722 8366 sys_catalog.cc:455] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b317f0a53c51431c85e6fe16a219c490" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: false } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: NON_VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: true } } }
I20260809 13:03:30.783031 8366 sys_catalog.cc:458] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:30.783547 8171 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b317f0a53c51431c85e6fe16a219c490" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: false } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: NON_VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: true } } }
I20260809 13:03:30.783788 8171 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [sys.catalog]: This master's current role is: FOLLOWER
I20260809 13:03:30.784730 8049 master.cc:552] Master@127.28.155.252:39567 shutdown complete.
I20260809 13:03:30.784838 8049 master_runner.cc:305] Clearing existing system tablet
I20260809 13:03:30.785356 8049 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:30.785477 8049 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:30.788708 8049 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.004s
I20260809 13:03:30.790560 8383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:30.791038 8049 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:30.791316 8049 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260809 13:03:30.791428 8049 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-2/wal
uuid: "7a67b38a17ca4b74bd025ea37b49c361"
format_stamp: "Formatted at 2026-08-09 13:03:30 on dist-test-slave-jq4t"
server_key: "0d6c0371b6bae53bc8f5a3580ee84917"
server_key_iv: "b94c2b7dfe0ca7c4606c2db6fd694373"
server_key_version: "encryptionkey@0"
I20260809 13:03:30.796864 8049 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:03:30.804174 8049 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 13:03:30.804363 8049 log.cc:1196] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260809 13:03:30.804898 8049 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361: Deleting consensus metadata
I20260809 13:03:30.805182 8049 master_runner.cc:315] Copying system tablet from 127.28.155.254:42999
I20260809 13:03:30.807992 8049 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361: tablet copy: Beginning tablet copy session from remote peer at address 127.28.155.254:42999
I20260809 13:03:30.825007 8324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:30.809268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38712 (local address 127.28.155.254:42999)
0809 13:03:30.809509 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:30.809515 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:30.809694 (+ 179us) server_negotiation.cc:407] Connection header received
0809 13:03:30.809999 (+ 305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:30.810005 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:30.810100 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:30.810216 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:30.811378 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.812636 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.814570 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.815281 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.815417 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:30.817911 (+ 2494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:30.817918 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:30.817923 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:30.817968 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:30.821784 (+ 3816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:30.822637 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:30.822643 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:30.822647 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:30.822824 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:30.823267 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:30.823273 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:30.823276 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:30.823683 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:30.823845 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:30.824311 (+ 466us) server_negotiation.cc:299] Negotiation successful
0809 13:03:30.824627 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260809 13:03:30.825070 8396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:30.808930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.0.0.1:38712)
0809 13:03:30.809527 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:30.809566 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:30.809756 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:30.810271 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:30.810277 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:30.810868 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:30.811167 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:30.811182 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.812821 (+ 1639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.812827 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:30.814383 (+ 1556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:30.814400 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:30.815474 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:30.815482 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:30.815671 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:30.816524 (+ 853us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:30.816551 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:30.817669 (+ 1118us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:30.821961 (+ 4292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:30.821967 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:30.821972 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:30.822496 (+ 524us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:30.822953 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:30.822958 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:30.822962 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:30.823149 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:30.823815 (+ 666us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:30.823820 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:30.824013 (+ 193us) client_negotiation.cc:769] Sending connection context
0809 13:03:30.824181 (+ 168us) client_negotiation.cc:240] Negotiation successful
0809 13:03:30.824592 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":457,"threads_started":1}
I20260809 13:03:30.826030 7130 tablet_copy_service.cc:140] P b317f0a53c51431c85e6fe16a219c490: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 7a67b38a17ca4b74bd025ea37b49c361 ({username='oryx', principal='oryx/127.28.155.252@KRBTEST.COM'} at 127.0.0.1:38712)
I20260809 13:03:30.826215 7130 tablet_copy_service.cc:161] P b317f0a53c51431c85e6fe16a219c490: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 7a67b38a17ca4b74bd025ea37b49c361 at {username='oryx', principal='oryx/127.28.155.252@KRBTEST.COM'} at 127.0.0.1:38712: session id = 7a67b38a17ca4b74bd025ea37b49c361-00000000000000000000000000000000
I20260809 13:03:30.830279 7130 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 13:03:30.832536 8049 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 13:03:30.839870 8049 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361: tablet copy: Starting download of 0 data blocks...
I20260809 13:03:30.840224 8049 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361: tablet copy: Starting download of 1 WAL segments...
I20260809 13:03:30.843091 8049 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 13:03:30.847920 7130 tablet_copy_service.cc:342] P b317f0a53c51431c85e6fe16a219c490: Request end of tablet copy session 7a67b38a17ca4b74bd025ea37b49c361-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.28.155.252@KRBTEST.COM'} at 127.0.0.1:38712
I20260809 13:03:30.848085 7130 tablet_copy_service.cc:433] P b317f0a53c51431c85e6fe16a219c490: ending tablet copy session 7a67b38a17ca4b74bd025ea37b49c361-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 7a67b38a17ca4b74bd025ea37b49c361
I20260809 13:03:30.859774 8049 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:30.862536 8397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:30.865871 8398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:30.876441 8401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:30.881947 8049 server_base.cc:1034] running on GCE node
I20260809 13:03:30.882393 8049 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:30.883127 8049 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:30.884348 8049 hybrid_clock.cc:648] HybridClock initialized: now 1786280610884305 us; error 28 us; skew 500 ppm
I20260809 13:03:30.884642 8049 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:30 dist-test-slave-jq4t krb5kdc[7026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280610, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:30.887805 8049 init.cc:377] Logged in from keytab as oryx/127.28.155.252@KRBTEST.COM (short username oryx)
I20260809 13:03:30.889324 8049 webserver.cc:460] Webserver started at http://127.28.155.252:36615/ using document root <none> and password file <none>
I20260809 13:03:30.889705 8049 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:30.889806 8049 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:30.893072 8049 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.002s
I20260809 13:03:30.895424 8415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:30.896273 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 7200
I20260809 13:03:30.896345 8049 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260809 13:03:30.896731 8049 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-2/wal
uuid: "7a67b38a17ca4b74bd025ea37b49c361"
format_stamp: "Formatted at 2026-08-09 13:03:30 on dist-test-slave-jq4t"
server_key: "0d6c0371b6bae53bc8f5a3580ee84917"
server_key_iv: "b94c2b7dfe0ca7c4606c2db6fd694373"
server_key_version: "encryptionkey@0"
I20260809 13:03:30.900665 8049 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:30.928321 8049 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:30.931717 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:45137
--local_ip_for_outbound_sockets=127.28.155.193
--tserver_master_addrs=127.28.155.254:42999
--webserver_port=42665
--webserver_interface=127.28.155.193
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.193.keytab
--principal=oryx/127.28.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:37737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.28.155.254:42999,127.28.155.253:40247
--tserver_master_addrs=127.28.155.254:42999,127.28.155.253:40247,127.28.155.252:39567 with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 13:03:30.936439 8049 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:30.983667 8049 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.252:39567
I20260809 13:03:30.983736 8497 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.252:39567 every 8 connection(s)
I20260809 13:03:30.984990 8049 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/master-2/data/info.pb
I20260809 13:03:30.991019 8498 sys_catalog.cc:263] Verifying existing consensus state
I20260809 13:03:30.995239 8498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361: Bootstrap starting.
I20260809 13:03:31.014081 8498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 13:03:31.014667 8498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361: Bootstrap complete.
I20260809 13:03:31.015888 8498 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: false } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: NON_VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: true } }
I20260809 13:03:31.016229 8498 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7a67b38a17ca4b74bd025ea37b49c361, State: Initialized, Role: LEARNER
I20260809 13:03:31.016557 8498 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: false } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: NON_VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: true } }
I20260809 13:03:31.017797 8505 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: false } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: NON_VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: true } } }
I20260809 13:03:31.018112 8498 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:03:31.018298 8505 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [sys.catalog]: This master's current role is: LEARNER
I20260809 13:03:31.029099 8524 catalog_manager.cc:1259] Loaded cluster ID: e9f390c010254238bb371f7000fec8b2
I20260809 13:03:31.029237 8524 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361: loading cluster ID for follower catalog manager: success
I20260809 13:03:31.033102 8524 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361: acquiring CA information for follower catalog manager: success
I20260809 13:03:31.035650 8524 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 13:03:31.282094 8525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:31.275108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35748 (local address 127.28.155.252:39567)
0809 13:03:31.275718 (+ 610us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:31.275724 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:31.275744 (+ 20us) server_negotiation.cc:407] Connection header received
0809 13:03:31.275809 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:31.275812 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:31.275891 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:31.276001 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:03:31.276575 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:31.277585 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:31.280093 (+ 2508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:31.281055 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:31.281215 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:31.281356 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:31.281692 (+ 336us) server_negotiation.cc:299] Negotiation successful
0809 13:03:31.281807 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":338,"threads_started":1}
I20260809 13:03:31.282128 8228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:31.274860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:39567 (local address 127.0.0.1:35748)
0809 13:03:31.275140 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:31.275166 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:31.275324 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:31.276072 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:31.276078 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:31.276117 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:03:31.276349 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:31.276361 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:31.277749 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:31.277755 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:31.279843 (+ 2088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:31.279864 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:31.281234 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:31.281241 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:31.281475 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:31.281517 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 13:03:31.281636 (+ 119us) client_negotiation.cc:240] Negotiation successful
0809 13:03:31.281806 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260809 13:03:31.283321 8462 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260809 13:03:31.284090 8505 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b317f0a53c51431c85e6fe16a219c490. Latest consensus state: current_term: 1 leader_uuid: "b317f0a53c51431c85e6fe16a219c490" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: false } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: NON_VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: true } } }
I20260809 13:03:31.284415 8505 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [sys.catalog]: This master's current role is: LEARNER
W20260809 13:03:31.337821 8425 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:31.338366 8425 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:31.338558 8425 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:31.346325 8425 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:31.346448 8425 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:31.346593 8425 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:03:31.357024 8425 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:37737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.193.keytab
--principal=oryx/127.28.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:45137
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=42665
--tserver_master_addrs=127.28.155.254:42999,127.28.155.253:40247,127.28.155.252:39567
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:31.358413 8425 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:31.359839 8425 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:31.374063 8531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:31.374027 8536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:31.373984 8532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:31.375015 8425 server_base.cc:1034] running on GCE node
I20260809 13:03:31.375679 8425 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:31.376736 8425 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:31.377949 8425 hybrid_clock.cc:648] HybridClock initialized: now 1786280611377894 us; error 46 us; skew 500 ppm
I20260809 13:03:31.378305 8425 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:31 dist-test-slave-jq4t krb5kdc[7026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280611, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:31.384773 8425 init.cc:377] Logged in from keytab as oryx/127.28.155.193@KRBTEST.COM (short username oryx)
I20260809 13:03:31.386801 8425 webserver.cc:460] Webserver started at http://127.28.155.193:42665/ using document root <none> and password file <none>
I20260809 13:03:31.387893 8425 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:31.388088 8425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:31.394778 8425 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 13:03:31.397984 8549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:31.399431 8425 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:03:31.399633 8425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254"
format_stamp: "Formatted at 2026-08-09 13:03:28 on dist-test-slave-jq4t"
server_key: "efd1e55e04fd4ab9ca66d5cbd6480c0a"
server_key_iv: "b01fb6d7a8bb19f10afd6b1bf29ef3dd"
server_key_version: "encryptionkey@0"
I20260809 13:03:31.400792 8425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:31.436017 8425 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:31.440613 8425 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:31.440927 8425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:31.442020 8425 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:03:31.443466 8425 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:03:31.443596 8425 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:31.443733 8425 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:03:31.443825 8425 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:31.482592 8425 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:45137
I20260809 13:03:31.482664 8736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:45137 every 8 connection(s)
I20260809 13:03:31.484218 8425 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:03:31.492326 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 8425
I20260809 13:03:31.492827 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 7417
Aug 09 13:03:31 dist-test-slave-jq4t krb5kdc[7026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280611, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.252@KRBTEST.COM
Aug 09 13:03:31 dist-test-slave-jq4t krb5kdc[7026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280611, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.253@KRBTEST.COM
Aug 09 13:03:31 dist-test-slave-jq4t krb5kdc[7026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280611, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM
Aug 09 13:03:31 dist-test-slave-jq4t krb5kdc[7026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280606, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.28.155.194@KRBTEST.COM
I20260809 13:03:31.514348 8525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:31.487618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:35989 (local address 127.28.155.252:39567)
0809 13:03:31.487832 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:31.487838 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:31.489662 (+ 1824us) server_negotiation.cc:407] Connection header received
0809 13:03:31.492369 (+ 2707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:31.492377 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:31.492518 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:31.492605 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:31.495511 (+ 2906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:31.496763 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:31.499032 (+ 2269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:31.499572 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:31.499697 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:31.506062 (+ 6365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:31.506070 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:31.506077 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:31.506121 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:31.510168 (+ 4047us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:31.511104 (+ 936us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:31.511109 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:31.511112 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:31.511266 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:31.511912 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:31.511917 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:31.511920 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:31.512310 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:31.512440 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:31.513694 (+ 1254us) server_negotiation.cc:299] Negotiation successful
0809 13:03:31.513988 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260809 13:03:31.514837 8744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:31.487528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:56269 (local address 127.28.155.253:40247)
0809 13:03:31.488706 (+ 1178us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:31.488713 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:31.489653 (+ 940us) server_negotiation.cc:407] Connection header received
0809 13:03:31.492525 (+ 2872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:31.492530 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:31.492638 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:31.492719 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:31.496298 (+ 3579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:31.497402 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:31.499351 (+ 1949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:31.500027 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:31.500160 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:31.505928 (+ 5768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:31.505937 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:31.505962 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:31.506015 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:31.509927 (+ 3912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:31.511067 (+ 1140us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:31.511076 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:31.511079 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:31.511259 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:31.511931 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:31.511935 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:31.511938 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:31.512310 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:31.512440 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:31.513906 (+ 1466us) server_negotiation.cc:299] Negotiation successful
0809 13:03:31.514150 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1047,"thread_start_us":938,"threads_started":1}
I20260809 13:03:31.515995 8746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:31.488253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:39567 (local address 127.28.155.193:35989)
0809 13:03:31.489436 (+ 1183us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:31.489504 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:31.491908 (+ 2404us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:31.493134 (+ 1226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:31.493147 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:31.494233 (+ 1086us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:31.495293 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:31.495321 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:31.497106 (+ 1785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:31.497113 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:31.498866 (+ 1753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:31.498879 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:31.500040 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:31.500048 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:31.500418 (+ 370us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:31.501497 (+ 1079us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:31.501515 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:31.505758 (+ 4243us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:31.510322 (+ 4564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:31.510327 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:31.510332 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:31.510969 (+ 637us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:31.511425 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:31.511429 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:31.511432 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:31.511750 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:31.512602 (+ 852us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:31.512612 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:31.513154 (+ 542us) client_negotiation.cc:769] Sending connection context
0809 13:03:31.514654 (+ 1500us) client_negotiation.cc:240] Negotiation successful
0809 13:03:31.514973 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":818,"mutex_wait_us":49,"spinlock_wait_cycles":11264,"thread_start_us":473,"threads_started":1}
I20260809 13:03:31.516039 8747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:31.488260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:40247 (local address 127.28.155.193:56269)
0809 13:03:31.489436 (+ 1176us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:31.489504 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:31.491908 (+ 2404us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:31.493134 (+ 1226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:31.493147 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:31.495857 (+ 2710us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:31.496113 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:31.496125 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:31.497618 (+ 1493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:31.497622 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:31.499203 (+ 1581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:31.499218 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:31.500433 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:31.500439 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:31.500663 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:31.501416 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:31.501468 (+ 52us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:31.505657 (+ 4189us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:31.510148 (+ 4491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:31.510157 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:31.510175 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:31.510891 (+ 716us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:31.511420 (+ 529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:31.511428 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:31.511432 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:31.511795 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:31.512602 (+ 807us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:31.512612 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:31.513612 (+ 1000us) client_negotiation.cc:769] Sending connection context
0809 13:03:31.515300 (+ 1688us) client_negotiation.cc:240] Negotiation successful
0809 13:03:31.515598 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":950,"mutex_wait_us":777,"spinlock_wait_cycles":122880,"thread_start_us":465,"threads_started":1}
I20260809 13:03:31.516702 8750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:31.490323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:37401 (local address 127.28.155.254:42999)
0809 13:03:31.493804 (+ 3481us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:31.493811 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:31.493831 (+ 20us) server_negotiation.cc:407] Connection header received
0809 13:03:31.493912 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:31.493916 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:31.493997 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:31.494105 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:31.495555 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:31.496699 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:31.500925 (+ 4226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:31.501720 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:31.501837 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:31.506586 (+ 4749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:31.506594 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:31.506598 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:31.506647 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:31.511154 (+ 4507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:31.512105 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:31.512112 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:31.512119 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:31.512297 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:31.512811 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:31.512816 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:31.512819 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:31.513204 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:31.513364 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:31.516011 (+ 2647us) server_negotiation.cc:299] Negotiation successful
0809 13:03:31.516283 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3343,"thread_start_us":3207,"threads_started":1}
I20260809 13:03:31.517057 8749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:31.490120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.28.155.193:37401)
0809 13:03:31.490748 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:31.490773 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:31.492195 (+ 1422us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:31.494314 (+ 2119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:31.494318 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:31.494898 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:31.495293 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:31.495321 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:31.496889 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:31.496894 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:31.500744 (+ 3850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:31.500759 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:31.502106 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:31.502116 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:31.502288 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:31.503037 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:31.503087 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:31.506282 (+ 3195us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:31.511361 (+ 5079us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:31.511370 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:31.511375 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:31.511944 (+ 569us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:31.512471 (+ 527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:31.512497 (+ 26us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:31.512504 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:31.512709 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:31.513384 (+ 675us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:31.513392 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:31.513596 (+ 204us) client_negotiation.cc:769] Sending connection context
0809 13:03:31.513788 (+ 192us) client_negotiation.cc:240] Negotiation successful
0809 13:03:31.514394 (+ 606us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"mutex_wait_us":1814,"thread_start_us":314,"threads_started":1}
I20260809 13:03:31.518221 8741 heartbeater.cc:347] Connected to a master server at 127.28.155.253:40247
I20260809 13:03:31.518595 8741 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:31.518664 8752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:31.494648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50112 (local address 127.28.155.194:39059)
0809 13:03:31.495285 (+ 637us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:31.495297 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:31.495321 (+ 24us) server_negotiation.cc:407] Connection header received
0809 13:03:31.495377 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:31.495383 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:31.495654 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:31.497752 (+ 2098us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:31.498018 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:31.499532 (+ 1514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:31.501738 (+ 2206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:31.502704 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:31.503527 (+ 823us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:31.509671 (+ 6144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:31.509691 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:31.509712 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:31.509772 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:31.513958 (+ 4186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:31.514945 (+ 987us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:31.514956 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:31.514962 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:31.515135 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:31.515603 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:31.515608 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:31.515611 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:31.516055 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:31.516355 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:31.517703 (+ 1348us) server_negotiation.cc:299] Negotiation successful
0809 13:03:31.518254 (+ 551us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":396,"threads_started":1}
I20260809 13:03:31.519649 8741 heartbeater.cc:511] Master 127.28.155.253:40247 requested a full tablet report, sending...
I20260809 13:03:31.519948 8739 heartbeater.cc:347] Connected to a master server at 127.28.155.252:39567
I20260809 13:03:31.520087 8739 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:31.520156 7616 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:31.520603 8739 heartbeater.cc:511] Master 127.28.155.252:39567 requested a full tablet report, sending...
I20260809 13:03:31.521180 8740 heartbeater.cc:347] Connected to a master server at 127.28.155.254:42999
I20260809 13:03:31.521317 8740 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:31.521790 8740 heartbeater.cc:511] Master 127.28.155.254:42999 requested a full tablet report, sending...
I20260809 13:03:31.522786 8110 ts_manager.cc:194] Registered new tserver with Master: 1ccb3277a9cf4b91bbaaad4d2ed54254 (127.28.155.193:45137)
I20260809 13:03:31.522786 8444 ts_manager.cc:194] Registered new tserver with Master: 1ccb3277a9cf4b91bbaaad4d2ed54254 (127.28.155.193:45137)
I20260809 13:03:31.523119 7096 ts_manager.cc:194] Re-registered known tserver with Master: 1ccb3277a9cf4b91bbaaad4d2ed54254 (127.28.155.193:45137)
I20260809 13:03:31.524272 7096 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.28.155.193@KRBTEST.COM'} at 127.28.155.193:37401
I20260809 13:03:31.623059 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 7417
I20260809 13:03:31.650772 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:39059
--local_ip_for_outbound_sockets=127.28.155.194
--tserver_master_addrs=127.28.155.254:42999
--webserver_port=36107
--webserver_interface=127.28.155.194
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.194.keytab
--principal=oryx/127.28.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:37737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.28.155.254:42999,127.28.155.253:40247
--tserver_master_addrs=127.28.155.254:42999,127.28.155.253:40247,127.28.155.252:39567 with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 13:03:31.684681 8367 sys_catalog.cc:455] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b317f0a53c51431c85e6fe16a219c490" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: false } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: NON_VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: true } } }
I20260809 13:03:31.685180 8367 sys_catalog.cc:458] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:31.687048 8757 raft_consensus.cc:1050] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490: attempting to promote NON_VOTER 7a67b38a17ca4b74bd025ea37b49c361 to VOTER
I20260809 13:03:31.687688 8757 consensus_queue.cc:237] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: false } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: false } }
I20260809 13:03:31.689772 8462 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [term 1 LEARNER]: Refusing update from remote peer b317f0a53c51431c85e6fe16a219c490: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260809 13:03:31.689839 8127 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [term 1 FOLLOWER]: Refusing update from remote peer b317f0a53c51431c85e6fe16a219c490: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260809 13:03:31.690531 8367 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260809 13:03:31.690951 8758 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260809 13:03:31.693842 8757 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 7a67b38a17ca4b74bd025ea37b49c361 (127.28.155.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: false } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: false } } }
I20260809 13:03:31.694458 8127 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 7a67b38a17ca4b74bd025ea37b49c361 (127.28.155.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: false } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: false } } }
I20260809 13:03:31.697685 8765 sys_catalog.cc:455] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b317f0a53c51431c85e6fe16a219c490" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: false } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: false } } }
I20260809 13:03:31.698364 8765 sys_catalog.cc:458] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:31.698627 8765 sys_catalog.cc:455] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b317f0a53c51431c85e6fe16a219c490" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: false } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: false } } }
I20260809 13:03:31.698860 8765 sys_catalog.cc:458] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:31.698714 8462 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 7a67b38a17ca4b74bd025ea37b49c361 (127.28.155.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: false } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: false } } }
I20260809 13:03:31.702517 8505 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b317f0a53c51431c85e6fe16a219c490" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: false } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: false } } }
I20260809 13:03:31.702801 8505 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 13:03:31.703678 8766 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b317f0a53c51431c85e6fe16a219c490" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: false } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: false } } }
I20260809 13:03:31.704053 8766 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [sys.catalog]: This master's current role is: FOLLOWER
I20260809 13:03:31.705006 8768 sys_catalog.cc:455] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b317f0a53c51431c85e6fe16a219c490" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: false } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: false } } }
I20260809 13:03:31.705353 8768 sys_catalog.cc:458] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490 [sys.catalog]: This master's current role is: LEADER
W20260809 13:03:32.017797 8755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:32.018236 8755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:32.018419 8755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:32.026685 8755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:32.026840 8755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:32.027067 8755 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:03:32.037613 8755 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:37737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.194.keytab
--principal=oryx/127.28.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:39059
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=36107
--tserver_master_addrs=127.28.155.254:42999,127.28.155.253:40247,127.28.155.252:39567
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:32.039036 8755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:32.040395 8755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:32.056608 8773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:32.056643 8779 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:32.056608 8775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:32.057909 8755 server_base.cc:1034] running on GCE node
I20260809 13:03:32.058748 8755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:32.059799 8755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:32.061076 8755 hybrid_clock.cc:648] HybridClock initialized: now 1786280612060990 us; error 53 us; skew 500 ppm
I20260809 13:03:32.061414 8755 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:32 dist-test-slave-jq4t krb5kdc[7026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280612, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:32.064970 8755 init.cc:377] Logged in from keytab as oryx/127.28.155.194@KRBTEST.COM (short username oryx)
I20260809 13:03:32.066465 8755 webserver.cc:460] Webserver started at http://127.28.155.194:36107/ using document root <none> and password file <none>
I20260809 13:03:32.067181 8755 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:32.067308 8755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:32.072988 8755 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260809 13:03:32.075695 8787 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:32.077140 8755 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:03:32.077291 8755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "a378f6f5259e4da08bc57e1749f81d45"
format_stamp: "Formatted at 2026-08-09 13:03:28 on dist-test-slave-jq4t"
server_key: "0f7b341617a3773fcfb13becbbbce09f"
server_key_iv: "5bfed4a13f4363489828c380e85ceecf"
server_key_version: "encryptionkey@0"
I20260809 13:03:32.078282 8755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:32.094671 8755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:32.099399 8755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:32.099676 8755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:32.100852 8755 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:03:32.102433 8755 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:03:32.102535 8755 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:32.102635 8755 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:03:32.102725 8755 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:32.139599 8755 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:39059
I20260809 13:03:32.139703 8973 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:39059 every 8 connection(s)
I20260809 13:03:32.141291 8755 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:03:32.149714 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 8755
I20260809 13:03:32.150050 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 7630
Aug 09 13:03:32 dist-test-slave-jq4t krb5kdc[7026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280612, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM
Aug 09 13:03:32 dist-test-slave-jq4t krb5kdc[7026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280612, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.253@KRBTEST.COM
Aug 09 13:03:32 dist-test-slave-jq4t krb5kdc[7026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280612, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.252@KRBTEST.COM
Aug 09 13:03:32 dist-test-slave-jq4t krb5kdc[7026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280606, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.28.155.195@KRBTEST.COM
I20260809 13:03:32.172776 8981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:32.144707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:42185 (local address 127.28.155.253:40247)
0809 13:03:32.146303 (+ 1596us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:32.146310 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:32.147343 (+ 1033us) server_negotiation.cc:407] Connection header received
0809 13:03:32.149855 (+ 2512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:32.149861 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:32.149970 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:32.150057 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:32.153045 (+ 2988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.154317 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.158130 (+ 3813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.158801 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.158912 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:32.164465 (+ 5553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:32.164473 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:32.164508 (+ 35us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:32.164572 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:32.168844 (+ 4272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:32.169897 (+ 1053us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:32.169902 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:32.169905 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:32.170075 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:32.170581 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:32.170586 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:32.170589 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:32.170978 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:32.171125 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:32.172075 (+ 950us) server_negotiation.cc:299] Negotiation successful
0809 13:03:32.172325 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1461,"thread_start_us":1298,"threads_started":1}
I20260809 13:03:32.172868 8989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:32.147837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:33061 (local address 127.28.155.254:42999)
0809 13:03:32.148867 (+ 1030us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:32.148871 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:32.148889 (+ 18us) server_negotiation.cc:407] Connection header received
0809 13:03:32.149971 (+ 1082us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:32.149979 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:32.150082 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:32.150195 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:32.153086 (+ 2891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.154236 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.157296 (+ 3060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.158006 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.158108 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:32.164128 (+ 6020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:32.164136 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:32.164141 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:32.164197 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:32.168353 (+ 4156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:32.169603 (+ 1250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:32.169609 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:32.169613 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:32.169793 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:32.170394 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:32.170399 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:32.170402 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:32.170811 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:32.170984 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:32.172075 (+ 1091us) server_negotiation.cc:299] Negotiation successful
0809 13:03:32.172325 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":922,"thread_start_us":805,"threads_started":1}
I20260809 13:03:32.175421 8987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:32.145402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:40247 (local address 127.28.155.194:42185)
0809 13:03:32.147141 (+ 1739us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:32.147216 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:32.149520 (+ 2304us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:32.150601 (+ 1081us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:32.150613 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:32.151713 (+ 1100us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:32.152841 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:32.152868 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.154560 (+ 1692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.154567 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:32.157944 (+ 3377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:32.157960 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.159260 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.159267 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:32.159453 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:32.160550 (+ 1097us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:32.160576 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:32.164134 (+ 3558us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:32.169052 (+ 4918us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:32.169058 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:32.169063 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:32.169705 (+ 642us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:32.170215 (+ 510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:32.170221 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:32.170224 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:32.170430 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:32.171196 (+ 766us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:32.171200 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:32.171590 (+ 390us) client_negotiation.cc:769] Sending connection context
0809 13:03:32.173127 (+ 1537us) client_negotiation.cc:240] Negotiation successful
0809 13:03:32.173781 (+ 654us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1555,"mutex_wait_us":2233,"spinlock_wait_cycles":7168,"thread_start_us":922,"threads_started":1}
I20260809 13:03:32.175933 8988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:32.147675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.28.155.194:33061)
0809 13:03:32.148271 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:32.148288 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:32.149540 (+ 1252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:32.150601 (+ 1061us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:32.150613 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:32.151713 (+ 1100us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:32.152841 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:32.152868 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.154436 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.154442 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:32.157108 (+ 2666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:32.157123 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.158492 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.158500 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:32.158932 (+ 432us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:32.159995 (+ 1063us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:32.160051 (+ 56us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:32.163743 (+ 3692us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:32.168575 (+ 4832us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:32.168587 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:32.168612 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:32.169456 (+ 844us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:32.169959 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:32.169975 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:32.169982 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:32.170254 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:32.171095 (+ 841us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:32.171103 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:32.171590 (+ 487us) client_negotiation.cc:769] Sending connection context
0809 13:03:32.173078 (+ 1488us) client_negotiation.cc:240] Negotiation successful
0809 13:03:32.173957 (+ 879us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"mutex_wait_us":1218,"spinlock_wait_cycles":6016,"thread_start_us":315,"threads_started":1}
I20260809 13:03:32.176132 8984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:32.144875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:46999 (local address 127.28.155.252:39567)
0809 13:03:32.145859 (+ 984us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:32.145868 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:32.147345 (+ 1477us) server_negotiation.cc:407] Connection header received
0809 13:03:32.149961 (+ 2616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:32.149967 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:32.150053 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:32.150151 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:32.153429 (+ 3278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.154612 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.157300 (+ 2688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.157999 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.158124 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:32.164900 (+ 6776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:32.164910 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:32.164916 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:32.164966 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:32.171676 (+ 6710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:32.172799 (+ 1123us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:32.172805 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:32.172811 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:32.172995 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:32.173482 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:32.173488 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:32.173492 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:32.173895 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:32.174044 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:32.175458 (+ 1414us) server_negotiation.cc:299] Negotiation successful
0809 13:03:32.175732 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":851,"thread_start_us":725,"threads_started":1}
I20260809 13:03:32.176442 8991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:32.151646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35340 (local address 127.28.155.195:44473)
0809 13:03:32.152787 (+ 1141us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:32.152793 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:32.152817 (+ 24us) server_negotiation.cc:407] Connection header received
0809 13:03:32.152872 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:32.152877 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:32.153130 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:32.155369 (+ 2239us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:32.155691 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.156897 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.158743 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.159654 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.159858 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:32.166810 (+ 6952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:32.166835 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:32.166855 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:32.166927 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:32.171387 (+ 4460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:32.172469 (+ 1082us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:32.172501 (+ 32us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:32.172505 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:32.172696 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:32.173651 (+ 955us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:32.173659 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:32.173665 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:32.174123 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:32.174432 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:32.175703 (+ 1271us) server_negotiation.cc:299] Negotiation successful
0809 13:03:32.176027 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":967,"thread_start_us":843,"threads_started":1}
I20260809 13:03:32.176522 8985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:32.145403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:39567 (local address 127.28.155.194:46999)
0809 13:03:32.147141 (+ 1738us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:32.147211 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:32.149520 (+ 2309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:32.150601 (+ 1081us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:32.150613 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:32.151853 (+ 1240us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:32.153250 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:32.153262 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.154801 (+ 1539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.154807 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:32.157107 (+ 2300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:32.157123 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.158492 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.158500 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:32.158931 (+ 431us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:32.160244 (+ 1313us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:32.160271 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:32.164634 (+ 4363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:32.171841 (+ 7207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:32.171846 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:32.171849 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:32.172362 (+ 513us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:32.173138 (+ 776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:32.173143 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:32.173147 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:32.173323 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:32.174107 (+ 784us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:32.174114 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:32.174285 (+ 171us) client_negotiation.cc:769] Sending connection context
0809 13:03:32.174467 (+ 182us) client_negotiation.cc:240] Negotiation successful
0809 13:03:32.174750 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1349,"mutex_wait_us":977,"spinlock_wait_cycles":74880,"thread_start_us":475,"threads_started":1}
I20260809 13:03:32.177886 7865 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:32.178210 8978 heartbeater.cc:347] Connected to a master server at 127.28.155.253:40247
I20260809 13:03:32.178584 8978 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:32.179386 8978 heartbeater.cc:511] Master 127.28.155.253:40247 requested a full tablet report, sending...
I20260809 13:03:32.180064 8975 heartbeater.cc:347] Connected to a master server at 127.28.155.254:42999
I20260809 13:03:32.180204 8975 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:32.180644 8974 heartbeater.cc:347] Connected to a master server at 127.28.155.252:39567
I20260809 13:03:32.180725 8975 heartbeater.cc:511] Master 127.28.155.254:42999 requested a full tablet report, sending...
I20260809 13:03:32.180788 8974 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:32.181270 8974 heartbeater.cc:511] Master 127.28.155.252:39567 requested a full tablet report, sending...
I20260809 13:03:32.182242 8110 ts_manager.cc:194] Registered new tserver with Master: a378f6f5259e4da08bc57e1749f81d45 (127.28.155.194:39059)
I20260809 13:03:32.183036 8444 ts_manager.cc:194] Registered new tserver with Master: a378f6f5259e4da08bc57e1749f81d45 (127.28.155.194:39059)
I20260809 13:03:32.184020 7096 ts_manager.cc:194] Re-registered known tserver with Master: a378f6f5259e4da08bc57e1749f81d45 (127.28.155.194:39059)
I20260809 13:03:32.185201 7096 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.28.155.194@KRBTEST.COM'} at 127.28.155.194:33061
I20260809 13:03:32.274119 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 7630
W20260809 13:03:32.299145 7074 connection.cc:535] server connection from 127.28.155.195:46293 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 13:03:32.299913 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:44473
--local_ip_for_outbound_sockets=127.28.155.195
--tserver_master_addrs=127.28.155.254:42999
--webserver_port=39911
--webserver_interface=127.28.155.195
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.195.keytab
--principal=oryx/127.28.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:37737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.28.155.254:42999,127.28.155.253:40247
--tserver_master_addrs=127.28.155.254:42999,127.28.155.253:40247,127.28.155.252:39567 with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 13:03:32.526700 8740 heartbeater.cc:503] Master 127.28.155.254:42999 was elected leader, sending a full tablet report...
W20260809 13:03:32.671517 8996 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:32.671852 8996 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:32.672011 8996 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:32.679953 8996 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:32.680084 8996 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:32.680292 8996 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:03:32.690682 8996 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:37737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.195.keytab
--principal=oryx/127.28.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:44473
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=39911
--tserver_master_addrs=127.28.155.254:42999,127.28.155.253:40247,127.28.155.252:39567
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:32.692199 8996 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:32.693717 8996 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:32.708192 9004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:32.708266 9011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:32.708235 9005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:32.709547 8996 server_base.cc:1034] running on GCE node
I20260809 13:03:32.710253 8996 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:32.711279 8996 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:32.712553 8996 hybrid_clock.cc:648] HybridClock initialized: now 1786280612712428 us; error 55 us; skew 500 ppm
I20260809 13:03:32.712906 8996 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:32 dist-test-slave-jq4t krb5kdc[7026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280612, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:32.716415 8996 init.cc:377] Logged in from keytab as oryx/127.28.155.195@KRBTEST.COM (short username oryx)
I20260809 13:03:32.718171 8996 webserver.cc:460] Webserver started at http://127.28.155.195:39911/ using document root <none> and password file <none>
I20260809 13:03:32.718909 8996 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:32.719086 8996 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:32.725162 8996 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 13:03:32.728006 9020 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:32.729454 8996 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:03:32.729648 8996 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "91632a26834d43f3a8fca18e454b405f"
format_stamp: "Formatted at 2026-08-09 13:03:29 on dist-test-slave-jq4t"
server_key: "bdfaee4b5e7f99c487a7dc4b2ddf11c7"
server_key_iv: "c6fd65f2f0ebc52929e21ca1d054a265"
server_key_version: "encryptionkey@0"
I20260809 13:03:32.730782 8996 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:32.768133 8996 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:32.773159 8996 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:32.773471 8996 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:32.774631 8996 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:03:32.776247 8996 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:03:32.776374 8996 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:32.776528 8996 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:03:32.776620 8996 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260809 13:03:32.812198 8996 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:44473
I20260809 13:03:32.812289 9203 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:44473 every 8 connection(s)
I20260809 13:03:32.813769 8996 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:03:32.818557 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 8996
Aug 09 13:03:32 dist-test-slave-jq4t krb5kdc[7026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280612, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.252@KRBTEST.COM
Aug 09 13:03:32 dist-test-slave-jq4t krb5kdc[7026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280612, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM
Aug 09 13:03:32 dist-test-slave-jq4t krb5kdc[7026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280612, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.253@KRBTEST.COM
I20260809 13:03:32.855670 9211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:32.817051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:50971 (local address 127.28.155.252:39567)
0809 13:03:32.818048 (+ 997us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:32.818052 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:32.829331 (+ 11279us) server_negotiation.cc:407] Connection header received
0809 13:03:32.830959 (+ 1628us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:32.830966 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:32.831077 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:32.831182 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:32.834629 (+ 3447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.835812 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.839564 (+ 3752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.840515 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.840643 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:32.847001 (+ 6358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:32.847007 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:32.847012 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:32.847057 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:32.851241 (+ 4184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:32.852399 (+ 1158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:32.852405 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:32.852408 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:32.852599 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:32.853200 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:32.853208 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:32.853213 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:32.853630 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:32.853787 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:32.854948 (+ 1161us) server_negotiation.cc:299] Negotiation successful
0809 13:03:32.855253 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":881,"thread_start_us":779,"threads_started":1}
I20260809 13:03:32.857590 9220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:32.822263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:51129 (local address 127.28.155.254:42999)
0809 13:03:32.830771 (+ 8508us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:32.830781 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:32.830806 (+ 25us) server_negotiation.cc:407] Connection header received
0809 13:03:32.830907 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:32.830917 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:32.831025 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:32.831169 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:32.834692 (+ 3523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.836146 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.839592 (+ 3446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.840514 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.840627 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:32.848926 (+ 8299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:32.848936 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:32.848944 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:32.848999 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:32.853377 (+ 4378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:32.854472 (+ 1095us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:32.854479 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:32.854485 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:32.854682 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:32.855178 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:32.855185 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:32.855190 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:32.855612 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:32.856072 (+ 460us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:32.856784 (+ 712us) server_negotiation.cc:299] Negotiation successful
0809 13:03:32.857079 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8327,"thread_start_us":8640,"threads_started":1}
I20260809 13:03:32.858232 9219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:32.817864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:39567 (local address 127.28.155.195:50971)
0809 13:03:32.829166 (+ 11302us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:32.829197 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:32.830764 (+ 1567us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:32.831690 (+ 926us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:32.831705 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:32.833006 (+ 1301us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:32.834402 (+ 1396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:32.834432 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.836147 (+ 1715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.836152 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:32.839334 (+ 3182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:32.839357 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.841045 (+ 1688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.841054 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:32.841591 (+ 537us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:32.842687 (+ 1096us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:32.842724 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:32.846713 (+ 3989us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:32.851449 (+ 4736us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:32.851458 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:32.851480 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:32.852245 (+ 765us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:32.852761 (+ 516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:32.852765 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:32.852768 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:32.853051 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:32.853926 (+ 875us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:32.853935 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:32.854450 (+ 515us) client_negotiation.cc:769] Sending connection context
0809 13:03:32.855979 (+ 1529us) client_negotiation.cc:240] Negotiation successful
0809 13:03:32.856612 (+ 633us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11063,"mutex_wait_us":3000,"spinlock_wait_cycles":5248,"thread_start_us":464,"threads_started":1}
I20260809 13:03:32.859397 9213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:32.822166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.28.155.195:51129)
0809 13:03:32.829407 (+ 7241us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:32.829433 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:32.830473 (+ 1040us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:32.832012 (+ 1539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:32.832016 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:32.833006 (+ 990us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:32.834476 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:32.834495 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.836464 (+ 1969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.836495 (+ 31us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:32.839343 (+ 2848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:32.839365 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.841041 (+ 1676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.841050 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:32.841598 (+ 548us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:32.842826 (+ 1228us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:32.842857 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:32.848627 (+ 5770us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:32.853624 (+ 4997us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:32.853631 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:32.853637 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:32.854308 (+ 671us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:32.854854 (+ 546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:32.854861 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:32.854867 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:32.855040 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:32.856170 (+ 1130us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:32.856178 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:32.856380 (+ 202us) client_negotiation.cc:769] Sending connection context
0809 13:03:32.858132 (+ 1752us) client_negotiation.cc:240] Negotiation successful
0809 13:03:32.858775 (+ 643us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7110,"mutex_wait_us":721,"spinlock_wait_cycles":7040,"thread_start_us":6545,"threads_started":1}
I20260809 13:03:32.859982 9204 heartbeater.cc:347] Connected to a master server at 127.28.155.252:39567
I20260809 13:03:32.860504 9204 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:32.861395 9212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:32.817051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:42661 (local address 127.28.155.253:40247)
0809 13:03:32.817688 (+ 637us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:32.817697 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:32.821769 (+ 4072us) server_negotiation.cc:407] Connection header received
0809 13:03:32.831117 (+ 9348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:32.831126 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:32.831219 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:32.831303 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:32.834636 (+ 3333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.835812 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.845765 (+ 9953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.846621 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.846777 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:32.852794 (+ 6017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:32.852802 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:32.852809 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:32.852859 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:32.856550 (+ 3691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:32.857463 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:32.857469 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:32.857471 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:32.857663 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:32.858131 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:32.858138 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:32.858144 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:32.858535 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:32.858685 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:32.860658 (+ 1973us) server_negotiation.cc:299] Negotiation successful
0809 13:03:32.860911 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":457,"thread_start_us":307,"threads_started":1}
I20260809 13:03:32.861656 9204 heartbeater.cc:511] Master 127.28.155.252:39567 requested a full tablet report, sending...
I20260809 13:03:32.862627 9215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:32.817864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:40247 (local address 127.28.155.195:42661)
0809 13:03:32.821523 (+ 3659us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:32.821588 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:32.830473 (+ 8885us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:32.831690 (+ 1217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:32.831705 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:32.833078 (+ 1373us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:32.834402 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:32.834432 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.842172 (+ 7740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.842176 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:32.843749 (+ 1573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:32.843764 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.846847 (+ 3083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.846854 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:32.847034 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:32.847711 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:32.847739 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:32.851513 (+ 3774us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:32.856842 (+ 5329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:32.856847 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:32.856850 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:32.857314 (+ 464us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:32.857817 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:32.857822 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:32.857825 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:32.857994 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:32.858779 (+ 785us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:32.858784 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:32.858969 (+ 185us) client_negotiation.cc:769] Sending connection context
0809 13:03:32.861808 (+ 2839us) client_negotiation.cc:240] Negotiation successful
0809 13:03:32.862134 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3339,"mutex_wait_us":181,"spinlock_wait_cycles":2944,"thread_start_us":11106,"threads_started":1}
I20260809 13:03:32.863638 9208 heartbeater.cc:347] Connected to a master server at 127.28.155.253:40247
I20260809 13:03:32.863770 9208 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:32.864233 9208 heartbeater.cc:511] Master 127.28.155.253:40247 requested a full tablet report, sending...
I20260809 13:03:32.864715 9207 heartbeater.cc:347] Connected to a master server at 127.28.155.254:42999
I20260809 13:03:32.864845 9207 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:32.865195 8444 ts_manager.cc:194] Registered new tserver with Master: 91632a26834d43f3a8fca18e454b405f (127.28.155.195:44473)
I20260809 13:03:32.865295 9207 heartbeater.cc:511] Master 127.28.155.254:42999 requested a full tablet report, sending...
I20260809 13:03:32.866287 8110 ts_manager.cc:194] Registered new tserver with Master: 91632a26834d43f3a8fca18e454b405f (127.28.155.195:44473)
I20260809 13:03:32.866675 7096 ts_manager.cc:194] Re-registered known tserver with Master: 91632a26834d43f3a8fca18e454b405f (127.28.155.195:44473)
I20260809 13:03:32.868083 7096 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.28.155.195@KRBTEST.COM'} at 127.28.155.195:51129
I20260809 13:03:32.879089 9225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:32.836203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38728 (local address 127.28.155.254:42999)
0809 13:03:32.856735 (+ 20532us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:32.856741 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:32.859995 (+ 3254us) server_negotiation.cc:407] Connection header received
0809 13:03:32.860055 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:32.860060 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:32.860140 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:32.860285 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:32.862864 (+ 2579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.864048 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.867835 (+ 3787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.868306 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.868453 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:32.872034 (+ 3581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:32.872040 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:32.872043 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:32.872079 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:32.875606 (+ 3527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:32.876760 (+ 1154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:32.876763 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:32.876766 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:32.876892 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:32.877292 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:32.877297 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:32.877300 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:32.877584 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:32.877851 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:32.878223 (+ 372us) server_negotiation.cc:299] Negotiation successful
0809 13:03:32.878501 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16033,"thread_start_us":16290,"threads_started":1}
I20260809 13:03:32.890902 9212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:32.841640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40906 (local address 127.28.155.253:40247)
0809 13:03:32.861755 (+ 20115us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:32.861762 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:32.873548 (+ 11786us) server_negotiation.cc:407] Connection header received
0809 13:03:32.873787 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:32.873793 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:32.873913 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:32.874019 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:32.876379 (+ 2360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.877591 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.879903 (+ 2312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.880439 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.880596 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:32.884740 (+ 4144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:32.884745 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:32.884748 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:32.884784 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:32.887724 (+ 2940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:32.888464 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:32.888470 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:32.888473 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:32.888690 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:32.889191 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:32.889199 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:32.889202 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:32.889581 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:32.889871 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:32.890241 (+ 370us) server_negotiation.cc:299] Negotiation successful
0809 13:03:32.890511 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19986,"thread_start_us":31055,"threads_started":1}
I20260809 13:03:32.892087 9211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:32.863944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35758 (local address 127.28.155.252:39567)
0809 13:03:32.864342 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:32.864350 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:32.874327 (+ 9977us) server_negotiation.cc:407] Connection header received
0809 13:03:32.874508 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:32.874513 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:32.874588 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:32.874696 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:32.876707 (+ 2011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.877762 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.879883 (+ 2121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.880501 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.880633 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:32.884683 (+ 4050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:32.884689 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:32.884697 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:32.884739 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:32.888447 (+ 3708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:32.889262 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:32.889268 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:32.889271 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:32.889441 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:32.889892 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:32.889899 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:32.889902 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:32.890275 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:32.890512 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:32.891442 (+ 930us) server_negotiation.cc:299] Negotiation successful
0809 13:03:32.891695 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258}
I20260809 13:03:32.884079 7096 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38728:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 13:03:32.894619 7096 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:03:32.931143 9247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:32.917177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:39059 (local address 127.0.0.1:50118)
0809 13:03:32.921670 (+ 4493us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:32.921688 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:32.921800 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:32.923308 (+ 1508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:32.923313 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:32.923342 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:03:32.923897 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:32.923913 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.925843 (+ 1930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.925849 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:32.928369 (+ 2520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:32.928390 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.930259 (+ 1869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.930265 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:32.930448 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:32.930486 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 13:03:32.930611 (+ 125us) client_negotiation.cc:240] Negotiation successful
0809 13:03:32.930748 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4364,"thread_start_us":6547,"threads_started":1}
I20260809 13:03:32.931205 9249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:32.918110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50118 (local address 127.28.155.194:39059)
0809 13:03:32.922759 (+ 4649us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:32.922765 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:32.922791 (+ 26us) server_negotiation.cc:407] Connection header received
0809 13:03:32.922881 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:32.922887 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:32.923111 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:32.923325 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:03:32.924403 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.925689 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.928571 (+ 2882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.930043 (+ 1472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.930232 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:32.930504 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:32.930660 (+ 156us) server_negotiation.cc:299] Negotiation successful
0809 13:03:32.930859 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4471,"thread_start_us":4363,"threads_started":1}
I20260809 13:03:32.933713 9250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:32.918546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35352 (local address 127.28.155.195:44473)
0809 13:03:32.922357 (+ 3811us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:32.922364 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:32.924184 (+ 1820us) server_negotiation.cc:407] Connection header received
0809 13:03:32.924393 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:32.924401 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:32.924690 (+ 289us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:32.924886 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:03:32.926785 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.928458 (+ 1673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.930290 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.932223 (+ 1933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.932410 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:32.932647 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:32.933142 (+ 495us) server_negotiation.cc:299] Negotiation successful
0809 13:03:32.933362 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3638,"thread_start_us":3458,"threads_started":1}
I20260809 13:03:32.933744 9245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:32.917508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:44473 (local address 127.0.0.1:35352)
0809 13:03:32.924050 (+ 6542us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:32.924084 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:32.924222 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:32.925884 (+ 1662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:32.925890 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:32.925925 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:03:32.926550 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:32.926563 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.928645 (+ 2082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.928648 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:32.930081 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:32.930094 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.932647 (+ 2553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.932653 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:32.932926 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:32.932959 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 13:03:32.933070 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 13:03:32.933206 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6377,"mutex_wait_us":2,"thread_start_us":7223,"threads_started":1}
I20260809 13:03:32.934594 9252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:32.918584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58254 (local address 127.28.155.193:45137)
0809 13:03:32.921153 (+ 2569us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:32.921168 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:32.925123 (+ 3955us) server_negotiation.cc:407] Connection header received
0809 13:03:32.925290 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:32.925297 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:32.925465 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:32.925656 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:03:32.926493 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.927907 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.931670 (+ 3763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.932960 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.933123 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:32.933274 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:32.934019 (+ 745us) server_negotiation.cc:299] Negotiation successful
0809 13:03:32.934174 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2369,"thread_start_us":2245,"threads_started":1}
I20260809 13:03:32.935472 9246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:32.917935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:45137 (local address 127.0.0.1:58254)
0809 13:03:32.924988 (+ 7053us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:32.925003 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:32.925154 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:32.925649 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:32.925654 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:32.925680 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:03:32.926216 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:32.926231 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.928040 (+ 1809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.928046 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:32.931464 (+ 3418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:32.931480 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:32.933437 (+ 1957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:32.933444 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:32.933630 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:32.933673 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 13:03:32.933780 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 13:03:32.934805 (+ 1025us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6940,"thread_start_us":3461,"threads_started":1}
I20260809 13:03:32.936182 8866 tablet_service.cc:1467] Processing CreateTablet for tablet ad3943564f5745548cbe0c78995edd1f (DEFAULT_TABLE table=test-table [id=b612fafadf8a44f5ae63efe5b60cb159]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:03:32.937826 8866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad3943564f5745548cbe0c78995edd1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:32.937739 9100 tablet_service.cc:1467] Processing CreateTablet for tablet ad3943564f5745548cbe0c78995edd1f (DEFAULT_TABLE table=test-table [id=b612fafadf8a44f5ae63efe5b60cb159]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:03:32.939182 9100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad3943564f5745548cbe0c78995edd1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:32.943259 8628 tablet_service.cc:1467] Processing CreateTablet for tablet ad3943564f5745548cbe0c78995edd1f (DEFAULT_TABLE table=test-table [id=b612fafadf8a44f5ae63efe5b60cb159]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:03:32.944373 8628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad3943564f5745548cbe0c78995edd1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:32.954668 9255 tablet_bootstrap.cc:492] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45: Bootstrap starting.
I20260809 13:03:32.957604 9258 tablet_bootstrap.cc:492] T ad3943564f5745548cbe0c78995edd1f P 1ccb3277a9cf4b91bbaaad4d2ed54254: Bootstrap starting.
I20260809 13:03:32.958837 9255 tablet_bootstrap.cc:654] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:32.959898 9255 log.cc:824] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45: Log is configured to *not* fsync() on all Append() calls
I20260809 13:03:32.961408 9256 tablet_bootstrap.cc:492] T ad3943564f5745548cbe0c78995edd1f P 91632a26834d43f3a8fca18e454b405f: Bootstrap starting.
I20260809 13:03:32.962710 9258 tablet_bootstrap.cc:654] T ad3943564f5745548cbe0c78995edd1f P 1ccb3277a9cf4b91bbaaad4d2ed54254: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:32.963526 9255 tablet_bootstrap.cc:492] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45: No bootstrap required, opened a new log
I20260809 13:03:32.963837 9255 ts_tablet_manager.cc:1397] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260809 13:03:32.963835 9258 log.cc:824] T ad3943564f5745548cbe0c78995edd1f P 1ccb3277a9cf4b91bbaaad4d2ed54254: Log is configured to *not* fsync() on all Append() calls
I20260809 13:03:32.965622 9256 tablet_bootstrap.cc:654] T ad3943564f5745548cbe0c78995edd1f P 91632a26834d43f3a8fca18e454b405f: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:32.966596 9258 tablet_bootstrap.cc:492] T ad3943564f5745548cbe0c78995edd1f P 1ccb3277a9cf4b91bbaaad4d2ed54254: No bootstrap required, opened a new log
I20260809 13:03:32.966878 9258 ts_tablet_manager.cc:1397] T ad3943564f5745548cbe0c78995edd1f P 1ccb3277a9cf4b91bbaaad4d2ed54254: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260809 13:03:32.966864 9256 log.cc:824] T ad3943564f5745548cbe0c78995edd1f P 91632a26834d43f3a8fca18e454b405f: Log is configured to *not* fsync() on all Append() calls
I20260809 13:03:32.970196 9256 tablet_bootstrap.cc:492] T ad3943564f5745548cbe0c78995edd1f P 91632a26834d43f3a8fca18e454b405f: No bootstrap required, opened a new log
I20260809 13:03:32.970492 9256 ts_tablet_manager.cc:1397] T ad3943564f5745548cbe0c78995edd1f P 91632a26834d43f3a8fca18e454b405f: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260809 13:03:32.975003 9255 raft_consensus.cc:348] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a378f6f5259e4da08bc57e1749f81d45" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 39059 } } peers { permanent_uuid: "91632a26834d43f3a8fca18e454b405f" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44473 } } peers { permanent_uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45137 } }
I20260809 13:03:32.975564 9255 raft_consensus.cc:374] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:32.975677 9255 raft_consensus.cc:729] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a378f6f5259e4da08bc57e1749f81d45, State: Initialized, Role: FOLLOWER
I20260809 13:03:32.975586 9258 raft_consensus.cc:348] T ad3943564f5745548cbe0c78995edd1f P 1ccb3277a9cf4b91bbaaad4d2ed54254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a378f6f5259e4da08bc57e1749f81d45" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 39059 } } peers { permanent_uuid: "91632a26834d43f3a8fca18e454b405f" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44473 } } peers { permanent_uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45137 } }
I20260809 13:03:32.976075 9258 raft_consensus.cc:374] T ad3943564f5745548cbe0c78995edd1f P 1ccb3277a9cf4b91bbaaad4d2ed54254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:32.976186 9258 raft_consensus.cc:729] T ad3943564f5745548cbe0c78995edd1f P 1ccb3277a9cf4b91bbaaad4d2ed54254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ccb3277a9cf4b91bbaaad4d2ed54254, State: Initialized, Role: FOLLOWER
I20260809 13:03:32.976380 9255 consensus_queue.cc:260] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a378f6f5259e4da08bc57e1749f81d45" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 39059 } } peers { permanent_uuid: "91632a26834d43f3a8fca18e454b405f" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44473 } } peers { permanent_uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45137 } }
I20260809 13:03:32.976828 9258 consensus_queue.cc:260] T ad3943564f5745548cbe0c78995edd1f P 1ccb3277a9cf4b91bbaaad4d2ed54254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a378f6f5259e4da08bc57e1749f81d45" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 39059 } } peers { permanent_uuid: "91632a26834d43f3a8fca18e454b405f" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44473 } } peers { permanent_uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45137 } }
I20260809 13:03:32.978382 9255 ts_tablet_manager.cc:1428] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45: Time spent starting tablet: real 0.014s user 0.011s sys 0.004s
I20260809 13:03:32.978693 8975 heartbeater.cc:503] Master 127.28.155.254:42999 was elected leader, sending a full tablet report...
I20260809 13:03:32.981357 9256 raft_consensus.cc:348] T ad3943564f5745548cbe0c78995edd1f P 91632a26834d43f3a8fca18e454b405f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a378f6f5259e4da08bc57e1749f81d45" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 39059 } } peers { permanent_uuid: "91632a26834d43f3a8fca18e454b405f" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44473 } } peers { permanent_uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45137 } }
I20260809 13:03:32.981810 9256 raft_consensus.cc:374] T ad3943564f5745548cbe0c78995edd1f P 91632a26834d43f3a8fca18e454b405f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:32.981910 9256 raft_consensus.cc:729] T ad3943564f5745548cbe0c78995edd1f P 91632a26834d43f3a8fca18e454b405f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91632a26834d43f3a8fca18e454b405f, State: Initialized, Role: FOLLOWER
I20260809 13:03:32.982540 9256 consensus_queue.cc:260] T ad3943564f5745548cbe0c78995edd1f P 91632a26834d43f3a8fca18e454b405f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a378f6f5259e4da08bc57e1749f81d45" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 39059 } } peers { permanent_uuid: "91632a26834d43f3a8fca18e454b405f" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44473 } } peers { permanent_uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45137 } }
I20260809 13:03:32.984397 9270 raft_consensus.cc:482] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:03:32.985620 9270 raft_consensus.cc:504] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a378f6f5259e4da08bc57e1749f81d45" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 39059 } } peers { permanent_uuid: "91632a26834d43f3a8fca18e454b405f" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44473 } } peers { permanent_uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45137 } }
I20260809 13:03:32.986585 9258 ts_tablet_manager.cc:1428] T ad3943564f5745548cbe0c78995edd1f P 1ccb3277a9cf4b91bbaaad4d2ed54254: Time spent starting tablet: real 0.020s user 0.011s sys 0.007s
W20260809 13:03:32.988708 8743 tablet.cc:2369] T ad3943564f5745548cbe0c78995edd1f P 1ccb3277a9cf4b91bbaaad4d2ed54254: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:03:32.995699 9271 raft_consensus.cc:482] T ad3943564f5745548cbe0c78995edd1f P 1ccb3277a9cf4b91bbaaad4d2ed54254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:03:32.996099 9271 raft_consensus.cc:504] T ad3943564f5745548cbe0c78995edd1f P 1ccb3277a9cf4b91bbaaad4d2ed54254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a378f6f5259e4da08bc57e1749f81d45" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 39059 } } peers { permanent_uuid: "91632a26834d43f3a8fca18e454b405f" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44473 } } peers { permanent_uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45137 } }
I20260809 13:03:32.999224 9270 leader_election.cc:288] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91632a26834d43f3a8fca18e454b405f (127.28.155.195:44473), 1ccb3277a9cf4b91bbaaad4d2ed54254 (127.28.155.193:45137)
I20260809 13:03:33.005254 9271 leader_election.cc:288] T ad3943564f5745548cbe0c78995edd1f P 1ccb3277a9cf4b91bbaaad4d2ed54254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a378f6f5259e4da08bc57e1749f81d45 (127.28.155.194:39059), 91632a26834d43f3a8fca18e454b405f (127.28.155.195:44473)
I20260809 13:03:33.005527 9256 ts_tablet_manager.cc:1428] T ad3943564f5745548cbe0c78995edd1f P 91632a26834d43f3a8fca18e454b405f: Time spent starting tablet: real 0.035s user 0.015s sys 0.004s
I20260809 13:03:33.007766 9207 heartbeater.cc:503] Master 127.28.155.254:42999 was elected leader, sending a full tablet report...
I20260809 13:03:33.017050 9252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:32.988049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:57347 (local address 127.28.155.193:45137)
0809 13:03:32.988393 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:32.988400 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:33.008559 (+ 20159us) server_negotiation.cc:407] Connection header received
0809 13:03:33.009431 (+ 872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:33.009438 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:33.009520 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:33.009593 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:03:33.010594 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:33.011779 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:33.014515 (+ 2736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:33.015910 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:33.016122 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:33.016201 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:33.016559 (+ 358us) server_negotiation.cc:299] Negotiation successful
0809 13:03:33.016710 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":208,"spinlock_wait_cycles":29440}
I20260809 13:03:33.018038 9273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:32.987638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:45137 (local address 127.28.155.194:57347)
0809 13:03:33.008377 (+ 20739us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:33.008402 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:33.008971 (+ 569us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:33.009863 (+ 892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:33.009867 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:33.009898 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:03:33.010408 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:33.010425 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:33.011996 (+ 1571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:33.012001 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:33.014291 (+ 2290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:33.014306 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:33.016154 (+ 1848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:33.016160 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:33.016333 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:33.016374 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 13:03:33.017326 (+ 952us) client_negotiation.cc:240] Negotiation successful
0809 13:03:33.017487 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19882,"spinlock_wait_cycles":768,"thread_start_us":19564,"threads_started":1}
I20260809 13:03:33.019181 8663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad3943564f5745548cbe0c78995edd1f" candidate_uuid: "a378f6f5259e4da08bc57e1749f81d45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254" is_pre_election: true
I20260809 13:03:33.019835 8663 raft_consensus.cc:2454] T ad3943564f5745548cbe0c78995edd1f P 1ccb3277a9cf4b91bbaaad4d2ed54254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a378f6f5259e4da08bc57e1749f81d45 in term 0.
I20260809 13:03:33.020463 9249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:32.999377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:60791 (local address 127.28.155.194:39059)
0809 13:03:32.999651 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:32.999661 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:33.009531 (+ 9870us) server_negotiation.cc:407] Connection header received
0809 13:03:33.009810 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:33.009815 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:33.009887 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:33.009944 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:03:33.011853 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:33.012865 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:33.017015 (+ 4150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:33.018399 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:33.018524 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:33.018639 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:33.019992 (+ 1353us) server_negotiation.cc:299] Negotiation successful
0809 13:03:33.020159 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55,"spinlock_wait_cycles":3840}
I20260809 13:03:33.020859 8788 leader_election.cc:302] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ccb3277a9cf4b91bbaaad4d2ed54254, a378f6f5259e4da08bc57e1749f81d45; no voters:
I20260809 13:03:33.021760 9275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:32.998833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:39059 (local address 127.28.155.193:60791)
0809 13:03:33.009423 (+ 10590us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:33.009448 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:33.009635 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:33.010236 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:33.010241 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:33.011231 (+ 990us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:03:33.011651 (+ 420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:33.011665 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:33.013044 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:33.013049 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:33.016808 (+ 3759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:33.016823 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:33.019276 (+ 2453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:33.019282 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:33.019693 (+ 411us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:33.019737 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 13:03:33.021028 (+ 1291us) client_negotiation.cc:240] Negotiation successful
0809 13:03:33.021249 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10426,"mutex_wait_us":74,"thread_start_us":10252,"threads_started":1}
I20260809 13:03:33.021790 9272 raft_consensus.cc:2781] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:03:33.021957 9272 raft_consensus.cc:482] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:03:33.022121 9272 raft_consensus.cc:3037] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:33.023133 8900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad3943564f5745548cbe0c78995edd1f" candidate_uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a378f6f5259e4da08bc57e1749f81d45" is_pre_election: true
I20260809 13:03:33.025929 9272 raft_consensus.cc:504] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a378f6f5259e4da08bc57e1749f81d45" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 39059 } } peers { permanent_uuid: "91632a26834d43f3a8fca18e454b405f" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44473 } } peers { permanent_uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45137 } }
I20260809 13:03:33.026836 8900 raft_consensus.cc:2379] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ccb3277a9cf4b91bbaaad4d2ed54254 in current term 1: Already voted for candidate a378f6f5259e4da08bc57e1749f81d45 in this term.
I20260809 13:03:33.027338 8663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad3943564f5745548cbe0c78995edd1f" candidate_uuid: "a378f6f5259e4da08bc57e1749f81d45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254"
I20260809 13:03:33.027578 8663 raft_consensus.cc:3037] T ad3943564f5745548cbe0c78995edd1f P 1ccb3277a9cf4b91bbaaad4d2ed54254 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:33.031309 8663 raft_consensus.cc:2454] T ad3943564f5745548cbe0c78995edd1f P 1ccb3277a9cf4b91bbaaad4d2ed54254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a378f6f5259e4da08bc57e1749f81d45 in term 1.
I20260809 13:03:33.031917 8788 leader_election.cc:302] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ccb3277a9cf4b91bbaaad4d2ed54254, a378f6f5259e4da08bc57e1749f81d45; no voters:
I20260809 13:03:33.032356 9270 raft_consensus.cc:2781] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:03:33.037509 9275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:33.016466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:44473 (local address 127.28.155.193:51643)
0809 13:03:33.024075 (+ 7609us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:33.024097 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:33.024220 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:33.029217 (+ 4997us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:33.029227 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:33.029271 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:03:33.029598 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:33.029614 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:33.031887 (+ 2273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:33.031892 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:33.034231 (+ 2339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:33.034251 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:33.036438 (+ 2187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:33.036444 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:33.036845 (+ 401us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:33.036888 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 13:03:33.036988 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 13:03:33.037150 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7468,"thread_start_us":8018,"threads_started":1}
I20260809 13:03:33.038317 9279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:33.016606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:51643 (local address 127.28.155.195:44473)
0809 13:03:33.028809 (+ 12203us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:33.028816 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:33.028843 (+ 27us) server_negotiation.cc:407] Connection header received
0809 13:03:33.028922 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:33.028928 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:33.029008 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:33.029139 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:03:33.030417 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:33.031724 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:33.034458 (+ 2734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:33.035897 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:33.036245 (+ 348us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:33.036329 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:33.037784 (+ 1455us) server_negotiation.cc:299] Negotiation successful
0809 13:03:33.037939 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12041,"thread_start_us":11851,"threads_started":1}
I20260809 13:03:33.038923 9250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:33.015938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:53619 (local address 127.28.155.195:44473)
0809 13:03:33.016170 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:33.016177 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:33.021624 (+ 5447us) server_negotiation.cc:407] Connection header received
0809 13:03:33.031840 (+ 10216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:33.031848 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:33.031925 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:33.031991 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:03:33.032725 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:33.033793 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:33.036458 (+ 2665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:33.037702 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:33.037832 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:33.037896 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:33.038505 (+ 609us) server_negotiation.cc:299] Negotiation successful
0809 13:03:33.038676 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260809 13:03:33.038965 9272 leader_election.cc:288] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45 [CANDIDATE]: Term 1 election: Requested vote from peers 91632a26834d43f3a8fca18e454b405f (127.28.155.195:44473), 1ccb3277a9cf4b91bbaaad4d2ed54254 (127.28.155.193:45137)
I20260809 13:03:33.039674 9273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:33.015838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:44473 (local address 127.28.155.194:53619)
0809 13:03:33.021520 (+ 5682us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:33.021540 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:33.031642 (+ 10102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:33.032217 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:33.032223 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:33.032253 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:03:33.032535 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:33.032551 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:33.034045 (+ 1494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:33.034051 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:33.036260 (+ 2209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:33.036277 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:33.038045 (+ 1768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:33.038053 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:33.038292 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:33.038337 (+ 45us) client_negotiation.cc:769] Sending connection context
0809 13:03:33.039180 (+ 843us) client_negotiation.cc:240] Negotiation successful
0809 13:03:33.039338 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5569,"thread_start_us":22851,"threads_started":1}
I20260809 13:03:33.040073 9132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad3943564f5745548cbe0c78995edd1f" candidate_uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91632a26834d43f3a8fca18e454b405f" is_pre_election: true
I20260809 13:03:33.040503 9270 raft_consensus.cc:686] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45 [term 1 LEADER]: Becoming Leader. State: Replica: a378f6f5259e4da08bc57e1749f81d45, State: Running, Role: LEADER
I20260809 13:03:33.040827 9132 raft_consensus.cc:2454] T ad3943564f5745548cbe0c78995edd1f P 91632a26834d43f3a8fca18e454b405f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ccb3277a9cf4b91bbaaad4d2ed54254 in term 0.
I20260809 13:03:33.040848 9130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad3943564f5745548cbe0c78995edd1f" candidate_uuid: "a378f6f5259e4da08bc57e1749f81d45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91632a26834d43f3a8fca18e454b405f" is_pre_election: true
I20260809 13:03:33.041290 9130 raft_consensus.cc:2454] T ad3943564f5745548cbe0c78995edd1f P 91632a26834d43f3a8fca18e454b405f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a378f6f5259e4da08bc57e1749f81d45 in term 0.
I20260809 13:03:33.041190 9270 consensus_queue.cc:237] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a378f6f5259e4da08bc57e1749f81d45" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 39059 } } peers { permanent_uuid: "91632a26834d43f3a8fca18e454b405f" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44473 } } peers { permanent_uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45137 } }
I20260809 13:03:33.041460 9127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad3943564f5745548cbe0c78995edd1f" candidate_uuid: "a378f6f5259e4da08bc57e1749f81d45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91632a26834d43f3a8fca18e454b405f"
I20260809 13:03:33.041668 8555 leader_election.cc:302] T ad3943564f5745548cbe0c78995edd1f P 1ccb3277a9cf4b91bbaaad4d2ed54254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ccb3277a9cf4b91bbaaad4d2ed54254, 91632a26834d43f3a8fca18e454b405f; no voters: a378f6f5259e4da08bc57e1749f81d45
I20260809 13:03:33.041754 9127 raft_consensus.cc:3037] T ad3943564f5745548cbe0c78995edd1f P 91632a26834d43f3a8fca18e454b405f [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:33.044852 9127 raft_consensus.cc:2454] T ad3943564f5745548cbe0c78995edd1f P 91632a26834d43f3a8fca18e454b405f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a378f6f5259e4da08bc57e1749f81d45 in term 1.
I20260809 13:03:33.045231 9274 raft_consensus.cc:2741] T ad3943564f5745548cbe0c78995edd1f P 1ccb3277a9cf4b91bbaaad4d2ed54254 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260809 13:03:33.046737 7094 catalog_manager.cc:5495] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45 reported cstate change: term changed from 0 to 1, leader changed from <none> to a378f6f5259e4da08bc57e1749f81d45 (127.28.155.194). New cstate: current_term: 1 leader_uuid: "a378f6f5259e4da08bc57e1749f81d45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a378f6f5259e4da08bc57e1749f81d45" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 39059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91632a26834d43f3a8fca18e454b405f" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45137 } health_report { overall_health: UNKNOWN } } }
W20260809 13:03:33.067202 9210 tablet.cc:2369] T ad3943564f5745548cbe0c78995edd1f P 91632a26834d43f3a8fca18e454b405f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:03:33.097303 9249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:33.091587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50128 (local address 127.28.155.194:39059)
0809 13:03:33.091792 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:33.091798 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:33.091818 (+ 20us) server_negotiation.cc:407] Connection header received
0809 13:03:33.092001 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:33.092005 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:33.092111 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:33.092279 (+ 168us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:03:33.092770 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:33.093532 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:33.094917 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:33.095358 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:33.095501 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:33.096016 (+ 515us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:03:33.096642 (+ 626us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:03:33.096804 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:33.096889 (+ 85us) server_negotiation.cc:299] Negotiation successful
0809 13:03:33.096977 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 13:03:33.106482 9127 raft_consensus.cc:1261] T ad3943564f5745548cbe0c78995edd1f P 91632a26834d43f3a8fca18e454b405f [term 1 FOLLOWER]: Refusing update from remote peer a378f6f5259e4da08bc57e1749f81d45: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:03:33.106482 8663 raft_consensus.cc:1261] T ad3943564f5745548cbe0c78995edd1f P 1ccb3277a9cf4b91bbaaad4d2ed54254 [term 1 FOLLOWER]: Refusing update from remote peer a378f6f5259e4da08bc57e1749f81d45: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:03:33.107564 9270 consensus_queue.cc:1035] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91632a26834d43f3a8fca18e454b405f" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:03:33.107928 9281 consensus_queue.cc:1035] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:03:33.131819 9289 mvcc.cc:205] Tried to move back new op lower bound from 7316605391272169472 to 7316605391021867008. Current Snapshot: MvccSnapshot[applied={T|T < 7316605391272169472 or (T in {7316605391272169472})}]
I20260809 13:03:33.148054 7094 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:03:33.148386 7094 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:03:33.157393 7094 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b317f0a53c51431c85e6fe16a219c490: Sending DeleteTablet for 3 replicas of tablet ad3943564f5745548cbe0c78995edd1f
I20260809 13:03:33.158528 8866 tablet_service.cc:1514] Processing DeleteTablet for tablet ad3943564f5745548cbe0c78995edd1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:03:33 UTC) from {username='oryx', principal='oryx/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:50118
I20260809 13:03:33.160246 9100 tablet_service.cc:1514] Processing DeleteTablet for tablet ad3943564f5745548cbe0c78995edd1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:03:33 UTC) from {username='oryx', principal='oryx/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:35352
I20260809 13:03:33.164148 8628 tablet_service.cc:1514] Processing DeleteTablet for tablet ad3943564f5745548cbe0c78995edd1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:03:33 UTC) from {username='oryx', principal='oryx/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:58254
I20260809 13:03:33.177340 9304 tablet_replica.cc:330] T ad3943564f5745548cbe0c78995edd1f P 91632a26834d43f3a8fca18e454b405f: stopping tablet replica
I20260809 13:03:33.177976 9304 raft_consensus.cc:2229] T ad3943564f5745548cbe0c78995edd1f P 91632a26834d43f3a8fca18e454b405f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:03:33.178639 9304 raft_consensus.cc:2258] T ad3943564f5745548cbe0c78995edd1f P 91632a26834d43f3a8fca18e454b405f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:03:33.181273 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 7048
I20260809 13:03:33.181600 9304 ts_tablet_manager.cc:1905] T ad3943564f5745548cbe0c78995edd1f P 91632a26834d43f3a8fca18e454b405f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:03:33.182588 7143 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:33.183004 9303 tablet_replica.cc:330] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45: stopping tablet replica
I20260809 13:03:33.186561 9305 tablet_replica.cc:330] T ad3943564f5745548cbe0c78995edd1f P 1ccb3277a9cf4b91bbaaad4d2ed54254: stopping tablet replica
I20260809 13:03:33.187019 9305 raft_consensus.cc:2229] T ad3943564f5745548cbe0c78995edd1f P 1ccb3277a9cf4b91bbaaad4d2ed54254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:03:33.187564 9305 raft_consensus.cc:2258] T ad3943564f5745548cbe0c78995edd1f P 1ccb3277a9cf4b91bbaaad4d2ed54254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:03:33.188176 9303 raft_consensus.cc:2229] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45 [term 1 LEADER]: Raft consensus shutting down.
I20260809 13:03:33.189672 9303 raft_consensus.cc:2258] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:03:33.193709 9304 ts_tablet_manager.cc:1918] T ad3943564f5745548cbe0c78995edd1f P 91632a26834d43f3a8fca18e454b405f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:03:33.193920 9304 log.cc:1196] T ad3943564f5745548cbe0c78995edd1f P 91632a26834d43f3a8fca18e454b405f: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/wal/wals/ad3943564f5745548cbe0c78995edd1f
I20260809 13:03:33.194581 9304 ts_tablet_manager.cc:1939] T ad3943564f5745548cbe0c78995edd1f P 91632a26834d43f3a8fca18e454b405f: Deleting consensus metadata
I20260809 13:03:33.203902 9305 ts_tablet_manager.cc:1905] T ad3943564f5745548cbe0c78995edd1f P 1ccb3277a9cf4b91bbaaad4d2ed54254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:03:33.207175 9303 ts_tablet_manager.cc:1905] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:03:33.211678 9305 ts_tablet_manager.cc:1918] T ad3943564f5745548cbe0c78995edd1f P 1ccb3277a9cf4b91bbaaad4d2ed54254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:03:33.211890 9305 log.cc:1196] T ad3943564f5745548cbe0c78995edd1f P 1ccb3277a9cf4b91bbaaad4d2ed54254: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/wal/wals/ad3943564f5745548cbe0c78995edd1f
I20260809 13:03:33.212514 9305 ts_tablet_manager.cc:1939] T ad3943564f5745548cbe0c78995edd1f P 1ccb3277a9cf4b91bbaaad4d2ed54254: Deleting consensus metadata
I20260809 13:03:33.215297 9303 ts_tablet_manager.cc:1918] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:03:33.215514 9303 log.cc:1196] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/wal/wals/ad3943564f5745548cbe0c78995edd1f
I20260809 13:03:33.216176 9303 ts_tablet_manager.cc:1939] T ad3943564f5745548cbe0c78995edd1f P a378f6f5259e4da08bc57e1749f81d45: Deleting consensus metadata
I20260809 13:03:33.224061 9212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:33.167247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40910 (local address 127.28.155.253:40247)
0809 13:03:33.167465 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:33.167472 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:33.180098 (+ 12626us) server_negotiation.cc:407] Connection header received
0809 13:03:33.182992 (+ 2894us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:33.182999 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:33.183110 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:33.183223 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:33.186109 (+ 2886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:33.187345 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:33.202013 (+ 14668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:33.202743 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:33.202863 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:33.215756 (+ 12893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:33.215765 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:33.215770 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:33.215831 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:33.220111 (+ 4280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:33.221285 (+ 1174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:33.221291 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:33.221295 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:33.221471 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:33.222058 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:33.222065 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:33.222068 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:33.222490 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:33.222775 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:33.223407 (+ 632us) server_negotiation.cc:299] Negotiation successful
0809 13:03:33.223686 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 13:03:33.241482 9211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:33.180308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35760 (local address 127.28.155.252:39567)
0809 13:03:33.180558 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:33.180564 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:33.227035 (+ 46471us) server_negotiation.cc:407] Connection header received
0809 13:03:33.227329 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:33.227335 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:33.227431 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:33.227509 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:33.229352 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:33.230187 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:33.231665 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:33.232207 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:33.232356 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:33.235599 (+ 3243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:33.235604 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:33.235607 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:33.235656 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:33.238626 (+ 2970us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:33.239322 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:33.239327 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:33.239331 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:33.239467 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:33.239868 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:33.239877 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:33.239880 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:33.240188 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:33.240463 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:33.240845 (+ 382us) server_negotiation.cc:299] Negotiation successful
0809 13:03:33.241093 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 13:03:33.379170 7073 catalog_manager.cc:4841] TS 1ccb3277a9cf4b91bbaaad4d2ed54254 (127.28.155.193:45137): tablet ad3943564f5745548cbe0c78995edd1f (table test-table [id=b612fafadf8a44f5ae63efe5b60cb159]) successfully deleted
I20260809 13:03:33.379504 7076 catalog_manager.cc:4841] TS a378f6f5259e4da08bc57e1749f81d45 (127.28.155.194:39059): tablet ad3943564f5745548cbe0c78995edd1f (table test-table [id=b612fafadf8a44f5ae63efe5b60cb159]) successfully deleted
I20260809 13:03:33.379729 7077 catalog_manager.cc:4841] TS 91632a26834d43f3a8fca18e454b405f (127.28.155.195:44473): tablet ad3943564f5745548cbe0c78995edd1f (table test-table [id=b612fafadf8a44f5ae63efe5b60cb159]) successfully deleted
I20260809 13:03:33.380645 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 7048
I20260809 13:03:33.439467 9212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:33.418084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40916 (local address 127.28.155.253:40247)
0809 13:03:33.418387 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:33.418397 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:33.419734 (+ 1337us) server_negotiation.cc:407] Connection header received
0809 13:03:33.420123 (+ 389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:33.420132 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:33.420255 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:33.420351 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:33.424099 (+ 3748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:33.425720 (+ 1621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:33.427933 (+ 2213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:33.428395 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:33.428762 (+ 367us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:33.432163 (+ 3401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:33.432168 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:33.432171 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:33.432211 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:33.436083 (+ 3872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:33.436918 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:33.436923 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:33.436927 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:33.437113 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:33.437553 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:33.437558 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:33.437560 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:33.437951 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:33.438211 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:33.438684 (+ 473us) server_negotiation.cc:299] Negotiation successful
0809 13:03:33.438935 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260809 13:03:33.445214 9211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:33.419412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35772 (local address 127.28.155.252:39567)
0809 13:03:33.419697 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:33.419706 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:33.426863 (+ 7157us) server_negotiation.cc:407] Connection header received
0809 13:03:33.427422 (+ 559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:33.427432 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:33.427536 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:33.427655 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:33.430120 (+ 2465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:33.431480 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:33.433527 (+ 2047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:33.434352 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:33.434525 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:33.439324 (+ 4799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:33.439329 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:33.439332 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:33.439369 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:33.442372 (+ 3003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:33.443048 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:33.443053 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:33.443061 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:33.443200 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:33.443619 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:33.443623 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:33.443625 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:33.443947 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:33.444226 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:33.444616 (+ 390us) server_negotiation.cc:299] Negotiation successful
0809 13:03:33.444858 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 13:03:34.135591 9317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.134373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.28.155.193:46127)
0809 13:03:34.135135 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.135298 (+ 163us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":636,"thread_start_us":491,"threads_started":1}
W20260809 13:03:34.136056 8740 heartbeater.cc:644] Failed to heartbeat to 127.28.155.254:42999 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
I20260809 13:03:34.139569 9319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.138571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.28.155.194:37657)
0809 13:03:34.139079 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.139332 (+ 253us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":253,"threads_started":1}
W20260809 13:03:34.140041 8975 heartbeater.cc:644] Failed to heartbeat to 127.28.155.254:42999 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
I20260809 13:03:34.143782 9320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.142838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.28.155.195:43839)
0809 13:03:34.143453 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.143584 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":368,"threads_started":1}
W20260809 13:03:34.144197 9207 heartbeater.cc:644] Failed to heartbeat to 127.28.155.254:42999 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
I20260809 13:03:34.656564 9321 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b317f0a53c51431c85e6fe16a219c490)
I20260809 13:03:34.656911 9321 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: false } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: false } }
I20260809 13:03:34.658363 9321 leader_election.cc:288] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b317f0a53c51431c85e6fe16a219c490 (127.28.155.254:42999), 7a67b38a17ca4b74bd025ea37b49c361 (127.28.155.252:39567)
I20260809 13:03:34.659461 9323 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b317f0a53c51431c85e6fe16a219c490)
I20260809 13:03:34.659885 9322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.658608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.0.0.1:39132)
0809 13:03:34.659198 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.659476 (+ 278us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":279,"threads_started":1}
I20260809 13:03:34.659886 9323 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: false } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: false } }
W20260809 13:03:34.661176 8085 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
I20260809 13:03:34.663185 9326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.662576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.0.0.1:39148)
0809 13:03:34.662734 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.662908 (+ 174us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 13:03:34.663650 9335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.662111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.0.0.1:39140)
0809 13:03:34.663031 (+ 920us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.663281 (+ 250us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":794,"thread_start_us":604,"threads_started":1}
W20260809 13:03:34.664389 8418 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
I20260809 13:03:34.668787 9323 leader_election.cc:288] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b317f0a53c51431c85e6fe16a219c490 (127.28.155.254:42999), 8adab2e3f7e248bd899bb7ad2d3d7bff (127.28.155.253:40247)
W20260809 13:03:34.669592 8085 leader_election.cc:334] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b317f0a53c51431c85e6fe16a219c490 (127.28.155.254:42999): Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
I20260809 13:03:34.671043 9322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.659350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:39567 (local address 127.0.0.1:35784)
0809 13:03:34.660326 (+ 976us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.660351 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:34.660550 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:34.661891 (+ 1341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:34.661896 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:34.661957 (+ 61us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:03:34.662208 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:34.662217 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:34.665099 (+ 2882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:34.665108 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:34.667985 (+ 2877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:34.668009 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:34.670196 (+ 2187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:34.670202 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:34.670408 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:34.670447 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 13:03:34.670521 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 13:03:34.670685 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":830,"thread_start_us":1485,"threads_started":1}
I20260809 13:03:34.672134 9328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.659651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35784 (local address 127.28.155.252:39567)
0809 13:03:34.661461 (+ 1810us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:34.661467 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:34.661489 (+ 22us) server_negotiation.cc:407] Connection header received
0809 13:03:34.661567 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:34.661573 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:34.661684 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:34.662403 (+ 719us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:03:34.663456 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:34.664877 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:34.668265 (+ 3388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:34.669940 (+ 1675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:34.671397 (+ 1457us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:34.671472 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:34.671523 (+ 51us) server_negotiation.cc:299] Negotiation successful
0809 13:03:34.671683 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1659,"thread_start_us":1500,"threads_started":1}
I20260809 13:03:34.672245 9336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.671460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.0.0.1:39160)
0809 13:03:34.671823 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.671979 (+ 156us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210}
W20260809 13:03:34.672425 8418 leader_election.cc:334] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b317f0a53c51431c85e6fe16a219c490 (127.28.155.254:42999): Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
I20260809 13:03:34.672801 8462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "7a67b38a17ca4b74bd025ea37b49c361" is_pre_election: true
I20260809 13:03:34.673146 8462 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8adab2e3f7e248bd899bb7ad2d3d7bff in term 1.
I20260809 13:03:34.673676 8085 leader_election.cc:302] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a67b38a17ca4b74bd025ea37b49c361, 8adab2e3f7e248bd899bb7ad2d3d7bff; no voters: b317f0a53c51431c85e6fe16a219c490
I20260809 13:03:34.674099 9321 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 13:03:34.674239 9321 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [term 1 FOLLOWER]: Starting leader election (detected failure of leader b317f0a53c51431c85e6fe16a219c490)
I20260809 13:03:34.674360 9321 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [term 1 FOLLOWER]: Advancing to term 2
I20260809 13:03:34.677426 9335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.662948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:40247 (local address 127.0.0.1:40930)
0809 13:03:34.663957 (+ 1009us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.663986 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:34.664099 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:34.670652 (+ 6553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:34.670657 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:34.670698 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:03:34.671118 (+ 420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:34.671138 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:34.673530 (+ 2392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:34.673535 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:34.675148 (+ 1613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:34.675161 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:34.676876 (+ 1715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:34.676880 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:34.677002 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:34.677026 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 13:03:34.677113 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 13:03:34.677217 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":911,"thread_start_us":8592,"threads_started":1}
I20260809 13:03:34.677556 9321 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: false } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: false } }
I20260809 13:03:34.677785 9339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.663115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40930 (local address 127.28.155.253:40247)
0809 13:03:34.670137 (+ 7022us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:34.670143 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:34.670167 (+ 24us) server_negotiation.cc:407] Connection header received
0809 13:03:34.670220 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:34.670225 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:34.670302 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:34.671631 (+ 1329us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:03:34.671901 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:34.673363 (+ 1462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:34.675325 (+ 1962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:34.676716 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:34.676888 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:34.676959 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:34.677165 (+ 206us) server_negotiation.cc:299] Negotiation successful
0809 13:03:34.677331 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6413,"thread_start_us":6168,"threads_started":1}
I20260809 13:03:34.678365 9321 leader_election.cc:288] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [CANDIDATE]: Term 2 election: Requested vote from peers b317f0a53c51431c85e6fe16a219c490 (127.28.155.254:42999), 7a67b38a17ca4b74bd025ea37b49c361 (127.28.155.252:39567)
I20260809 13:03:34.678591 8127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7a67b38a17ca4b74bd025ea37b49c361" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" is_pre_election: true
I20260809 13:03:34.678977 8127 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a67b38a17ca4b74bd025ea37b49c361 in current term 2: Already voted for candidate 8adab2e3f7e248bd899bb7ad2d3d7bff in this term.
I20260809 13:03:34.679011 9322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.678528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.0.0.1:39170)
0809 13:03:34.678695 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.678804 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260809 13:03:34.679190 8462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "7a67b38a17ca4b74bd025ea37b49c361"
I20260809 13:03:34.679445 8462 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [term 1 FOLLOWER]: Advancing to term 2
I20260809 13:03:34.679752 8422 leader_election.cc:302] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a67b38a17ca4b74bd025ea37b49c361; no voters: 8adab2e3f7e248bd899bb7ad2d3d7bff, b317f0a53c51431c85e6fe16a219c490
I20260809 13:03:34.680099 9322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.679691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.0.0.1:39184)
0809 13:03:34.679862 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.679971 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260809 13:03:34.680274 8085 leader_election.cc:334] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b317f0a53c51431c85e6fe16a219c490 (127.28.155.254:42999): Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
I20260809 13:03:34.681968 8462 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8adab2e3f7e248bd899bb7ad2d3d7bff in term 2.
I20260809 13:03:34.682271 9323 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 13:03:34.682514 8085 leader_election.cc:302] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a67b38a17ca4b74bd025ea37b49c361, 8adab2e3f7e248bd899bb7ad2d3d7bff; no voters: b317f0a53c51431c85e6fe16a219c490
I20260809 13:03:34.682828 9321 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [term 2 FOLLOWER]: Leader election won for term 2
I20260809 13:03:34.683383 9321 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [term 2 LEADER]: Becoming Leader. State: Replica: 8adab2e3f7e248bd899bb7ad2d3d7bff, State: Running, Role: LEADER
I20260809 13:03:34.683794 9321 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: false } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: false } }
I20260809 13:03:34.685513 9342 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8adab2e3f7e248bd899bb7ad2d3d7bff. Latest consensus state: current_term: 2 leader_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: false } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: false } } }
I20260809 13:03:34.685858 9342 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:34.686522 9348 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:03:34.692272 9348 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:03:34.693325 9348 catalog_manager.cc:1259] Loaded cluster ID: e9f390c010254238bb371f7000fec8b2
I20260809 13:03:34.693410 9348 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:03:34.694682 9348 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:03:34.695509 9348 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff: Loaded TSK: 0
I20260809 13:03:34.696434 9348 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 13:03:34.747298 8106 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40916:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 13:03:34.755623 8106 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:03:34.760288 9322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.759855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.0.0.1:39220)
0809 13:03:34.760040 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.760132 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 13:03:34.760819 8462 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [term 2 FOLLOWER]: Refusing update from remote peer 8adab2e3f7e248bd899bb7ad2d3d7bff: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260809 13:03:34.761472 9322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.761048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.0.0.1:39228)
0809 13:03:34.761198 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.761290 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 13:03:34.761616 9342 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260809 13:03:34.761965 8085 consensus_peers.cc:487] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff -> Peer b317f0a53c51431c85e6fe16a219c490 (127.28.155.254:42999): Couldn't send request to peer b317f0a53c51431c85e6fe16a219c490. Status: Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 13:03:34.764923 9323 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8adab2e3f7e248bd899bb7ad2d3d7bff. Latest consensus state: current_term: 2 leader_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: false } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: false } } }
I20260809 13:03:34.765249 9323 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 13:03:34.767812 9323 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: false } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: false } } }
I20260809 13:03:34.768414 9323 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a67b38a17ca4b74bd025ea37b49c361 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 13:03:34.773073 9357 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b317f0a53c51431c85e6fe16a219c490" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42999 } } peers { permanent_uuid: "8adab2e3f7e248bd899bb7ad2d3d7bff" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40247 } attrs { promote: false } } peers { permanent_uuid: "7a67b38a17ca4b74bd025ea37b49c361" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 39567 } attrs { promote: false } } }
I20260809 13:03:34.773667 9357 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:34.791095 9322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.781167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:45137 (local address 127.0.0.1:58262)
0809 13:03:34.781424 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.781442 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:34.781535 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:34.782515 (+ 980us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:34.782522 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:34.782555 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:03:34.782785 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:34.782797 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:34.784655 (+ 1858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:34.784664 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:34.787657 (+ 2993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:34.787679 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:34.789921 (+ 2242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:34.789931 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:34.790238 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:34.790300 (+ 62us) client_negotiation.cc:769] Sending connection context
0809 13:03:34.790388 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 13:03:34.790594 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68,"mutex_wait_us":171}
I20260809 13:03:34.792598 9326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.782353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:44473 (local address 127.0.0.1:35364)
0809 13:03:34.782506 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.782524 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:34.782633 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:34.783431 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:34.783436 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:34.783462 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:03:34.783877 (+ 415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:34.783890 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:34.785810 (+ 1920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:34.785819 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:34.788699 (+ 2880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:34.788722 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:34.791461 (+ 2739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:34.791470 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:34.791731 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:34.791788 (+ 57us) client_negotiation.cc:769] Sending connection context
0809 13:03:34.791875 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 13:03:34.792097 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":1}
I20260809 13:03:34.792887 9358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.781373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58262 (local address 127.28.155.193:45137)
0809 13:03:34.781878 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:34.781884 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:34.781904 (+ 20us) server_negotiation.cc:407] Connection header received
0809 13:03:34.781980 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:34.781986 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:34.782092 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:34.782937 (+ 845us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:03:34.783130 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:34.784387 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:34.787920 (+ 3533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:34.789684 (+ 1764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:34.792028 (+ 2344us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:34.792163 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:34.792229 (+ 66us) server_negotiation.cc:299] Negotiation successful
0809 13:03:34.792443 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":412,"threads_started":1}
I20260809 13:03:34.793588 9359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.782468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35364 (local address 127.28.155.195:44473)
0809 13:03:34.783100 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:34.783105 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:34.783125 (+ 20us) server_negotiation.cc:407] Connection header received
0809 13:03:34.783203 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:34.783210 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:34.783302 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:34.783415 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:03:34.784092 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:34.785615 (+ 1523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:34.789378 (+ 3763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:34.791205 (+ 1827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:34.792911 (+ 1706us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:34.792999 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:34.793052 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 13:03:34.793267 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":502,"thread_start_us":394,"threads_started":1}
I20260809 13:03:34.793880 8628 tablet_service.cc:1467] Processing CreateTablet for tablet e09edca2bfef417db07ee0c0a182ae32 (DEFAULT_TABLE table=test-table [id=b9f281ed879a46368c08a26a1d2b1502]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:03:34.794414 8628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e09edca2bfef417db07ee0c0a182ae32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:34.794359 9100 tablet_service.cc:1467] Processing CreateTablet for tablet e09edca2bfef417db07ee0c0a182ae32 (DEFAULT_TABLE table=test-table [id=b9f281ed879a46368c08a26a1d2b1502]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:03:34.794809 9100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e09edca2bfef417db07ee0c0a182ae32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:34.800176 9362 tablet_bootstrap.cc:492] T e09edca2bfef417db07ee0c0a182ae32 P 1ccb3277a9cf4b91bbaaad4d2ed54254: Bootstrap starting.
I20260809 13:03:34.801982 9362 tablet_bootstrap.cc:654] T e09edca2bfef417db07ee0c0a182ae32 P 1ccb3277a9cf4b91bbaaad4d2ed54254: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:34.804337 9362 tablet_bootstrap.cc:492] T e09edca2bfef417db07ee0c0a182ae32 P 1ccb3277a9cf4b91bbaaad4d2ed54254: No bootstrap required, opened a new log
I20260809 13:03:34.804556 9362 ts_tablet_manager.cc:1397] T e09edca2bfef417db07ee0c0a182ae32 P 1ccb3277a9cf4b91bbaaad4d2ed54254: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20260809 13:03:34.804823 9363 tablet_bootstrap.cc:492] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f: Bootstrap starting.
I20260809 13:03:34.805415 9362 raft_consensus.cc:348] T e09edca2bfef417db07ee0c0a182ae32 P 1ccb3277a9cf4b91bbaaad4d2ed54254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45137 } } peers { permanent_uuid: "91632a26834d43f3a8fca18e454b405f" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44473 } } peers { permanent_uuid: "a378f6f5259e4da08bc57e1749f81d45" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 39059 } }
I20260809 13:03:34.805678 9362 raft_consensus.cc:374] T e09edca2bfef417db07ee0c0a182ae32 P 1ccb3277a9cf4b91bbaaad4d2ed54254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:34.805776 9362 raft_consensus.cc:729] T e09edca2bfef417db07ee0c0a182ae32 P 1ccb3277a9cf4b91bbaaad4d2ed54254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ccb3277a9cf4b91bbaaad4d2ed54254, State: Initialized, Role: FOLLOWER
I20260809 13:03:34.806025 9362 consensus_queue.cc:260] T e09edca2bfef417db07ee0c0a182ae32 P 1ccb3277a9cf4b91bbaaad4d2ed54254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45137 } } peers { permanent_uuid: "91632a26834d43f3a8fca18e454b405f" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44473 } } peers { permanent_uuid: "a378f6f5259e4da08bc57e1749f81d45" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 39059 } }
I20260809 13:03:34.806838 9363 tablet_bootstrap.cc:654] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:34.806931 9362 ts_tablet_manager.cc:1428] T e09edca2bfef417db07ee0c0a182ae32 P 1ccb3277a9cf4b91bbaaad4d2ed54254: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 13:03:34.808653 9367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.807647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.28.155.193:57607)
0809 13:03:34.808235 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.808375 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":439,"threads_started":1}
I20260809 13:03:34.810395 9322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.783405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:39059 (local address 127.0.0.1:50130)
0809 13:03:34.791470 (+ 8065us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.791496 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:34.791627 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:34.803842 (+ 12215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:34.803852 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:34.803895 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:03:34.804189 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:34.804205 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:34.805782 (+ 1577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:34.805791 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:34.807713 (+ 1922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:34.807732 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:34.809539 (+ 1807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:34.809548 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:34.809781 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:34.809817 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 13:03:34.809922 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 13:03:34.810073 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7896,"thread_start_us":10408,"threads_started":1}
I20260809 13:03:34.811087 9361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.783862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50130 (local address 127.28.155.194:39059)
0809 13:03:34.803194 (+ 19332us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:34.803206 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:34.803238 (+ 32us) server_negotiation.cc:407] Connection header received
0809 13:03:34.803341 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:34.803350 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:34.803459 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:34.804381 (+ 922us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:03:34.804652 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:34.805552 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:34.807876 (+ 2324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:34.809136 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:34.809321 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:34.809407 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:34.810704 (+ 1297us) server_negotiation.cc:299] Negotiation successful
0809 13:03:34.810862 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19138,"thread_start_us":19759,"threads_started":1}
I20260809 13:03:34.813068 8741 heartbeater.cc:503] Master 127.28.155.253:40247 was elected leader, sending a full tablet report...
I20260809 13:03:34.813223 8866 tablet_service.cc:1467] Processing CreateTablet for tablet e09edca2bfef417db07ee0c0a182ae32 (DEFAULT_TABLE table=test-table [id=b9f281ed879a46368c08a26a1d2b1502]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:03:34.813684 8866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e09edca2bfef417db07ee0c0a182ae32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:34.818651 9367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.814475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.28.155.193:35271)
0809 13:03:34.818373 (+ 3898us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.818485 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3770}
I20260809 13:03:34.819819 9363 tablet_bootstrap.cc:492] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f: No bootstrap required, opened a new log
I20260809 13:03:34.820014 9363 ts_tablet_manager.cc:1397] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.010s
I20260809 13:03:34.820868 9373 tablet_bootstrap.cc:492] T e09edca2bfef417db07ee0c0a182ae32 P a378f6f5259e4da08bc57e1749f81d45: Bootstrap starting.
I20260809 13:03:34.821120 9363 raft_consensus.cc:348] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45137 } } peers { permanent_uuid: "91632a26834d43f3a8fca18e454b405f" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44473 } } peers { permanent_uuid: "a378f6f5259e4da08bc57e1749f81d45" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 39059 } }
I20260809 13:03:34.821380 9363 raft_consensus.cc:374] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:34.821498 9363 raft_consensus.cc:729] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91632a26834d43f3a8fca18e454b405f, State: Initialized, Role: FOLLOWER
I20260809 13:03:34.821914 9363 consensus_queue.cc:260] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45137 } } peers { permanent_uuid: "91632a26834d43f3a8fca18e454b405f" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44473 } } peers { permanent_uuid: "a378f6f5259e4da08bc57e1749f81d45" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 39059 } }
I20260809 13:03:34.822875 9363 ts_tablet_manager.cc:1428] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 13:03:34.822940 9373 tablet_bootstrap.cc:654] T e09edca2bfef417db07ee0c0a182ae32 P a378f6f5259e4da08bc57e1749f81d45: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:34.826725 9373 tablet_bootstrap.cc:492] T e09edca2bfef417db07ee0c0a182ae32 P a378f6f5259e4da08bc57e1749f81d45: No bootstrap required, opened a new log
I20260809 13:03:34.826725 9208 heartbeater.cc:503] Master 127.28.155.253:40247 was elected leader, sending a full tablet report...
I20260809 13:03:34.826928 9373 ts_tablet_manager.cc:1397] T e09edca2bfef417db07ee0c0a182ae32 P a378f6f5259e4da08bc57e1749f81d45: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 13:03:34.827962 9376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.823542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.28.155.195:52513)
0809 13:03:34.827553 (+ 4011us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.827703 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3882,"thread_start_us":3748,"threads_started":1}
I20260809 13:03:34.827929 9373 raft_consensus.cc:348] T e09edca2bfef417db07ee0c0a182ae32 P a378f6f5259e4da08bc57e1749f81d45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45137 } } peers { permanent_uuid: "91632a26834d43f3a8fca18e454b405f" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44473 } } peers { permanent_uuid: "a378f6f5259e4da08bc57e1749f81d45" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 39059 } }
I20260809 13:03:34.828218 9373 raft_consensus.cc:374] T e09edca2bfef417db07ee0c0a182ae32 P a378f6f5259e4da08bc57e1749f81d45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:34.828356 9373 raft_consensus.cc:729] T e09edca2bfef417db07ee0c0a182ae32 P a378f6f5259e4da08bc57e1749f81d45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a378f6f5259e4da08bc57e1749f81d45, State: Initialized, Role: FOLLOWER
I20260809 13:03:34.828680 9373 consensus_queue.cc:260] T e09edca2bfef417db07ee0c0a182ae32 P a378f6f5259e4da08bc57e1749f81d45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45137 } } peers { permanent_uuid: "91632a26834d43f3a8fca18e454b405f" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44473 } } peers { permanent_uuid: "a378f6f5259e4da08bc57e1749f81d45" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 39059 } }
I20260809 13:03:34.829360 9376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.828899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.28.155.195:48869)
0809 13:03:34.829069 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.829200 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 13:03:34.829617 9373 ts_tablet_manager.cc:1428] T e09edca2bfef417db07ee0c0a182ae32 P a378f6f5259e4da08bc57e1749f81d45: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 13:03:34.831766 9379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.830331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.28.155.194:36015)
0809 13:03:34.831363 (+ 1032us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.831499 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":927,"threads_started":1}
I20260809 13:03:34.832515 8978 heartbeater.cc:503] Master 127.28.155.253:40247 was elected leader, sending a full tablet report...
I20260809 13:03:34.833568 9379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.832760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.28.155.194:36631)
0809 13:03:34.833385 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.833468 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":482}
I20260809 13:03:34.872591 9375 raft_consensus.cc:482] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:03:34.872915 9375 raft_consensus.cc:504] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45137 } } peers { permanent_uuid: "91632a26834d43f3a8fca18e454b405f" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44473 } } peers { permanent_uuid: "a378f6f5259e4da08bc57e1749f81d45" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 39059 } }
I20260809 13:03:34.874634 9375 leader_election.cc:288] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ccb3277a9cf4b91bbaaad4d2ed54254 (127.28.155.193:45137), a378f6f5259e4da08bc57e1749f81d45 (127.28.155.194:39059)
I20260809 13:03:34.882814 9358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.875227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:44619 (local address 127.28.155.193:45137)
0809 13:03:34.875500 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:34.875510 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:34.876055 (+ 545us) server_negotiation.cc:407] Connection header received
0809 13:03:34.876215 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:34.876219 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:34.876279 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:34.876351 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:03:34.876880 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:34.877866 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:34.880226 (+ 2360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:34.881547 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:34.881734 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:34.881826 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:34.882390 (+ 564us) server_negotiation.cc:299] Negotiation successful
0809 13:03:34.882532 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260809 13:03:34.882856 9361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.875142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:34935 (local address 127.28.155.194:39059)
0809 13:03:34.875355 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:34.875363 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:34.875391 (+ 28us) server_negotiation.cc:407] Connection header received
0809 13:03:34.875721 (+ 330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:34.875727 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:34.875820 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:34.875922 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:03:34.876503 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:34.877578 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:34.880237 (+ 2659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:34.881555 (+ 1318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:34.881775 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:34.881844 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:34.882390 (+ 546us) server_negotiation.cc:299] Negotiation successful
0809 13:03:34.882532 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 13:03:34.882925 9376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.874973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:39059 (local address 127.28.155.195:34935)
0809 13:03:34.875281 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.875302 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:34.875515 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:34.875989 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:34.875995 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:34.876030 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:03:34.876295 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:34.876304 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:34.877734 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:34.877738 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:34.880065 (+ 2327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:34.880080 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:34.881800 (+ 1720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:34.881805 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:34.882135 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:34.882251 (+ 116us) client_negotiation.cc:769] Sending connection context
0809 13:03:34.882356 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 13:03:34.882518 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"mutex_wait_us":209}
I20260809 13:03:34.882953 9380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.874973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:45137 (local address 127.28.155.195:44619)
0809 13:03:34.875932 (+ 959us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.875949 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:34.876063 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:34.876396 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:34.876403 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:34.876434 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:03:34.876726 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:34.876734 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:34.878000 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:34.878005 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:34.880064 (+ 2059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:34.880080 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:34.881791 (+ 1711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:34.881798 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:34.882134 (+ 336us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:34.882248 (+ 114us) client_negotiation.cc:769] Sending connection context
0809 13:03:34.882423 (+ 175us) client_negotiation.cc:240] Negotiation successful
0809 13:03:34.882531 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":807,"mutex_wait_us":143,"thread_start_us":534,"threads_started":1}
I20260809 13:03:34.883950 8663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e09edca2bfef417db07ee0c0a182ae32" candidate_uuid: "91632a26834d43f3a8fca18e454b405f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254" is_pre_election: true
I20260809 13:03:34.884258 8663 raft_consensus.cc:2454] T e09edca2bfef417db07ee0c0a182ae32 P 1ccb3277a9cf4b91bbaaad4d2ed54254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91632a26834d43f3a8fca18e454b405f in term 0.
I20260809 13:03:34.884408 8900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e09edca2bfef417db07ee0c0a182ae32" candidate_uuid: "91632a26834d43f3a8fca18e454b405f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a378f6f5259e4da08bc57e1749f81d45" is_pre_election: true
I20260809 13:03:34.884754 8900 raft_consensus.cc:2454] T e09edca2bfef417db07ee0c0a182ae32 P a378f6f5259e4da08bc57e1749f81d45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91632a26834d43f3a8fca18e454b405f in term 0.
I20260809 13:03:34.884939 9021 leader_election.cc:302] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ccb3277a9cf4b91bbaaad4d2ed54254, 91632a26834d43f3a8fca18e454b405f; no voters:
I20260809 13:03:34.885398 9375 raft_consensus.cc:2781] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:03:34.885561 9375 raft_consensus.cc:482] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:03:34.885684 9375 raft_consensus.cc:3037] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:34.888053 9375 raft_consensus.cc:504] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45137 } } peers { permanent_uuid: "91632a26834d43f3a8fca18e454b405f" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44473 } } peers { permanent_uuid: "a378f6f5259e4da08bc57e1749f81d45" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 39059 } }
I20260809 13:03:34.888772 9375 leader_election.cc:288] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f [CANDIDATE]: Term 1 election: Requested vote from peers 1ccb3277a9cf4b91bbaaad4d2ed54254 (127.28.155.193:45137), a378f6f5259e4da08bc57e1749f81d45 (127.28.155.194:39059)
I20260809 13:03:34.889258 8663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e09edca2bfef417db07ee0c0a182ae32" candidate_uuid: "91632a26834d43f3a8fca18e454b405f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254"
I20260809 13:03:34.889343 8900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e09edca2bfef417db07ee0c0a182ae32" candidate_uuid: "91632a26834d43f3a8fca18e454b405f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a378f6f5259e4da08bc57e1749f81d45"
I20260809 13:03:34.889525 8663 raft_consensus.cc:3037] T e09edca2bfef417db07ee0c0a182ae32 P 1ccb3277a9cf4b91bbaaad4d2ed54254 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:34.889582 8900 raft_consensus.cc:3037] T e09edca2bfef417db07ee0c0a182ae32 P a378f6f5259e4da08bc57e1749f81d45 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:34.892793 8900 raft_consensus.cc:2454] T e09edca2bfef417db07ee0c0a182ae32 P a378f6f5259e4da08bc57e1749f81d45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91632a26834d43f3a8fca18e454b405f in term 1.
I20260809 13:03:34.892793 8663 raft_consensus.cc:2454] T e09edca2bfef417db07ee0c0a182ae32 P 1ccb3277a9cf4b91bbaaad4d2ed54254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91632a26834d43f3a8fca18e454b405f in term 1.
I20260809 13:03:34.893280 9029 leader_election.cc:302] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91632a26834d43f3a8fca18e454b405f, a378f6f5259e4da08bc57e1749f81d45; no voters:
I20260809 13:03:34.893630 9375 raft_consensus.cc:2781] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:03:34.894078 9375 raft_consensus.cc:686] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f [term 1 LEADER]: Becoming Leader. State: Replica: 91632a26834d43f3a8fca18e454b405f, State: Running, Role: LEADER
I20260809 13:03:34.894536 9375 consensus_queue.cc:237] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45137 } } peers { permanent_uuid: "91632a26834d43f3a8fca18e454b405f" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44473 } } peers { permanent_uuid: "a378f6f5259e4da08bc57e1749f81d45" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 39059 } }
I20260809 13:03:34.895372 9376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.894800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.28.155.195:57265)
0809 13:03:34.895068 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.895196 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
W20260809 13:03:34.897816 8980 tablet.cc:2369] T e09edca2bfef417db07ee0c0a182ae32 P a378f6f5259e4da08bc57e1749f81d45: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:03:34.898715 8106 catalog_manager.cc:5495] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f reported cstate change: term changed from 0 to 1, leader changed from <none> to 91632a26834d43f3a8fca18e454b405f (127.28.155.195). New cstate: current_term: 1 leader_uuid: "91632a26834d43f3a8fca18e454b405f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91632a26834d43f3a8fca18e454b405f" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a378f6f5259e4da08bc57e1749f81d45" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 39059 } health_report { overall_health: UNKNOWN } } }
I20260809 13:03:34.923074 9359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.917163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35370 (local address 127.28.155.195:44473)
0809 13:03:34.917399 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:34.917407 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:34.917522 (+ 115us) server_negotiation.cc:407] Connection header received
0809 13:03:34.917791 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:34.917796 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:34.917891 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:34.918056 (+ 165us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:03:34.918459 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:34.919197 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:34.920568 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:34.921096 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:34.921237 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:34.921684 (+ 447us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:03:34.922388 (+ 704us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:03:34.922569 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:34.922625 (+ 56us) server_negotiation.cc:299] Negotiation successful
0809 13:03:34.922751 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 13:03:34.927700 8663 raft_consensus.cc:1261] T e09edca2bfef417db07ee0c0a182ae32 P 1ccb3277a9cf4b91bbaaad4d2ed54254 [term 1 FOLLOWER]: Refusing update from remote peer 91632a26834d43f3a8fca18e454b405f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:03:34.927996 8900 raft_consensus.cc:1261] T e09edca2bfef417db07ee0c0a182ae32 P a378f6f5259e4da08bc57e1749f81d45 [term 1 FOLLOWER]: Refusing update from remote peer 91632a26834d43f3a8fca18e454b405f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:03:34.928611 9383 consensus_queue.cc:1035] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ccb3277a9cf4b91bbaaad4d2ed54254" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 45137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:03:34.929023 9375 consensus_queue.cc:1035] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a378f6f5259e4da08bc57e1749f81d45" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 39059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:03:34.931546 9367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.930918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.28.155.193:33715)
0809 13:03:34.931183 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.931294 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144}
I20260809 13:03:34.932703 9379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.932055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.28.155.194:35171)
0809 13:03:34.932285 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.932427 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260809 13:03:34.944826 9386 mvcc.cc:205] Tried to move back new op lower bound from 7316605398735396864 to 7316605398612942848. Current Snapshot: MvccSnapshot[applied={T|T < 7316605398735396864}]
I20260809 13:03:34.946010 9387 mvcc.cc:205] Tried to move back new op lower bound from 7316605398735396864 to 7316605398612942848. Current Snapshot: MvccSnapshot[applied={T|T < 7316605398735396864}]
I20260809 13:03:34.947559 9376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.947008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.28.155.195:48423)
0809 13:03:34.947232 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.947339 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260809 13:03:34.949926 9367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.949308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.28.155.193:46591)
0809 13:03:34.949589 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.949704 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170}
I20260809 13:03:34.954416 9376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.953905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.28.155.195:54523)
0809 13:03:34.954104 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.954213 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260809 13:03:34.956888 9379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.956196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.28.155.194:38951)
0809 13:03:34.956535 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:34.956660 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159}
I20260809 13:03:34.965173 8110 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40916:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:03:34.965525 8110 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40916:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:03:34.972853 8110 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8adab2e3f7e248bd899bb7ad2d3d7bff: Sending DeleteTablet for 3 replicas of tablet e09edca2bfef417db07ee0c0a182ae32
I20260809 13:03:34.974025 8628 tablet_service.cc:1514] Processing DeleteTablet for tablet e09edca2bfef417db07ee0c0a182ae32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:03:34 UTC) from {username='oryx', principal='oryx/127.28.155.253@KRBTEST.COM'} at 127.0.0.1:58262
I20260809 13:03:34.974581 9100 tablet_service.cc:1514] Processing DeleteTablet for tablet e09edca2bfef417db07ee0c0a182ae32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:03:34 UTC) from {username='oryx', principal='oryx/127.28.155.253@KRBTEST.COM'} at 127.0.0.1:35364
I20260809 13:03:34.974717 8866 tablet_service.cc:1514] Processing DeleteTablet for tablet e09edca2bfef417db07ee0c0a182ae32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:03:34 UTC) from {username='oryx', principal='oryx/127.28.155.253@KRBTEST.COM'} at 127.0.0.1:50130
I20260809 13:03:34.975039 9403 tablet_replica.cc:330] T e09edca2bfef417db07ee0c0a182ae32 P 1ccb3277a9cf4b91bbaaad4d2ed54254: stopping tablet replica
I20260809 13:03:34.975327 9403 raft_consensus.cc:2229] T e09edca2bfef417db07ee0c0a182ae32 P 1ccb3277a9cf4b91bbaaad4d2ed54254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:03:34.975831 9403 raft_consensus.cc:2258] T e09edca2bfef417db07ee0c0a182ae32 P 1ccb3277a9cf4b91bbaaad4d2ed54254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:03:34.977689 9403 ts_tablet_manager.cc:1905] T e09edca2bfef417db07ee0c0a182ae32 P 1ccb3277a9cf4b91bbaaad4d2ed54254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:03:34.976447 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 8425
I20260809 13:03:34.987848 9403 ts_tablet_manager.cc:1918] T e09edca2bfef417db07ee0c0a182ae32 P 1ccb3277a9cf4b91bbaaad4d2ed54254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:03:34.988240 9403 log.cc:1196] T e09edca2bfef417db07ee0c0a182ae32 P 1ccb3277a9cf4b91bbaaad4d2ed54254: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-0/wal/wals/e09edca2bfef417db07ee0c0a182ae32
I20260809 13:03:34.988960 9403 ts_tablet_manager.cc:1939] T e09edca2bfef417db07ee0c0a182ae32 P 1ccb3277a9cf4b91bbaaad4d2ed54254: Deleting consensus metadata
I20260809 13:03:34.990908 8084 catalog_manager.cc:4841] TS 1ccb3277a9cf4b91bbaaad4d2ed54254 (127.28.155.193:45137): tablet e09edca2bfef417db07ee0c0a182ae32 (table test-table [id=b9f281ed879a46368c08a26a1d2b1502]) successfully deleted
I20260809 13:03:35.001626 9404 tablet_replica.cc:330] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f: stopping tablet replica
I20260809 13:03:35.001904 9404 raft_consensus.cc:2229] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f [term 1 LEADER]: Raft consensus shutting down.
I20260809 13:03:35.003186 9404 raft_consensus.cc:2258] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:03:35.003901 9405 tablet_replica.cc:330] T e09edca2bfef417db07ee0c0a182ae32 P a378f6f5259e4da08bc57e1749f81d45: stopping tablet replica
I20260809 13:03:35.004155 9405 raft_consensus.cc:2229] T e09edca2bfef417db07ee0c0a182ae32 P a378f6f5259e4da08bc57e1749f81d45 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:03:35.004556 9405 raft_consensus.cc:2258] T e09edca2bfef417db07ee0c0a182ae32 P a378f6f5259e4da08bc57e1749f81d45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:03:35.005752 9404 ts_tablet_manager.cc:1905] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:03:35.006337 9405 ts_tablet_manager.cc:1905] T e09edca2bfef417db07ee0c0a182ae32 P a378f6f5259e4da08bc57e1749f81d45: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:03:35.013640 9405 ts_tablet_manager.cc:1918] T e09edca2bfef417db07ee0c0a182ae32 P a378f6f5259e4da08bc57e1749f81d45: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:03:35.013684 9404 ts_tablet_manager.cc:1918] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:03:35.013836 9405 log.cc:1196] T e09edca2bfef417db07ee0c0a182ae32 P a378f6f5259e4da08bc57e1749f81d45: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-1/wal/wals/e09edca2bfef417db07ee0c0a182ae32
I20260809 13:03:35.013844 9404 log.cc:1196] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786280548611909-29295-0/minicluster-data/ts-2/wal/wals/e09edca2bfef417db07ee0c0a182ae32
I20260809 13:03:35.014374 9405 ts_tablet_manager.cc:1939] T e09edca2bfef417db07ee0c0a182ae32 P a378f6f5259e4da08bc57e1749f81d45: Deleting consensus metadata
I20260809 13:03:35.014401 9404 ts_tablet_manager.cc:1939] T e09edca2bfef417db07ee0c0a182ae32 P 91632a26834d43f3a8fca18e454b405f: Deleting consensus metadata
I20260809 13:03:35.015817 8086 catalog_manager.cc:4841] TS a378f6f5259e4da08bc57e1749f81d45 (127.28.155.194:39059): tablet e09edca2bfef417db07ee0c0a182ae32 (table test-table [id=b9f281ed879a46368c08a26a1d2b1502]) successfully deleted
I20260809 13:03:35.016249 8087 catalog_manager.cc:4841] TS 91632a26834d43f3a8fca18e454b405f (127.28.155.195:44473): tablet e09edca2bfef417db07ee0c0a182ae32 (table test-table [id=b9f281ed879a46368c08a26a1d2b1502]) successfully deleted
I20260809 13:03:35.023442 9358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:34.979607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58264 (local address 127.28.155.193:45137)
0809 13:03:34.979793 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:34.979799 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:35.002397 (+ 22598us) server_negotiation.cc:407] Connection header received
0809 13:03:35.002643 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:35.002651 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:35.002773 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:35.002915 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:35.005641 (+ 2726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:35.006836 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:35.008976 (+ 2140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:35.009645 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:35.009759 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:35.014218 (+ 4459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:35.014244 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:35.014269 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:35.014333 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:35.019916 (+ 5583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:35.020942 (+ 1026us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:35.020953 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:35.020957 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:35.021149 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:35.021607 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:35.021613 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:35.021616 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:35.022158 (+ 542us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:35.022483 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:35.022773 (+ 290us) server_negotiation.cc:299] Negotiation successful
0809 13:03:35.023052 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 13:03:35.024161 8732 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:35.171288 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 8425
I20260809 13:03:35.202450 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 8755
I20260809 13:03:35.217494 9361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:35.203314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50138 (local address 127.28.155.194:39059)
0809 13:03:35.203526 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:35.203533 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:35.203730 (+ 197us) server_negotiation.cc:407] Connection header received
0809 13:03:35.203962 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:35.203967 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:35.204038 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:35.204167 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:35.205678 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:35.206438 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:35.207747 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:35.208180 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:35.208327 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:35.211200 (+ 2873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:35.211219 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:35.211236 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:35.211272 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:35.214398 (+ 3126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:35.215127 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:35.215136 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:35.215138 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:35.215278 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:35.215735 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:35.215740 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:35.215744 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:35.216118 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:35.216469 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:35.216836 (+ 367us) server_negotiation.cc:299] Negotiation successful
0809 13:03:35.217092 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 13:03:35.218321 8967 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:35.241391 9322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:35.240842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.0.0.1:39242)
0809 13:03:35.241067 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:35.241183 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260809 13:03:35.242667 9322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:35.242222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42999 (local address 127.0.0.1:39244)
0809 13:03:35.242416 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:35.242514 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:42999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 13:03:35.352298 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 8755
I20260809 13:03:35.400111 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 8996
I20260809 13:03:35.416886 9359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:35.401181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49496 (local address 127.28.155.195:44473)
0809 13:03:35.401410 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:35.401419 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:35.401444 (+ 25us) server_negotiation.cc:407] Connection header received
0809 13:03:35.401515 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:35.401519 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:35.401607 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:35.401718 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:35.404396 (+ 2678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:35.405343 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:35.406619 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:35.407079 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:35.407223 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:35.410100 (+ 2877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:35.410117 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:35.410137 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:35.410185 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:35.413714 (+ 3529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:35.414464 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:35.414472 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:35.414475 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:35.414645 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:35.415066 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:35.415071 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:35.415082 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:35.415525 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:35.415859 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:35.416217 (+ 358us) server_negotiation.cc:299] Negotiation successful
0809 13:03:35.416511 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 13:03:35.417701 9195 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:35.562328 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 8996
I20260809 13:03:35.595985 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 7884
I20260809 13:03:35.597225 8159 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:35.730732 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 7884
I20260809 13:03:35.761230 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 8049
I20260809 13:03:35.762403 8489 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:35.885254 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 8049
2026-08-09T13:03:35Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (10522 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:03:36 dist-test-slave-jq4t krb5kdc[9417](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:03:36 dist-test-slave-jq4t krb5kdc[9417](info): set up 2 sockets
Aug 09 13:03:36 dist-test-slave-jq4t krb5kdc[9417](info): commencing operation
krb5kdc: starting...
W20260809 13:03:37.223958 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.284s user 0.000s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:03:37 dist-test-slave-jq4t krb5kdc[9417](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280617, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:03:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:03:37Z Disabled control of system clock
WARNING: no policy specified for oryx/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.254.keytab.
Entry for principal oryx/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.254.keytab.
I20260809 13:03:37.514588 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:45637
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.254.keytab
--principal=oryx/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:40173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:45637
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:37.878109 9440 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:37.878479 9440 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:37.878646 9440 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:37.886070 9440 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:03:37.886221 9440 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 13:03:37.886313 9440 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:37.886428 9440 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:37.886512 9440 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:03:37.886620 9440 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:03:37.896965 9440 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:40173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:45637
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.254.keytab
--principal=oryx/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:45637
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:37.898406 9440 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:37.899847 9440 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:37.912784 9446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:37.912732 9449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:37.912779 9447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:37.914000 9440 server_base.cc:1034] running on GCE node
I20260809 13:03:37.914809 9440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:37.916288 9440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:37.917539 9440 hybrid_clock.cc:648] HybridClock initialized: now 1786280617917448 us; error 63 us; skew 500 ppm
I20260809 13:03:37.917882 9440 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:37 dist-test-slave-jq4t krb5kdc[9417](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280617, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:37.921248 9440 init.cc:377] Logged in from keytab as oryx/127.28.155.254@KRBTEST.COM (short username oryx)
I20260809 13:03:37.922725 9440 webserver.cc:460] Webserver started at http://127.28.155.254:44709/ using document root <none> and password file <none>
I20260809 13:03:37.923447 9440 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:37.923585 9440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:37.923925 9440 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:37.927032 9440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "957868b5ea3f4caf803efe9a4e5b30d0"
format_stamp: "Formatted at 2026-08-09 13:03:37 on dist-test-slave-jq4t"
server_key: "81bb29006ad399ed67a89c13946728ed"
server_key_iv: "47cfa0affbbcfb313d9ca4a33a54d73c"
server_key_version: "encryptionkey@0"
I20260809 13:03:37.927943 9440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "957868b5ea3f4caf803efe9a4e5b30d0"
format_stamp: "Formatted at 2026-08-09 13:03:37 on dist-test-slave-jq4t"
server_key: "81bb29006ad399ed67a89c13946728ed"
server_key_iv: "47cfa0affbbcfb313d9ca4a33a54d73c"
server_key_version: "encryptionkey@0"
I20260809 13:03:37.933189 9440 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260809 13:03:37.936771 9462 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:37.938045 9440 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 13:03:37.938234 9440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "957868b5ea3f4caf803efe9a4e5b30d0"
format_stamp: "Formatted at 2026-08-09 13:03:37 on dist-test-slave-jq4t"
server_key: "81bb29006ad399ed67a89c13946728ed"
server_key_iv: "47cfa0affbbcfb313d9ca4a33a54d73c"
server_key_version: "encryptionkey@0"
I20260809 13:03:37.938467 9440 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:37.963263 9440 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:37.967772 9440 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:37.968076 9440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:37.992039 9440 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:45637
I20260809 13:03:37.992092 9555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:45637 every 8 connection(s)
I20260809 13:03:37.993542 9440 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:03:37.994175 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 9440
I20260809 13:03:37.994413 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:03:37.995293 29295 external_mini_cluster.cc:1428] Setting key ab91032a40f9b3c74d82b639be4d02c7
I20260809 13:03:37.998373 9560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 13:03:38 dist-test-slave-jq4t krb5kdc[9417](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280617, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM
I20260809 13:03:38.012758 9560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 957868b5ea3f4caf803efe9a4e5b30d0: Bootstrap starting.
I20260809 13:03:38.016732 9560 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 957868b5ea3f4caf803efe9a4e5b30d0: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:38.017966 9560 log.cc:824] T 00000000000000000000000000000000 P 957868b5ea3f4caf803efe9a4e5b30d0: Log is configured to *not* fsync() on all Append() calls
I20260809 13:03:38.020601 9566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:37.997422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55054 (local address 127.28.155.254:45637)
0809 13:03:37.998267 (+ 845us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:37.998280 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:37.998321 (+ 41us) server_negotiation.cc:407] Connection header received
0809 13:03:38.000099 (+ 1778us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:38.000122 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:38.000578 (+ 456us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:38.000920 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:38.002909 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:38.004325 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:38.006216 (+ 1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:38.006921 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:38.007070 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:38.012068 (+ 4998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:38.012076 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:38.012093 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:38.012136 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:38.015484 (+ 3348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:38.016322 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:38.016330 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:38.016337 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:38.016585 (+ 248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:38.017085 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:38.017089 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:38.017091 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:38.017705 (+ 614us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:38.018054 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:38.018566 (+ 512us) server_negotiation.cc:299] Negotiation successful
0809 13:03:38.019105 (+ 539us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":637,"thread_start_us":410,"threads_started":1}
I20260809 13:03:38.021953 9560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 957868b5ea3f4caf803efe9a4e5b30d0: No bootstrap required, opened a new log
I20260809 13:03:38.030085 9560 raft_consensus.cc:348] T 00000000000000000000000000000000 P 957868b5ea3f4caf803efe9a4e5b30d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "957868b5ea3f4caf803efe9a4e5b30d0" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 45637 } }
I20260809 13:03:38.030472 9560 raft_consensus.cc:374] T 00000000000000000000000000000000 P 957868b5ea3f4caf803efe9a4e5b30d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:38.030555 9560 raft_consensus.cc:729] T 00000000000000000000000000000000 P 957868b5ea3f4caf803efe9a4e5b30d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 957868b5ea3f4caf803efe9a4e5b30d0, State: Initialized, Role: FOLLOWER
I20260809 13:03:38.031088 9560 consensus_queue.cc:260] T 00000000000000000000000000000000 P 957868b5ea3f4caf803efe9a4e5b30d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "957868b5ea3f4caf803efe9a4e5b30d0" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 45637 } }
I20260809 13:03:38.031304 9560 raft_consensus.cc:388] T 00000000000000000000000000000000 P 957868b5ea3f4caf803efe9a4e5b30d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:03:38.031409 9560 raft_consensus.cc:482] T 00000000000000000000000000000000 P 957868b5ea3f4caf803efe9a4e5b30d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:03:38.031576 9560 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 957868b5ea3f4caf803efe9a4e5b30d0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:38.034147 9560 raft_consensus.cc:504] T 00000000000000000000000000000000 P 957868b5ea3f4caf803efe9a4e5b30d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "957868b5ea3f4caf803efe9a4e5b30d0" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 45637 } }
I20260809 13:03:38.034623 9560 leader_election.cc:302] T 00000000000000000000000000000000 P 957868b5ea3f4caf803efe9a4e5b30d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 957868b5ea3f4caf803efe9a4e5b30d0; no voters:
I20260809 13:03:38.035187 9560 leader_election.cc:288] T 00000000000000000000000000000000 P 957868b5ea3f4caf803efe9a4e5b30d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:03:38.035353 9568 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 957868b5ea3f4caf803efe9a4e5b30d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:03:38.036130 9568 raft_consensus.cc:686] T 00000000000000000000000000000000 P 957868b5ea3f4caf803efe9a4e5b30d0 [term 1 LEADER]: Becoming Leader. State: Replica: 957868b5ea3f4caf803efe9a4e5b30d0, State: Running, Role: LEADER
I20260809 13:03:38.036814 9568 consensus_queue.cc:237] T 00000000000000000000000000000000 P 957868b5ea3f4caf803efe9a4e5b30d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "957868b5ea3f4caf803efe9a4e5b30d0" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 45637 } }
I20260809 13:03:38.037549 9560 sys_catalog.cc:564] T 00000000000000000000000000000000 P 957868b5ea3f4caf803efe9a4e5b30d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:03:38.040050 9570 sys_catalog.cc:455] T 00000000000000000000000000000000 P 957868b5ea3f4caf803efe9a4e5b30d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 957868b5ea3f4caf803efe9a4e5b30d0. Latest consensus state: current_term: 1 leader_uuid: "957868b5ea3f4caf803efe9a4e5b30d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "957868b5ea3f4caf803efe9a4e5b30d0" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 45637 } } }
I20260809 13:03:38.040582 9570 sys_catalog.cc:458] T 00000000000000000000000000000000 P 957868b5ea3f4caf803efe9a4e5b30d0 [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:38.041831 9569 sys_catalog.cc:455] T 00000000000000000000000000000000 P 957868b5ea3f4caf803efe9a4e5b30d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "957868b5ea3f4caf803efe9a4e5b30d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "957868b5ea3f4caf803efe9a4e5b30d0" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 45637 } } }
I20260809 13:03:38.042294 9569 sys_catalog.cc:458] T 00000000000000000000000000000000 P 957868b5ea3f4caf803efe9a4e5b30d0 [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:38.043474 9579 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:03:38.049521 9579 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:03:38.059207 9579 catalog_manager.cc:1347] Generated new cluster ID: 9c950a17f9074564a8d038977b3702b1
I20260809 13:03:38.059356 9579 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:03:38.097043 9579 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:03:38.099072 9579 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:03:38.112694 9579 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 957868b5ea3f4caf803efe9a4e5b30d0: Generated new TSK 0
I20260809 13:03:38.113782 9579 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.28.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.193.keytab.
Entry for principal oryx/127.28.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.193.keytab.
I20260809 13:03:38.182767 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:0
--local_ip_for_outbound_sockets=127.28.155.193
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:45637
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.193.keytab
--principal=oryx/127.28.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:40173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:38.555276 9597 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:38.555573 9597 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:38.555745 9597 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:38.563369 9597 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:38.563496 9597 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:38.563653 9597 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 13:03:38.563782 9597 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:03:38.574146 9597 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:40173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.193.keytab
--principal=oryx/127.28.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.28.155.254:45637
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:38.575582 9597 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:38.577096 9597 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:38.591536 9604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:38.591477 9610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:38.591598 9607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:38.592276 9597 server_base.cc:1034] running on GCE node
I20260809 13:03:38.593012 9597 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:38.593977 9597 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:38.595206 9597 hybrid_clock.cc:648] HybridClock initialized: now 1786280618595135 us; error 35 us; skew 500 ppm
I20260809 13:03:38.595532 9597 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:38 dist-test-slave-jq4t krb5kdc[9417](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280618, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:38.603880 9597 init.cc:377] Logged in from keytab as oryx/127.28.155.193@KRBTEST.COM (short username oryx)
I20260809 13:03:38.605724 9597 webserver.cc:460] Webserver started at http://127.28.155.193:42667/ using document root <none> and password file <none>
I20260809 13:03:38.606549 9597 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:38.606691 9597 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:38.607062 9597 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:38.610417 9597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-0/data/instance:
uuid: "93e0f5c2800a4e7cb522c56114b61324"
format_stamp: "Formatted at 2026-08-09 13:03:38 on dist-test-slave-jq4t"
server_key: "fdc1b182ec6a7e48aab8afd0277995cd"
server_key_iv: "456c319e618215922a5e4748d346ef6d"
server_key_version: "encryptionkey@0"
I20260809 13:03:38.611356 9597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance:
uuid: "93e0f5c2800a4e7cb522c56114b61324"
format_stamp: "Formatted at 2026-08-09 13:03:38 on dist-test-slave-jq4t"
server_key: "fdc1b182ec6a7e48aab8afd0277995cd"
server_key_iv: "456c319e618215922a5e4748d346ef6d"
server_key_version: "encryptionkey@0"
I20260809 13:03:38.617669 9597 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260809 13:03:38.621755 9630 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:38.623363 9597 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260809 13:03:38.623602 9597 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "93e0f5c2800a4e7cb522c56114b61324"
format_stamp: "Formatted at 2026-08-09 13:03:38 on dist-test-slave-jq4t"
server_key: "fdc1b182ec6a7e48aab8afd0277995cd"
server_key_iv: "456c319e618215922a5e4748d346ef6d"
server_key_version: "encryptionkey@0"
I20260809 13:03:38.623910 9597 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:38.643703 9597 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:38.648558 9597 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:38.648886 9597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:38.651917 9597 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:03:38.652070 9597 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:38.652215 9597 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:03:38.652302 9597 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 13:03:38 dist-test-slave-jq4t krb5kdc[9417](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280618, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM
I20260809 13:03:38.681111 9642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:38.652344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:43873 (local address 127.28.155.254:45637)
0809 13:03:38.653004 (+ 660us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:38.653011 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:38.654253 (+ 1242us) server_negotiation.cc:407] Connection header received
0809 13:03:38.657660 (+ 3407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:38.657668 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:38.657790 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:38.657952 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:38.661025 (+ 3073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:38.662102 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:38.665854 (+ 3752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:38.666409 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:38.666618 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:38.673743 (+ 7125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:38.673753 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:38.673760 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:38.673824 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:38.677501 (+ 3677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:38.678409 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:38.678414 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:38.678416 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:38.678556 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:38.679088 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:38.679092 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:38.679094 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:38.679391 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:38.679564 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:38.680412 (+ 848us) server_negotiation.cc:299] Negotiation successful
0809 13:03:38.680700 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":496,"thread_start_us":325,"threads_started":1}
I20260809 13:03:38.682978 9644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:38.653051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:45637 (local address 127.28.155.193:43873)
0809 13:03:38.654021 (+ 970us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:38.654093 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:38.657211 (+ 3118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:38.658314 (+ 1103us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:38.658327 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:38.659455 (+ 1128us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:38.660695 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:38.660744 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:38.662356 (+ 1612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:38.662366 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:38.665619 (+ 3253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:38.665642 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:38.667062 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:38.667070 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:38.667513 (+ 443us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:38.668572 (+ 1059us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:38.669308 (+ 736us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:38.673381 (+ 4073us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:38.677697 (+ 4316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:38.677711 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:38.677739 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:38.678233 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:38.678691 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:38.678697 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:38.678701 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:38.678943 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:38.679536 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:38.679546 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:38.679986 (+ 440us) client_negotiation.cc:769] Sending connection context
0809 13:03:38.680275 (+ 289us) client_negotiation.cc:240] Negotiation successful
0809 13:03:38.680978 (+ 703us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":634,"thread_start_us":357,"threads_started":1}
I20260809 13:03:38.708606 9597 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:42147
I20260809 13:03:38.708645 9817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:42147 every 8 connection(s)
I20260809 13:03:38.709566 9642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:38.690172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:37821 (local address 127.28.155.254:45637)
0809 13:03:38.690402 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:38.690410 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:38.691281 (+ 871us) server_negotiation.cc:407] Connection header received
0809 13:03:38.691498 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:38.691502 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:38.691590 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:38.691683 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:38.693557 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:38.694837 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:38.697541 (+ 2704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:38.698401 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:38.698558 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:38.701798 (+ 3240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:38.701807 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:38.701814 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:38.701870 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:38.706158 (+ 4288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:38.706961 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:38.706967 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:38.706971 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:38.707125 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:38.707626 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:38.707631 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:38.707634 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:38.708136 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:38.708332 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:38.708894 (+ 562us) server_negotiation.cc:299] Negotiation successful
0809 13:03:38.709170 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 13:03:38.709678 9768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:38.690273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:45637 (local address 127.28.155.193:37821)
0809 13:03:38.691109 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:38.691137 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:38.691355 (+ 218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:38.691764 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:38.691771 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:38.692675 (+ 904us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:38.693337 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:38.693355 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:38.695008 (+ 1653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:38.695017 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:38.697264 (+ 2247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:38.697291 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:38.698853 (+ 1562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:38.698862 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:38.699061 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:38.699832 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:38.699866 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:38.701537 (+ 1671us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:38.706332 (+ 4795us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:38.706339 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:38.706343 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:38.706807 (+ 464us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:38.707255 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:38.707271 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:38.707273 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:38.707442 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:38.708285 (+ 843us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:38.708290 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:38.708596 (+ 306us) client_negotiation.cc:769] Sending connection context
0809 13:03:38.708755 (+ 159us) client_negotiation.cc:240] Negotiation successful
0809 13:03:38.709205 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":416,"threads_started":1}
I20260809 13:03:38.710417 9597 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:03:38.713201 9818 heartbeater.cc:347] Connected to a master server at 127.28.155.254:45637
I20260809 13:03:38.713516 9818 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:38.714385 9818 heartbeater.cc:511] Master 127.28.155.254:45637 requested a full tablet report, sending...
I20260809 13:03:38.715582 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 9597
I20260809 13:03:38.715833 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance
I20260809 13:03:38.716589 29295 external_mini_cluster.cc:1428] Setting key d7eb9ba8c6405462809285fa0d53bfe7
I20260809 13:03:38.716792 9491 ts_manager.cc:194] Registered new tserver with Master: 93e0f5c2800a4e7cb522c56114b61324 (127.28.155.193:42147)
I20260809 13:03:38.718473 9491 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.28.155.193@KRBTEST.COM'} at 127.28.155.193:43873
WARNING: no policy specified for oryx/127.28.155.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.194.keytab.
Entry for principal oryx/127.28.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.194.keytab.
I20260809 13:03:38.777933 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:0
--local_ip_for_outbound_sockets=127.28.155.194
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:45637
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.194.keytab
--principal=oryx/127.28.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:40173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:39.136094 9822 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:39.136391 9822 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:39.136551 9822 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:39.144379 9822 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:39.144578 9822 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:39.144719 9822 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 13:03:39.144865 9822 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:03:39.155107 9822 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:40173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.194.keytab
--principal=oryx/127.28.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.28.155.254:45637
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:39.156497 9822 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:39.157823 9822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:39.171192 9828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:39.171103 9829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:39.171135 9832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:39.172087 9822 server_base.cc:1034] running on GCE node
I20260809 13:03:39.172813 9822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:39.173749 9822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:39.175027 9822 hybrid_clock.cc:648] HybridClock initialized: now 1786280619174940 us; error 63 us; skew 500 ppm
I20260809 13:03:39.175444 9822 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:39 dist-test-slave-jq4t krb5kdc[9417](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280619, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:39.178835 9822 init.cc:377] Logged in from keytab as oryx/127.28.155.194@KRBTEST.COM (short username oryx)
I20260809 13:03:39.180435 9822 webserver.cc:460] Webserver started at http://127.28.155.194:44789/ using document root <none> and password file <none>
I20260809 13:03:39.181288 9822 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:39.181430 9822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:39.181784 9822 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:39.185217 9822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-1/data/instance:
uuid: "22b5a2b099ae474b93f8e215f4028dd9"
format_stamp: "Formatted at 2026-08-09 13:03:39 on dist-test-slave-jq4t"
server_key: "4996cd8a8e5f93d42f2aecc45a1f17e2"
server_key_iv: "f87d9cb25a8dbae215c2163506f5ed25"
server_key_version: "encryptionkey@0"
I20260809 13:03:39.186362 9822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance:
uuid: "22b5a2b099ae474b93f8e215f4028dd9"
format_stamp: "Formatted at 2026-08-09 13:03:39 on dist-test-slave-jq4t"
server_key: "4996cd8a8e5f93d42f2aecc45a1f17e2"
server_key_iv: "f87d9cb25a8dbae215c2163506f5ed25"
server_key_version: "encryptionkey@0"
I20260809 13:03:39.191974 9822 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 13:03:39.195806 9843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:39.197388 9822 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 13:03:39.197588 9822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "22b5a2b099ae474b93f8e215f4028dd9"
format_stamp: "Formatted at 2026-08-09 13:03:39 on dist-test-slave-jq4t"
server_key: "4996cd8a8e5f93d42f2aecc45a1f17e2"
server_key_iv: "f87d9cb25a8dbae215c2163506f5ed25"
server_key_version: "encryptionkey@0"
I20260809 13:03:39.197837 9822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:39.224634 9822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:39.229200 9822 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:39.229517 9822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:39.232441 9822 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:03:39.232615 9822 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260809 13:03:39.232785 9822 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:03:39.232872 9822 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 13:03:39 dist-test-slave-jq4t krb5kdc[9417](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280619, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM
I20260809 13:03:39.260885 9857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:39.233323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:35085 (local address 127.28.155.254:45637)
0809 13:03:39.233922 (+ 599us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:39.233930 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:39.235195 (+ 1265us) server_negotiation.cc:407] Connection header received
0809 13:03:39.238336 (+ 3141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:39.238342 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:39.238438 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:39.238560 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:39.241680 (+ 3120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:39.242889 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:39.245802 (+ 2913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:39.246390 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:39.246538 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:39.251773 (+ 5235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:39.251783 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:39.251790 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:39.251848 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:39.256532 (+ 4684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:39.257657 (+ 1125us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:39.257666 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:39.257673 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:39.257880 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:39.258396 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:39.258404 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:39.258410 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:39.258907 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:39.259119 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:39.259900 (+ 781us) server_negotiation.cc:299] Negotiation successful
0809 13:03:39.260257 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":332,"threads_started":1}
I20260809 13:03:39.261808 9858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:39.234030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:45637 (local address 127.28.155.194:35085)
0809 13:03:39.234995 (+ 965us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:39.235047 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:39.237893 (+ 2846us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:39.239074 (+ 1181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:39.239086 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:39.240193 (+ 1107us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:39.241480 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:39.241513 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:39.243082 (+ 1569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:39.243090 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:39.245604 (+ 2514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:39.245631 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:39.246682 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:39.246691 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:39.246940 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:39.247794 (+ 854us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:39.247820 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:39.251408 (+ 3588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:39.256705 (+ 5297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:39.256719 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:39.256742 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:39.257483 (+ 741us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:39.258024 (+ 541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:39.258027 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:39.258029 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:39.258258 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:39.259079 (+ 821us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:39.259085 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:39.259471 (+ 386us) client_negotiation.cc:769] Sending connection context
0809 13:03:39.259729 (+ 258us) client_negotiation.cc:240] Negotiation successful
0809 13:03:39.260182 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":669,"thread_start_us":418,"threads_started":1}
I20260809 13:03:39.285904 9822 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:36975
I20260809 13:03:39.285938 10025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:36975 every 8 connection(s)
I20260809 13:03:39.286388 9857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:39.269874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:37871 (local address 127.28.155.254:45637)
0809 13:03:39.270060 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:39.270064 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:39.270359 (+ 295us) server_negotiation.cc:407] Connection header received
0809 13:03:39.270645 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:39.270652 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:39.270755 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:39.270892 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:39.272312 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:39.273424 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:39.275115 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:39.275516 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:39.275693 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:39.278789 (+ 3096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:39.278798 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:39.278804 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:39.278856 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:39.282320 (+ 3464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:39.283039 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:39.283047 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:39.283050 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:39.283185 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:39.283590 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:39.283597 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:39.283600 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:39.284128 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:39.284280 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:39.285704 (+ 1424us) server_negotiation.cc:299] Negotiation successful
0809 13:03:39.285946 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 13:03:39.286656 9981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:39.269512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:45637 (local address 127.28.155.194:37871)
0809 13:03:39.270235 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:39.270260 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:39.270454 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:39.270933 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:39.270938 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:39.271547 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:39.272089 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:39.272110 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:39.273583 (+ 1473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:39.273588 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:39.274953 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:39.274966 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:39.275973 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:39.275977 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:39.276118 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:39.277095 (+ 977us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:39.277123 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:39.278500 (+ 1377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:39.282467 (+ 3967us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:39.282473 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:39.282477 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:39.282909 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:39.283307 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:39.283312 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:39.283316 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:39.283471 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:39.284363 (+ 892us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:39.284368 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:39.285367 (+ 999us) client_negotiation.cc:769] Sending connection context
0809 13:03:39.285606 (+ 239us) client_negotiation.cc:240] Negotiation successful
0809 13:03:39.286017 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":428,"threads_started":1}
I20260809 13:03:39.287669 9822 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:03:39.288465 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 9822
I20260809 13:03:39.288733 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance
I20260809 13:03:39.289430 29295 external_mini_cluster.cc:1428] Setting key 63bce7a0a475b9fe0500c6ee70353dc8
I20260809 13:03:39.290728 10026 heartbeater.cc:347] Connected to a master server at 127.28.155.254:45637
I20260809 13:03:39.291448 10026 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:39.292157 10026 heartbeater.cc:511] Master 127.28.155.254:45637 requested a full tablet report, sending...
I20260809 13:03:39.293848 9491 ts_manager.cc:194] Registered new tserver with Master: 22b5a2b099ae474b93f8e215f4028dd9 (127.28.155.194:36975)
I20260809 13:03:39.295118 9491 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.28.155.194@KRBTEST.COM'} at 127.28.155.194:35085
WARNING: no policy specified for oryx/127.28.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.195.keytab.
Entry for principal oryx/127.28.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.195.keytab.
I20260809 13:03:39.352562 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:0
--local_ip_for_outbound_sockets=127.28.155.195
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:45637
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.195.keytab
--principal=oryx/127.28.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:40173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:39.716876 10035 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:39.717166 10035 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:39.717269 10035 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 13:03:39.722379 9818 heartbeater.cc:503] Master 127.28.155.254:45637 was elected leader, sending a full tablet report...
W20260809 13:03:39.725636 10035 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:39.725761 10035 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:39.725857 10035 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 13:03:39.725943 10035 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:03:39.736393 10035 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:40173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.195.keytab
--principal=oryx/127.28.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.28.155.254:45637
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:39.737955 10035 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:39.739589 10035 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:39.754276 10042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:39.754252 10049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:39.754216 10045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:39.755541 10035 server_base.cc:1034] running on GCE node
I20260809 13:03:39.756377 10035 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:39.757524 10035 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:39.758778 10035 hybrid_clock.cc:648] HybridClock initialized: now 1786280619758708 us; error 42 us; skew 500 ppm
I20260809 13:03:39.759133 10035 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:39 dist-test-slave-jq4t krb5kdc[9417](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280619, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:39.762842 10035 init.cc:377] Logged in from keytab as oryx/127.28.155.195@KRBTEST.COM (short username oryx)
I20260809 13:03:39.764672 10035 webserver.cc:460] Webserver started at http://127.28.155.195:40945/ using document root <none> and password file <none>
I20260809 13:03:39.765511 10035 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:39.765666 10035 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:39.766024 10035 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:39.769531 10035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-2/data/instance:
uuid: "69cc3e329c5643e5997919f5a3342b19"
format_stamp: "Formatted at 2026-08-09 13:03:39 on dist-test-slave-jq4t"
server_key: "07642ccc351933ef88f41baf265b599e"
server_key_iv: "b865119fbee9bb6066b8922b28c75669"
server_key_version: "encryptionkey@0"
I20260809 13:03:39.770458 10035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance:
uuid: "69cc3e329c5643e5997919f5a3342b19"
format_stamp: "Formatted at 2026-08-09 13:03:39 on dist-test-slave-jq4t"
server_key: "07642ccc351933ef88f41baf265b599e"
server_key_iv: "b865119fbee9bb6066b8922b28c75669"
server_key_version: "encryptionkey@0"
I20260809 13:03:39.776324 10035 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260809 13:03:39.780663 10058 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:39.782208 10035 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:03:39.782413 10035 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "69cc3e329c5643e5997919f5a3342b19"
format_stamp: "Formatted at 2026-08-09 13:03:39 on dist-test-slave-jq4t"
server_key: "07642ccc351933ef88f41baf265b599e"
server_key_iv: "b865119fbee9bb6066b8922b28c75669"
server_key_version: "encryptionkey@0"
I20260809 13:03:39.782673 10035 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:39.824692 10035 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:39.830147 10035 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:39.830492 10035 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:39.833762 10035 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:03:39.833904 10035 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:39.834112 10035 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:03:39.834198 10035 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 13:03:39 dist-test-slave-jq4t krb5kdc[9417](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280619, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM
I20260809 13:03:39.862916 10079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:39.834847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:45637 (local address 127.28.155.195:46539)
0809 13:03:39.835786 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:39.835851 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:39.838121 (+ 2270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:39.839099 (+ 978us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:39.839112 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:39.839925 (+ 813us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:39.840997 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:39.841032 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:39.842692 (+ 1660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:39.842700 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:39.845733 (+ 3033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:39.845757 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:39.846889 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:39.846900 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:39.847291 (+ 391us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:39.848224 (+ 933us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:39.848268 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:39.852190 (+ 3922us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:39.857264 (+ 5074us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:39.857276 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:39.857303 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:39.858016 (+ 713us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:39.858577 (+ 561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:39.858584 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:39.858589 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:39.858924 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:39.859663 (+ 739us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:39.859672 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:39.860090 (+ 418us) client_negotiation.cc:769] Sending connection context
0809 13:03:39.860533 (+ 443us) client_negotiation.cc:240] Negotiation successful
0809 13:03:39.861225 (+ 692us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"thread_start_us":423,"threads_started":1}
I20260809 13:03:39.864372 10076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:39.834146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:46539 (local address 127.28.155.254:45637)
0809 13:03:39.834634 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:39.834640 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:39.835997 (+ 1357us) server_negotiation.cc:407] Connection header received
0809 13:03:39.838483 (+ 2486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:39.838492 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:39.838658 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:39.838796 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:39.841294 (+ 2498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:39.842439 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:39.846019 (+ 3580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:39.846587 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:39.846748 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:39.852559 (+ 5811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:39.852571 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:39.852578 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:39.852627 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:39.857079 (+ 4452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:39.858240 (+ 1161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:39.858244 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:39.858247 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:39.858392 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:39.859069 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:39.859076 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:39.859079 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:39.859521 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:39.859688 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:39.863592 (+ 3904us) server_negotiation.cc:299] Negotiation successful
0809 13:03:39.863908 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":232,"threads_started":1}
I20260809 13:03:39.883469 10242 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:44333 every 8 connection(s)
I20260809 13:03:39.883502 10035 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:44333
I20260809 13:03:39.885721 10035 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:03:39.888415 10243 heartbeater.cc:347] Connected to a master server at 127.28.155.254:45637
I20260809 13:03:39.888739 10243 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:39.889427 10076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:39.871922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:35993 (local address 127.28.155.254:45637)
0809 13:03:39.872172 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:39.872182 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:39.873127 (+ 945us) server_negotiation.cc:407] Connection header received
0809 13:03:39.873405 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:39.873411 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:39.873498 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:39.873609 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:39.874615 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:39.875682 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:39.877455 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:39.878082 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:39.878245 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:39.881422 (+ 3177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:39.881427 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:39.881430 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:39.881466 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:39.885591 (+ 4125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:39.886920 (+ 1329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:39.886928 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:39.886934 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:39.887141 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:39.887663 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:39.887668 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:39.887672 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:39.888055 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:39.888230 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:39.888758 (+ 528us) server_negotiation.cc:299] Negotiation successful
0809 13:03:39.889028 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 13:03:39.889545 10209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:39.871899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:45637 (local address 127.28.155.195:35993)
0809 13:03:39.872966 (+ 1067us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:39.873003 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:39.873203 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:39.873650 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:39.873656 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:39.874158 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:39.874458 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:39.874468 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:39.875833 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:39.875839 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:39.877301 (+ 1462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:39.877317 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:39.878370 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:39.878382 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:39.878725 (+ 343us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:39.879671 (+ 946us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:39.879704 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:39.881203 (+ 1499us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:39.885752 (+ 4549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:39.885756 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:39.885759 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:39.886682 (+ 923us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:39.887305 (+ 623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:39.887312 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:39.887315 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:39.887510 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:39.888179 (+ 669us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:39.888183 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:39.888448 (+ 265us) client_negotiation.cc:769] Sending connection context
0809 13:03:39.888642 (+ 194us) client_negotiation.cc:240] Negotiation successful
0809 13:03:39.889020 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":902,"thread_start_us":735,"threads_started":1}
I20260809 13:03:39.889703 10243 heartbeater.cc:511] Master 127.28.155.254:45637 requested a full tablet report, sending...
I20260809 13:03:39.891425 9491 ts_manager.cc:194] Registered new tserver with Master: 69cc3e329c5643e5997919f5a3342b19 (127.28.155.195:44333)
I20260809 13:03:39.892525 9491 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.28.155.195@KRBTEST.COM'} at 127.28.155.195:46539
I20260809 13:03:39.893484 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 10035
I20260809 13:03:39.893679 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance
I20260809 13:03:39.894145 29295 external_mini_cluster.cc:1428] Setting key 2d4e06e61f3319c5a2de31850c7173b4
I20260809 13:03:39.897318 29295 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 13:03:39 dist-test-slave-jq4t krb5kdc[9417](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280619, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 13:03:39 dist-test-slave-jq4t krb5kdc[9417](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:39 dist-test-slave-jq4t krb5kdc[9417](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
W20260809 13:03:39.963043 10076 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:39.951020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55062 (local address 127.28.155.254:45637)
0809 13:03:39.951298 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:39.951305 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:39.951627 (+ 322us) server_negotiation.cc:407] Connection header received
0809 13:03:39.951883 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:39.951887 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:39.951962 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:39.952081 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:39.953660 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:39.954431 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:39.955727 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:39.956183 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:39.956333 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:39.962638 (+ 6305us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55062: BlockingRecv error: recv got EOF from 127.0.0.1:55062 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
Aug 09 13:03:39 dist-test-slave-jq4t krb5kdc[9417](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280619, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM
I20260809 13:03:39.981930 10076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:39.966652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55074 (local address 127.28.155.254:45637)
0809 13:03:39.966877 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:39.966887 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:39.967297 (+ 410us) server_negotiation.cc:407] Connection header received
0809 13:03:39.967528 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:39.967534 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:39.967634 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:39.967748 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:39.969073 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:39.969850 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:39.971197 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:39.971662 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:39.971809 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:39.975998 (+ 4189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:39.976004 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:39.976008 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:39.976050 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:39.978803 (+ 2753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:39.979609 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:39.979622 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:39.979625 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:39.979772 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:39.980218 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:39.980225 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:39.980233 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:39.980631 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:39.980967 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:39.981314 (+ 347us) server_negotiation.cc:299] Negotiation successful
0809 13:03:39.981591 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 13:03:39.986919 9491 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55074:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 13:03:39.995685 9491 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:03:40.022500 10264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:40.010518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:42147 (local address 127.0.0.1:40452)
0809 13:03:40.012215 (+ 1697us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:40.012267 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:40.012620 (+ 353us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:40.014267 (+ 1647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:40.014274 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:40.014304 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:03:40.014765 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:40.014784 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.016790 (+ 2006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.016795 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:40.019269 (+ 2474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:40.019291 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.021322 (+ 2031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.021327 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:40.021516 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:40.021627 (+ 111us) client_negotiation.cc:769] Sending connection context
0809 13:03:40.021771 (+ 144us) client_negotiation.cc:240] Negotiation successful
0809 13:03:40.022003 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1305,"mutex_wait_us":25,"thread_start_us":1097,"threads_started":1}
I20260809 13:03:40.023360 10265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:40.010736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40452 (local address 127.28.155.193:42147)
0809 13:03:40.011401 (+ 665us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:40.011411 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:40.012401 (+ 990us) server_negotiation.cc:407] Connection header received
0809 13:03:40.012923 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:40.012933 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:40.013193 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:40.013319 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:03:40.014934 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.016584 (+ 1650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.019466 (+ 2882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.021118 (+ 1652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.021314 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:40.021520 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:40.022790 (+ 1270us) server_negotiation.cc:299] Negotiation successful
0809 13:03:40.023004 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":475,"thread_start_us":1384,"threads_started":1}
I20260809 13:03:40.023752 10266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:40.011316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:36975 (local address 127.0.0.1:49318)
0809 13:03:40.012831 (+ 1515us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:40.012849 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:40.012950 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:40.016006 (+ 3056us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:40.016012 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:40.016038 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:03:40.016407 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:40.016417 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.018576 (+ 2159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.018582 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:40.021014 (+ 2432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:40.021030 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.022813 (+ 1783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.022819 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:40.023030 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:40.023071 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 13:03:40.023141 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 13:03:40.023282 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1377,"mutex_wait_us":52,"thread_start_us":1214,"threads_started":1}
I20260809 13:03:40.023882 10269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:40.013478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:44333 (local address 127.0.0.1:41498)
0809 13:03:40.015779 (+ 2301us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:40.015794 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:40.015948 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:40.016521 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:40.016526 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:40.016554 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:03:40.017011 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:40.017025 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.019096 (+ 2071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.019103 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:40.020854 (+ 1751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:40.020868 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.023062 (+ 2194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.023068 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:40.023231 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:40.023259 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 13:03:40.023316 (+ 57us) client_negotiation.cc:240] Negotiation successful
0809 13:03:40.023444 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2196,"mutex_wait_us":48,"thread_start_us":2056,"threads_started":1}
I20260809 13:03:40.024943 10267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:40.011953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49318 (local address 127.28.155.194:36975)
0809 13:03:40.015378 (+ 3425us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:40.015388 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:40.015419 (+ 31us) server_negotiation.cc:407] Connection header received
0809 13:03:40.015516 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:40.015523 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:40.015774 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:40.016653 (+ 879us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:03:40.016891 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.018381 (+ 1490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.021212 (+ 2831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.022580 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.024181 (+ 1601us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:40.024342 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:40.024414 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 13:03:40.024623 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3254,"thread_start_us":3124,"threads_started":1}
I20260809 13:03:40.024972 10268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:40.013051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41498 (local address 127.28.155.195:44333)
0809 13:03:40.013928 (+ 877us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:40.013937 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:40.015913 (+ 1976us) server_negotiation.cc:407] Connection header received
0809 13:03:40.016133 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:40.016138 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:40.016308 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:40.016522 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:03:40.017252 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.018929 (+ 1677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.021021 (+ 2092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.022577 (+ 1556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.024148 (+ 1571us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:40.024342 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:40.024415 (+ 73us) server_negotiation.cc:299] Negotiation successful
0809 13:03:40.024623 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":681,"thread_start_us":576,"threads_started":1}
I20260809 13:03:40.027748 9715 tablet_service.cc:1467] Processing CreateTablet for tablet 054de37cbb3749d4bba5f419df15d1ad (DEFAULT_TABLE table=test-table [id=237c61146c3848a789709d80885078f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:03:40.028651 9916 tablet_service.cc:1467] Processing CreateTablet for tablet 054de37cbb3749d4bba5f419df15d1ad (DEFAULT_TABLE table=test-table [id=237c61146c3848a789709d80885078f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:03:40.029561 9715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 054de37cbb3749d4bba5f419df15d1ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:40.029717 10134 tablet_service.cc:1467] Processing CreateTablet for tablet 054de37cbb3749d4bba5f419df15d1ad (DEFAULT_TABLE table=test-table [id=237c61146c3848a789709d80885078f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:03:40.030172 9916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 054de37cbb3749d4bba5f419df15d1ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:40.030891 10134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 054de37cbb3749d4bba5f419df15d1ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:40.043601 10271 tablet_bootstrap.cc:492] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19: Bootstrap starting.
I20260809 13:03:40.045375 10272 tablet_bootstrap.cc:492] T 054de37cbb3749d4bba5f419df15d1ad P 22b5a2b099ae474b93f8e215f4028dd9: Bootstrap starting.
I20260809 13:03:40.048048 10271 tablet_bootstrap.cc:654] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:40.049064 10272 tablet_bootstrap.cc:654] T 054de37cbb3749d4bba5f419df15d1ad P 22b5a2b099ae474b93f8e215f4028dd9: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:40.049093 10273 tablet_bootstrap.cc:492] T 054de37cbb3749d4bba5f419df15d1ad P 93e0f5c2800a4e7cb522c56114b61324: Bootstrap starting.
I20260809 13:03:40.049571 10271 log.cc:824] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19: Log is configured to *not* fsync() on all Append() calls
I20260809 13:03:40.050465 10272 log.cc:824] T 054de37cbb3749d4bba5f419df15d1ad P 22b5a2b099ae474b93f8e215f4028dd9: Log is configured to *not* fsync() on all Append() calls
I20260809 13:03:40.053598 10273 tablet_bootstrap.cc:654] T 054de37cbb3749d4bba5f419df15d1ad P 93e0f5c2800a4e7cb522c56114b61324: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:40.053836 10271 tablet_bootstrap.cc:492] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19: No bootstrap required, opened a new log
I20260809 13:03:40.054153 10271 ts_tablet_manager.cc:1397] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.000s
I20260809 13:03:40.054790 10273 log.cc:824] T 054de37cbb3749d4bba5f419df15d1ad P 93e0f5c2800a4e7cb522c56114b61324: Log is configured to *not* fsync() on all Append() calls
I20260809 13:03:40.055347 10272 tablet_bootstrap.cc:492] T 054de37cbb3749d4bba5f419df15d1ad P 22b5a2b099ae474b93f8e215f4028dd9: No bootstrap required, opened a new log
I20260809 13:03:40.055657 10272 ts_tablet_manager.cc:1397] T 054de37cbb3749d4bba5f419df15d1ad P 22b5a2b099ae474b93f8e215f4028dd9: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260809 13:03:40.060194 10273 tablet_bootstrap.cc:492] T 054de37cbb3749d4bba5f419df15d1ad P 93e0f5c2800a4e7cb522c56114b61324: No bootstrap required, opened a new log
I20260809 13:03:40.060698 10273 ts_tablet_manager.cc:1397] T 054de37cbb3749d4bba5f419df15d1ad P 93e0f5c2800a4e7cb522c56114b61324: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.003s
I20260809 13:03:40.066138 10271 raft_consensus.cc:348] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } }
I20260809 13:03:40.066716 10271 raft_consensus.cc:374] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:40.066838 10271 raft_consensus.cc:729] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69cc3e329c5643e5997919f5a3342b19, State: Initialized, Role: FOLLOWER
I20260809 13:03:40.067338 10272 raft_consensus.cc:348] T 054de37cbb3749d4bba5f419df15d1ad P 22b5a2b099ae474b93f8e215f4028dd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } }
I20260809 13:03:40.067809 10272 raft_consensus.cc:374] T 054de37cbb3749d4bba5f419df15d1ad P 22b5a2b099ae474b93f8e215f4028dd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:40.067615 10271 consensus_queue.cc:260] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } }
I20260809 13:03:40.067914 10272 raft_consensus.cc:729] T 054de37cbb3749d4bba5f419df15d1ad P 22b5a2b099ae474b93f8e215f4028dd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22b5a2b099ae474b93f8e215f4028dd9, State: Initialized, Role: FOLLOWER
I20260809 13:03:40.069031 10243 heartbeater.cc:503] Master 127.28.155.254:45637 was elected leader, sending a full tablet report...
I20260809 13:03:40.069773 10271 ts_tablet_manager.cc:1428] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19: Time spent starting tablet: real 0.015s user 0.016s sys 0.000s
I20260809 13:03:40.068758 10272 consensus_queue.cc:260] T 054de37cbb3749d4bba5f419df15d1ad P 22b5a2b099ae474b93f8e215f4028dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } }
I20260809 13:03:40.070505 10273 raft_consensus.cc:348] T 054de37cbb3749d4bba5f419df15d1ad P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } }
I20260809 13:03:40.070982 10273 raft_consensus.cc:374] T 054de37cbb3749d4bba5f419df15d1ad P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:40.071107 10273 raft_consensus.cc:729] T 054de37cbb3749d4bba5f419df15d1ad P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93e0f5c2800a4e7cb522c56114b61324, State: Initialized, Role: FOLLOWER
I20260809 13:03:40.071858 10273 consensus_queue.cc:260] T 054de37cbb3749d4bba5f419df15d1ad P 93e0f5c2800a4e7cb522c56114b61324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } }
I20260809 13:03:40.072261 10272 ts_tablet_manager.cc:1428] T 054de37cbb3749d4bba5f419df15d1ad P 22b5a2b099ae474b93f8e215f4028dd9: Time spent starting tablet: real 0.016s user 0.016s sys 0.000s
I20260809 13:03:40.072676 10026 heartbeater.cc:503] Master 127.28.155.254:45637 was elected leader, sending a full tablet report...
I20260809 13:03:40.074378 10273 ts_tablet_manager.cc:1428] T 054de37cbb3749d4bba5f419df15d1ad P 93e0f5c2800a4e7cb522c56114b61324: Time spent starting tablet: real 0.013s user 0.007s sys 0.004s
I20260809 13:03:40.104197 10278 raft_consensus.cc:482] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:03:40.104671 10278 raft_consensus.cc:504] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } }
I20260809 13:03:40.106509 10278 leader_election.cc:288] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93e0f5c2800a4e7cb522c56114b61324 (127.28.155.193:42147), 22b5a2b099ae474b93f8e215f4028dd9 (127.28.155.194:36975)
I20260809 13:03:40.113253 10265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:40.106991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:45017 (local address 127.28.155.193:42147)
0809 13:03:40.107231 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:40.107237 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:40.107260 (+ 23us) server_negotiation.cc:407] Connection header received
0809 13:03:40.107499 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:40.107507 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:40.107592 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:40.107698 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:03:40.108110 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.109224 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.111231 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.112353 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.112526 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:40.112596 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:40.112935 (+ 339us) server_negotiation.cc:299] Negotiation successful
0809 13:03:40.113036 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 13:03:40.113344 10079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:40.106759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:42147 (local address 127.28.155.195:45017)
0809 13:03:40.107105 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:40.107127 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:40.107264 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:40.107744 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:40.107748 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:40.107773 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:03:40.107954 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:40.107961 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.109371 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.109377 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:40.111008 (+ 1631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:40.111021 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.112541 (+ 1520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.112549 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:40.112755 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:40.112792 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 13:03:40.112889 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 13:03:40.113035 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"mutex_wait_us":19}
I20260809 13:03:40.114171 10267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:40.107150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:60041 (local address 127.28.155.194:36975)
0809 13:03:40.107392 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:40.107400 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:40.107962 (+ 562us) server_negotiation.cc:407] Connection header received
0809 13:03:40.108175 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:40.108179 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:40.108241 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:40.108312 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:03:40.108992 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.109996 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.112077 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.113161 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.113315 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:40.113404 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:40.113769 (+ 365us) server_negotiation.cc:299] Negotiation successful
0809 13:03:40.113913 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 13:03:40.114166 10281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:40.107007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:36975 (local address 127.28.155.195:60041)
0809 13:03:40.107824 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:40.107844 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:40.108017 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:40.108377 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:40.108382 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:40.108408 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:03:40.108819 (+ 411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:40.108830 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.110148 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.110152 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:40.111911 (+ 1759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:40.111927 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.113429 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.113438 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:40.113612 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:40.113643 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 13:03:40.113744 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 13:03:40.113837 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"mutex_wait_us":25,"thread_start_us":448,"threads_started":1}
I20260809 13:03:40.114651 9746 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "054de37cbb3749d4bba5f419df15d1ad" candidate_uuid: "69cc3e329c5643e5997919f5a3342b19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93e0f5c2800a4e7cb522c56114b61324" is_pre_election: true
I20260809 13:03:40.115221 9746 raft_consensus.cc:2454] T 054de37cbb3749d4bba5f419df15d1ad P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69cc3e329c5643e5997919f5a3342b19 in term 0.
I20260809 13:03:40.115211 9960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "054de37cbb3749d4bba5f419df15d1ad" candidate_uuid: "69cc3e329c5643e5997919f5a3342b19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22b5a2b099ae474b93f8e215f4028dd9" is_pre_election: true
I20260809 13:03:40.115826 9960 raft_consensus.cc:2454] T 054de37cbb3749d4bba5f419df15d1ad P 22b5a2b099ae474b93f8e215f4028dd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69cc3e329c5643e5997919f5a3342b19 in term 0.
I20260809 13:03:40.115937 10066 leader_election.cc:302] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69cc3e329c5643e5997919f5a3342b19, 93e0f5c2800a4e7cb522c56114b61324; no voters:
I20260809 13:03:40.116427 10278 raft_consensus.cc:2781] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:03:40.116647 10278 raft_consensus.cc:482] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:03:40.116751 10278 raft_consensus.cc:3037] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:40.119132 10278 raft_consensus.cc:504] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } }
I20260809 13:03:40.119814 10278 leader_election.cc:288] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19 [CANDIDATE]: Term 1 election: Requested vote from peers 93e0f5c2800a4e7cb522c56114b61324 (127.28.155.193:42147), 22b5a2b099ae474b93f8e215f4028dd9 (127.28.155.194:36975)
I20260809 13:03:40.120404 9746 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "054de37cbb3749d4bba5f419df15d1ad" candidate_uuid: "69cc3e329c5643e5997919f5a3342b19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93e0f5c2800a4e7cb522c56114b61324"
I20260809 13:03:40.120405 9960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "054de37cbb3749d4bba5f419df15d1ad" candidate_uuid: "69cc3e329c5643e5997919f5a3342b19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22b5a2b099ae474b93f8e215f4028dd9"
I20260809 13:03:40.120707 9960 raft_consensus.cc:3037] T 054de37cbb3749d4bba5f419df15d1ad P 22b5a2b099ae474b93f8e215f4028dd9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:40.120710 9746 raft_consensus.cc:3037] T 054de37cbb3749d4bba5f419df15d1ad P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:40.123255 9960 raft_consensus.cc:2454] T 054de37cbb3749d4bba5f419df15d1ad P 22b5a2b099ae474b93f8e215f4028dd9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69cc3e329c5643e5997919f5a3342b19 in term 1.
I20260809 13:03:40.123292 9746 raft_consensus.cc:2454] T 054de37cbb3749d4bba5f419df15d1ad P 93e0f5c2800a4e7cb522c56114b61324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69cc3e329c5643e5997919f5a3342b19 in term 1.
I20260809 13:03:40.123772 10066 leader_election.cc:302] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69cc3e329c5643e5997919f5a3342b19, 93e0f5c2800a4e7cb522c56114b61324; no voters:
I20260809 13:03:40.124125 10278 raft_consensus.cc:2781] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:03:40.124681 10278 raft_consensus.cc:686] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19 [term 1 LEADER]: Becoming Leader. State: Replica: 69cc3e329c5643e5997919f5a3342b19, State: Running, Role: LEADER
I20260809 13:03:40.125202 10278 consensus_queue.cc:237] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } }
I20260809 13:03:40.130286 9491 catalog_manager.cc:5495] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19 reported cstate change: term changed from 0 to 1, leader changed from <none> to 69cc3e329c5643e5997919f5a3342b19 (127.28.155.195). New cstate: current_term: 1 leader_uuid: "69cc3e329c5643e5997919f5a3342b19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } health_report { overall_health: UNKNOWN } } }
W20260809 13:03:40.138078 10244 tablet.cc:2369] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:03:40.161798 10268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:40.155977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41508 (local address 127.28.155.195:44333)
0809 13:03:40.156207 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:40.156214 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:40.156236 (+ 22us) server_negotiation.cc:407] Connection header received
0809 13:03:40.156521 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:40.156528 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:40.156643 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:40.156802 (+ 159us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:03:40.157193 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.157965 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.159326 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.159779 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.159924 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:40.160389 (+ 465us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:03:40.161044 (+ 655us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:03:40.161170 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:40.161414 (+ 244us) server_negotiation.cc:299] Negotiation successful
0809 13:03:40.161513 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 13:03:40.171562 9960 raft_consensus.cc:1261] T 054de37cbb3749d4bba5f419df15d1ad P 22b5a2b099ae474b93f8e215f4028dd9 [term 1 FOLLOWER]: Refusing update from remote peer 69cc3e329c5643e5997919f5a3342b19: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:03:40.171566 9746 raft_consensus.cc:1261] T 054de37cbb3749d4bba5f419df15d1ad P 93e0f5c2800a4e7cb522c56114b61324 [term 1 FOLLOWER]: Refusing update from remote peer 69cc3e329c5643e5997919f5a3342b19: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:03:40.172590 10284 consensus_queue.cc:1035] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:03:40.173005 10278 consensus_queue.cc:1035] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:03:40.184604 10289 mvcc.cc:205] Tried to move back new op lower bound from 7316605420210671616 to 7316605420037132288. Current Snapshot: MvccSnapshot[applied={T|T < 7316605420210671616}]
I20260809 13:03:40.185732 10290 mvcc.cc:205] Tried to move back new op lower bound from 7316605420210671616 to 7316605420037132288. Current Snapshot: MvccSnapshot[applied={T|T < 7316605420210671616}]
I20260809 13:03:40.203266 9491 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55074:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:03:40.203585 9491 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55074:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:03:40.208087 9491 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 957868b5ea3f4caf803efe9a4e5b30d0: Sending DeleteTablet for 3 replicas of tablet 054de37cbb3749d4bba5f419df15d1ad
I20260809 13:03:40.209576 9916 tablet_service.cc:1514] Processing DeleteTablet for tablet 054de37cbb3749d4bba5f419df15d1ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:03:40 UTC) from {username='oryx', principal='oryx/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:49318
I20260809 13:03:40.209582 10134 tablet_service.cc:1514] Processing DeleteTablet for tablet 054de37cbb3749d4bba5f419df15d1ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:03:40 UTC) from {username='oryx', principal='oryx/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:41498
I20260809 13:03:40.209635 9715 tablet_service.cc:1514] Processing DeleteTablet for tablet 054de37cbb3749d4bba5f419df15d1ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:03:40 UTC) from {username='oryx', principal='oryx/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:40452
I20260809 13:03:40.213158 9491 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55074:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 13:03:40.214179 9491 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:03:40.222436 10306 tablet_replica.cc:330] T 054de37cbb3749d4bba5f419df15d1ad P 93e0f5c2800a4e7cb522c56114b61324: stopping tablet replica
I20260809 13:03:40.223271 10306 raft_consensus.cc:2229] T 054de37cbb3749d4bba5f419df15d1ad P 93e0f5c2800a4e7cb522c56114b61324 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:03:40.224015 10306 raft_consensus.cc:2258] T 054de37cbb3749d4bba5f419df15d1ad P 93e0f5c2800a4e7cb522c56114b61324 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:03:40.225430 10303 tablet_replica.cc:330] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19: stopping tablet replica
I20260809 13:03:40.225675 9915 tablet_service.cc:1467] Processing CreateTablet for tablet baa95bfd68ea4b10bbb72805bf4b217e (DEFAULT_TABLE table=test-table [id=ea8ab090211344e7823b76be9d58ef56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:03:40.225759 9715 tablet_service.cc:1467] Processing CreateTablet for tablet baa95bfd68ea4b10bbb72805bf4b217e (DEFAULT_TABLE table=test-table [id=ea8ab090211344e7823b76be9d58ef56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:03:40.226269 9715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baa95bfd68ea4b10bbb72805bf4b217e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:40.225734 10134 tablet_service.cc:1467] Processing CreateTablet for tablet baa95bfd68ea4b10bbb72805bf4b217e (DEFAULT_TABLE table=test-table [id=ea8ab090211344e7823b76be9d58ef56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:03:40.226366 9915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baa95bfd68ea4b10bbb72805bf4b217e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:40.227038 10303 raft_consensus.cc:2229] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19 [term 1 LEADER]: Raft consensus shutting down.
I20260809 13:03:40.227203 10134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baa95bfd68ea4b10bbb72805bf4b217e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:40.232802 10303 raft_consensus.cc:2258] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:03:40.233902 10273 tablet_bootstrap.cc:492] T baa95bfd68ea4b10bbb72805bf4b217e P 93e0f5c2800a4e7cb522c56114b61324: Bootstrap starting.
I20260809 13:03:40.234658 10306 ts_tablet_manager.cc:1905] T 054de37cbb3749d4bba5f419df15d1ad P 93e0f5c2800a4e7cb522c56114b61324: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:03:40.236024 10273 tablet_bootstrap.cc:654] T baa95bfd68ea4b10bbb72805bf4b217e P 93e0f5c2800a4e7cb522c56114b61324: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:40.237440 10272 tablet_bootstrap.cc:492] T baa95bfd68ea4b10bbb72805bf4b217e P 22b5a2b099ae474b93f8e215f4028dd9: Bootstrap starting.
I20260809 13:03:40.238322 10303 ts_tablet_manager.cc:1905] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:03:40.239635 10272 tablet_bootstrap.cc:654] T baa95bfd68ea4b10bbb72805bf4b217e P 22b5a2b099ae474b93f8e215f4028dd9: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:40.242123 10302 tablet_replica.cc:330] T 054de37cbb3749d4bba5f419df15d1ad P 22b5a2b099ae474b93f8e215f4028dd9: stopping tablet replica
I20260809 13:03:40.242727 10302 raft_consensus.cc:2229] T 054de37cbb3749d4bba5f419df15d1ad P 22b5a2b099ae474b93f8e215f4028dd9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:03:40.244809 10302 raft_consensus.cc:2258] T 054de37cbb3749d4bba5f419df15d1ad P 22b5a2b099ae474b93f8e215f4028dd9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:03:40.247414 10272 tablet_bootstrap.cc:492] T baa95bfd68ea4b10bbb72805bf4b217e P 22b5a2b099ae474b93f8e215f4028dd9: No bootstrap required, opened a new log
I20260809 13:03:40.247596 10272 ts_tablet_manager.cc:1397] T baa95bfd68ea4b10bbb72805bf4b217e P 22b5a2b099ae474b93f8e215f4028dd9: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260809 13:03:40.248521 10272 raft_consensus.cc:348] T baa95bfd68ea4b10bbb72805bf4b217e P 22b5a2b099ae474b93f8e215f4028dd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:40.248788 10272 raft_consensus.cc:374] T baa95bfd68ea4b10bbb72805bf4b217e P 22b5a2b099ae474b93f8e215f4028dd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:40.248940 10272 raft_consensus.cc:729] T baa95bfd68ea4b10bbb72805bf4b217e P 22b5a2b099ae474b93f8e215f4028dd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22b5a2b099ae474b93f8e215f4028dd9, State: Initialized, Role: FOLLOWER
I20260809 13:03:40.249253 10272 consensus_queue.cc:260] T baa95bfd68ea4b10bbb72805bf4b217e P 22b5a2b099ae474b93f8e215f4028dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:40.252391 10272 ts_tablet_manager.cc:1428] T baa95bfd68ea4b10bbb72805bf4b217e P 22b5a2b099ae474b93f8e215f4028dd9: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260809 13:03:40.253271 10306 ts_tablet_manager.cc:1918] T 054de37cbb3749d4bba5f419df15d1ad P 93e0f5c2800a4e7cb522c56114b61324: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:03:40.253475 10306 log.cc:1196] T 054de37cbb3749d4bba5f419df15d1ad P 93e0f5c2800a4e7cb522c56114b61324: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-0/wal/wals/054de37cbb3749d4bba5f419df15d1ad
I20260809 13:03:40.253508 10302 ts_tablet_manager.cc:1905] T 054de37cbb3749d4bba5f419df15d1ad P 22b5a2b099ae474b93f8e215f4028dd9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:03:40.253865 10273 tablet_bootstrap.cc:492] T baa95bfd68ea4b10bbb72805bf4b217e P 93e0f5c2800a4e7cb522c56114b61324: No bootstrap required, opened a new log
I20260809 13:03:40.254050 10273 ts_tablet_manager.cc:1397] T baa95bfd68ea4b10bbb72805bf4b217e P 93e0f5c2800a4e7cb522c56114b61324: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.001s
I20260809 13:03:40.254142 10306 ts_tablet_manager.cc:1939] T 054de37cbb3749d4bba5f419df15d1ad P 93e0f5c2800a4e7cb522c56114b61324: Deleting consensus metadata
I20260809 13:03:40.255299 10271 tablet_bootstrap.cc:492] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19: Bootstrap starting.
I20260809 13:03:40.255759 10273 raft_consensus.cc:348] T baa95bfd68ea4b10bbb72805bf4b217e P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:40.256028 10273 raft_consensus.cc:374] T baa95bfd68ea4b10bbb72805bf4b217e P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:40.256145 10273 raft_consensus.cc:729] T baa95bfd68ea4b10bbb72805bf4b217e P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93e0f5c2800a4e7cb522c56114b61324, State: Initialized, Role: FOLLOWER
I20260809 13:03:40.256534 10273 consensus_queue.cc:260] T baa95bfd68ea4b10bbb72805bf4b217e P 93e0f5c2800a4e7cb522c56114b61324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:40.257333 10273 ts_tablet_manager.cc:1428] T baa95bfd68ea4b10bbb72805bf4b217e P 93e0f5c2800a4e7cb522c56114b61324: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 13:03:40.257382 10271 tablet_bootstrap.cc:654] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:40.258394 10303 ts_tablet_manager.cc:1918] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:03:40.263168 9467 catalog_manager.cc:4841] TS 93e0f5c2800a4e7cb522c56114b61324 (127.28.155.193:42147): tablet 054de37cbb3749d4bba5f419df15d1ad (table test-table [id=237c61146c3848a789709d80885078f2]) successfully deleted
I20260809 13:03:40.263453 10303 log.cc:1196] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-2/wal/wals/054de37cbb3749d4bba5f419df15d1ad
I20260809 13:03:40.263288 10302 ts_tablet_manager.cc:1918] T 054de37cbb3749d4bba5f419df15d1ad P 22b5a2b099ae474b93f8e215f4028dd9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:03:40.263803 10302 log.cc:1196] T 054de37cbb3749d4bba5f419df15d1ad P 22b5a2b099ae474b93f8e215f4028dd9: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-1/wal/wals/054de37cbb3749d4bba5f419df15d1ad
I20260809 13:03:40.264207 10303 ts_tablet_manager.cc:1939] T 054de37cbb3749d4bba5f419df15d1ad P 69cc3e329c5643e5997919f5a3342b19: Deleting consensus metadata
I20260809 13:03:40.263168 10271 tablet_bootstrap.cc:492] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19: No bootstrap required, opened a new log
I20260809 13:03:40.264528 10302 ts_tablet_manager.cc:1939] T 054de37cbb3749d4bba5f419df15d1ad P 22b5a2b099ae474b93f8e215f4028dd9: Deleting consensus metadata
I20260809 13:03:40.264797 10271 ts_tablet_manager.cc:1397] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260809 13:03:40.266305 9467 catalog_manager.cc:4841] TS 69cc3e329c5643e5997919f5a3342b19 (127.28.155.195:44333): tablet 054de37cbb3749d4bba5f419df15d1ad (table test-table [id=237c61146c3848a789709d80885078f2]) successfully deleted
I20260809 13:03:40.265910 10271 raft_consensus.cc:348] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:40.266690 10271 raft_consensus.cc:374] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:40.266633 9464 catalog_manager.cc:4841] TS 22b5a2b099ae474b93f8e215f4028dd9 (127.28.155.194:36975): tablet 054de37cbb3749d4bba5f419df15d1ad (table test-table [id=237c61146c3848a789709d80885078f2]) successfully deleted
I20260809 13:03:40.266824 10271 raft_consensus.cc:729] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69cc3e329c5643e5997919f5a3342b19, State: Initialized, Role: FOLLOWER
I20260809 13:03:40.267230 10271 consensus_queue.cc:260] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:40.267809 10271 ts_tablet_manager.cc:1428] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20260809 13:03:40.294524 10027 tablet.cc:2369] T baa95bfd68ea4b10bbb72805bf4b217e P 22b5a2b099ae474b93f8e215f4028dd9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:03:40.426074 10278 raft_consensus.cc:482] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:03:40.426318 10278 raft_consensus.cc:504] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:40.427006 10278 leader_election.cc:288] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93e0f5c2800a4e7cb522c56114b61324 (127.28.155.193:42147), 22b5a2b099ae474b93f8e215f4028dd9 (127.28.155.194:36975)
I20260809 13:03:40.427623 9746 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baa95bfd68ea4b10bbb72805bf4b217e" candidate_uuid: "69cc3e329c5643e5997919f5a3342b19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93e0f5c2800a4e7cb522c56114b61324" is_pre_election: true
I20260809 13:03:40.427675 9960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baa95bfd68ea4b10bbb72805bf4b217e" candidate_uuid: "69cc3e329c5643e5997919f5a3342b19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22b5a2b099ae474b93f8e215f4028dd9" is_pre_election: true
I20260809 13:03:40.427966 9746 raft_consensus.cc:2454] T baa95bfd68ea4b10bbb72805bf4b217e P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69cc3e329c5643e5997919f5a3342b19 in term 0.
I20260809 13:03:40.427978 9960 raft_consensus.cc:2454] T baa95bfd68ea4b10bbb72805bf4b217e P 22b5a2b099ae474b93f8e215f4028dd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69cc3e329c5643e5997919f5a3342b19 in term 0.
I20260809 13:03:40.428527 10061 leader_election.cc:302] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22b5a2b099ae474b93f8e215f4028dd9, 69cc3e329c5643e5997919f5a3342b19; no voters:
I20260809 13:03:40.428900 10278 raft_consensus.cc:2781] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:03:40.429059 10278 raft_consensus.cc:482] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:03:40.429196 10278 raft_consensus.cc:3037] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:40.431471 10278 raft_consensus.cc:504] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:40.432138 10278 leader_election.cc:288] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19 [CANDIDATE]: Term 1 election: Requested vote from peers 93e0f5c2800a4e7cb522c56114b61324 (127.28.155.193:42147), 22b5a2b099ae474b93f8e215f4028dd9 (127.28.155.194:36975)
I20260809 13:03:40.432734 9960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baa95bfd68ea4b10bbb72805bf4b217e" candidate_uuid: "69cc3e329c5643e5997919f5a3342b19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22b5a2b099ae474b93f8e215f4028dd9"
I20260809 13:03:40.432746 9746 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baa95bfd68ea4b10bbb72805bf4b217e" candidate_uuid: "69cc3e329c5643e5997919f5a3342b19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93e0f5c2800a4e7cb522c56114b61324"
I20260809 13:03:40.432953 9960 raft_consensus.cc:3037] T baa95bfd68ea4b10bbb72805bf4b217e P 22b5a2b099ae474b93f8e215f4028dd9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:40.432993 9746 raft_consensus.cc:3037] T baa95bfd68ea4b10bbb72805bf4b217e P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:40.435084 9960 raft_consensus.cc:2454] T baa95bfd68ea4b10bbb72805bf4b217e P 22b5a2b099ae474b93f8e215f4028dd9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69cc3e329c5643e5997919f5a3342b19 in term 1.
I20260809 13:03:40.435532 10061 leader_election.cc:302] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22b5a2b099ae474b93f8e215f4028dd9, 69cc3e329c5643e5997919f5a3342b19; no voters:
I20260809 13:03:40.435842 10278 raft_consensus.cc:2781] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:03:40.436028 10278 raft_consensus.cc:686] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19 [term 1 LEADER]: Becoming Leader. State: Replica: 69cc3e329c5643e5997919f5a3342b19, State: Running, Role: LEADER
I20260809 13:03:40.436317 10278 consensus_queue.cc:237] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:40.436412 9746 raft_consensus.cc:2454] T baa95bfd68ea4b10bbb72805bf4b217e P 93e0f5c2800a4e7cb522c56114b61324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69cc3e329c5643e5997919f5a3342b19 in term 1.
I20260809 13:03:40.439680 9490 catalog_manager.cc:5495] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19 reported cstate change: term changed from 0 to 1, leader changed from <none> to 69cc3e329c5643e5997919f5a3342b19 (127.28.155.195). New cstate: current_term: 1 leader_uuid: "69cc3e329c5643e5997919f5a3342b19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } health_report { overall_health: HEALTHY } } }
W20260809 13:03:40.465217 9819 tablet.cc:2369] T baa95bfd68ea4b10bbb72805bf4b217e P 93e0f5c2800a4e7cb522c56114b61324: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 13:03:40 dist-test-slave-jq4t krb5kdc[9417](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280617, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.254@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM
I20260809 13:03:40.519992 10322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:40.503311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:45637 (local address 127.0.0.1:55090)
0809 13:03:40.504412 (+ 1101us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:40.504426 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:40.504655 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:40.505040 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:40.505047 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:40.505905 (+ 858us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:40.506186 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:40.506197 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.507404 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.507413 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:40.508410 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:40.508423 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.509290 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.509297 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:40.509506 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:40.510291 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:40.510311 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:40.512880 (+ 2569us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:40.517248 (+ 4368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:40.517263 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:40.517270 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:40.517747 (+ 477us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:40.518224 (+ 477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:40.518228 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:40.518230 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:40.518375 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:40.519078 (+ 703us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:40.519085 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:40.519263 (+ 178us) client_negotiation.cc:769] Sending connection context
0809 13:03:40.519409 (+ 146us) client_negotiation.cc:240] Negotiation successful
0809 13:03:40.519637 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":973,"thread_start_us":868,"threads_started":1}
I20260809 13:03:40.520380 10320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:40.503409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55090 (local address 127.28.155.254:45637)
0809 13:03:40.504066 (+ 657us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:40.504071 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:40.504548 (+ 477us) server_negotiation.cc:407] Connection header received
0809 13:03:40.504789 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:40.504794 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:40.504873 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:40.505003 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:40.506378 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.507241 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.508628 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.509075 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.509216 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:40.513144 (+ 3928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:40.513152 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:40.513157 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:40.513200 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:40.517074 (+ 3874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:40.517905 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:40.517911 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:40.517914 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:40.518100 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:40.518514 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:40.518521 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:40.518524 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:40.518927 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:40.519102 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:40.519576 (+ 474us) server_negotiation.cc:299] Negotiation successful
0809 13:03:40.519858 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":524,"thread_start_us":362,"threads_started":1}
I20260809 13:03:40.526839 9490 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:55090:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 13:03:40.528201 9490 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:03:40.536109 9715 tablet_service.cc:1467] Processing CreateTablet for tablet 6812ea45fec04653949d8cf6f92eb776 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=eb7729dd22d74eba870299a76dcfe641]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 13:03:40.536470 10134 tablet_service.cc:1467] Processing CreateTablet for tablet 6812ea45fec04653949d8cf6f92eb776 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=eb7729dd22d74eba870299a76dcfe641]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 13:03:40.536839 9715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6812ea45fec04653949d8cf6f92eb776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:40.537138 10134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6812ea45fec04653949d8cf6f92eb776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:40.545058 10273 tablet_bootstrap.cc:492] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324: Bootstrap starting.
I20260809 13:03:40.545195 10271 tablet_bootstrap.cc:492] T 6812ea45fec04653949d8cf6f92eb776 P 69cc3e329c5643e5997919f5a3342b19: Bootstrap starting.
I20260809 13:03:40.547127 10273 tablet_bootstrap.cc:654] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:40.547217 10271 tablet_bootstrap.cc:654] T 6812ea45fec04653949d8cf6f92eb776 P 69cc3e329c5643e5997919f5a3342b19: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:40.546970 9916 tablet_service.cc:1467] Processing CreateTablet for tablet 6812ea45fec04653949d8cf6f92eb776 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=eb7729dd22d74eba870299a76dcfe641]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 13:03:40.547670 9916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6812ea45fec04653949d8cf6f92eb776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:40.558945 10272 tablet_bootstrap.cc:492] T 6812ea45fec04653949d8cf6f92eb776 P 22b5a2b099ae474b93f8e215f4028dd9: Bootstrap starting.
I20260809 13:03:40.559486 10271 tablet_bootstrap.cc:492] T 6812ea45fec04653949d8cf6f92eb776 P 69cc3e329c5643e5997919f5a3342b19: No bootstrap required, opened a new log
I20260809 13:03:40.559701 10271 ts_tablet_manager.cc:1397] T 6812ea45fec04653949d8cf6f92eb776 P 69cc3e329c5643e5997919f5a3342b19: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.009s
I20260809 13:03:40.560663 10271 raft_consensus.cc:348] T 6812ea45fec04653949d8cf6f92eb776 P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:40.560948 10272 tablet_bootstrap.cc:654] T 6812ea45fec04653949d8cf6f92eb776 P 22b5a2b099ae474b93f8e215f4028dd9: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:40.561008 10271 raft_consensus.cc:374] T 6812ea45fec04653949d8cf6f92eb776 P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:40.561103 10271 raft_consensus.cc:729] T 6812ea45fec04653949d8cf6f92eb776 P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69cc3e329c5643e5997919f5a3342b19, State: Initialized, Role: FOLLOWER
I20260809 13:03:40.561415 10271 consensus_queue.cc:260] T 6812ea45fec04653949d8cf6f92eb776 P 69cc3e329c5643e5997919f5a3342b19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:40.561829 10284 raft_consensus.cc:482] T 6812ea45fec04653949d8cf6f92eb776 P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:03:40.562050 10284 raft_consensus.cc:504] T 6812ea45fec04653949d8cf6f92eb776 P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:40.562876 10278 tablet_replica.cc:439] T 6812ea45fec04653949d8cf6f92eb776 P 69cc3e329c5643e5997919f5a3342b19: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } } }
I20260809 13:03:40.563333 10278 tablet_replica.cc:442] T 6812ea45fec04653949d8cf6f92eb776 P 69cc3e329c5643e5997919f5a3342b19: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 13:03:40.562875 10284 leader_election.cc:288] T 6812ea45fec04653949d8cf6f92eb776 P 69cc3e329c5643e5997919f5a3342b19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93e0f5c2800a4e7cb522c56114b61324 (127.28.155.193:42147), 22b5a2b099ae474b93f8e215f4028dd9 (127.28.155.194:36975)
I20260809 13:03:40.563912 9960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6812ea45fec04653949d8cf6f92eb776" candidate_uuid: "69cc3e329c5643e5997919f5a3342b19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22b5a2b099ae474b93f8e215f4028dd9" is_pre_election: true
I20260809 13:03:40.566340 9746 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6812ea45fec04653949d8cf6f92eb776" candidate_uuid: "69cc3e329c5643e5997919f5a3342b19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93e0f5c2800a4e7cb522c56114b61324" is_pre_election: true
W20260809 13:03:40.568571 10066 leader_election.cc:341] T 6812ea45fec04653949d8cf6f92eb776 P 69cc3e329c5643e5997919f5a3342b19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93e0f5c2800a4e7cb522c56114b61324 (127.28.155.193:42147): Illegal state: must be running to vote when last-logged opid is not known
W20260809 13:03:40.569620 10061 leader_election.cc:341] T 6812ea45fec04653949d8cf6f92eb776 P 69cc3e329c5643e5997919f5a3342b19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22b5a2b099ae474b93f8e215f4028dd9 (127.28.155.194:36975): Illegal state: must be running to vote when last-logged opid is not known
I20260809 13:03:40.569809 10061 leader_election.cc:302] T 6812ea45fec04653949d8cf6f92eb776 P 69cc3e329c5643e5997919f5a3342b19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69cc3e329c5643e5997919f5a3342b19; no voters: 22b5a2b099ae474b93f8e215f4028dd9, 93e0f5c2800a4e7cb522c56114b61324
I20260809 13:03:40.570463 10284 raft_consensus.cc:2726] T 6812ea45fec04653949d8cf6f92eb776 P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260809 13:03:40.571931 10271 ts_tablet_manager.cc:1428] T 6812ea45fec04653949d8cf6f92eb776 P 69cc3e329c5643e5997919f5a3342b19: Time spent starting tablet: real 0.012s user 0.003s sys 0.000s
I20260809 13:03:40.572865 10272 tablet_bootstrap.cc:492] T 6812ea45fec04653949d8cf6f92eb776 P 22b5a2b099ae474b93f8e215f4028dd9: No bootstrap required, opened a new log
I20260809 13:03:40.573146 10272 ts_tablet_manager.cc:1397] T 6812ea45fec04653949d8cf6f92eb776 P 22b5a2b099ae474b93f8e215f4028dd9: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.003s
I20260809 13:03:40.573226 10273 tablet_bootstrap.cc:492] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324: No bootstrap required, opened a new log
I20260809 13:03:40.573429 10273 ts_tablet_manager.cc:1397] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.016s
I20260809 13:03:40.574214 10272 raft_consensus.cc:348] T 6812ea45fec04653949d8cf6f92eb776 P 22b5a2b099ae474b93f8e215f4028dd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:40.574291 10273 raft_consensus.cc:348] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:40.574564 10273 raft_consensus.cc:374] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:40.574661 10273 raft_consensus.cc:729] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93e0f5c2800a4e7cb522c56114b61324, State: Initialized, Role: FOLLOWER
I20260809 13:03:40.574615 10272 raft_consensus.cc:374] T 6812ea45fec04653949d8cf6f92eb776 P 22b5a2b099ae474b93f8e215f4028dd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:40.574834 10272 raft_consensus.cc:729] T 6812ea45fec04653949d8cf6f92eb776 P 22b5a2b099ae474b93f8e215f4028dd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22b5a2b099ae474b93f8e215f4028dd9, State: Initialized, Role: FOLLOWER
I20260809 13:03:40.574947 10273 consensus_queue.cc:260] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:40.575119 10272 consensus_queue.cc:260] T 6812ea45fec04653949d8cf6f92eb776 P 22b5a2b099ae474b93f8e215f4028dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:40.575687 10273 ts_tablet_manager.cc:1428] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 13:03:40.575560 10280 tablet_replica.cc:439] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } } }
I20260809 13:03:40.575616 10279 tablet_replica.cc:439] T 6812ea45fec04653949d8cf6f92eb776 P 22b5a2b099ae474b93f8e215f4028dd9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } } }
I20260809 13:03:40.575978 10280 tablet_replica.cc:442] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 13:03:40.576041 10279 tablet_replica.cc:442] T 6812ea45fec04653949d8cf6f92eb776 P 22b5a2b099ae474b93f8e215f4028dd9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 13:03:40.577653 10272 ts_tablet_manager.cc:1428] T 6812ea45fec04653949d8cf6f92eb776 P 22b5a2b099ae474b93f8e215f4028dd9: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260809 13:03:40.940512 10280 raft_consensus.cc:482] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:03:40.940765 10280 raft_consensus.cc:504] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:40.942644 10280 leader_election.cc:288] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22b5a2b099ae474b93f8e215f4028dd9 (127.28.155.194:36975), 69cc3e329c5643e5997919f5a3342b19 (127.28.155.195:44333)
I20260809 13:03:40.955250 10284 consensus_queue.cc:1035] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:03:40.960829 10329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:40.942881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:36975 (local address 127.28.155.193:37725)
0809 13:03:40.953082 (+ 10201us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:40.953113 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:40.953341 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:40.954037 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:40.954042 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:40.954072 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:03:40.954414 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:40.954426 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.955916 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.955921 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:40.958217 (+ 2296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:40.958232 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.959841 (+ 1609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.959847 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:40.960041 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:40.960088 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 13:03:40.960176 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 13:03:40.960335 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10004,"mutex_wait_us":1,"thread_start_us":9959,"threads_started":1}
I20260809 13:03:40.961272 10331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:40.942978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:44333 (local address 127.28.155.193:35345)
0809 13:03:40.953990 (+ 11012us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:40.954011 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:40.954164 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:40.954528 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:40.954533 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:40.954560 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:03:40.954990 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:40.955002 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.956336 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.956341 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:40.958553 (+ 2212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:40.958567 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.960375 (+ 1808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.960380 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:40.960632 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:40.960671 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 13:03:40.960767 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 13:03:40.960922 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10844,"mutex_wait_us":24,"thread_start_us":10661,"threads_started":1}
I20260809 13:03:40.961500 10333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:40.943058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:37725 (local address 127.28.155.194:36975)
0809 13:03:40.952798 (+ 9740us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:40.952808 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:40.953498 (+ 690us) server_negotiation.cc:407] Connection header received
0809 13:03:40.953608 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:40.953617 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:40.953710 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:40.953808 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:03:40.954617 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.955716 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.958405 (+ 2689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.959603 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.959837 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:40.959926 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:40.961049 (+ 1123us) server_negotiation.cc:299] Negotiation successful
0809 13:03:40.961207 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9545,"thread_start_us":9371,"threads_started":1}
I20260809 13:03:40.961992 10335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:40.943106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:35345 (local address 127.28.155.195:44333)
0809 13:03:40.953520 (+ 10414us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:40.953526 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:40.954106 (+ 580us) server_negotiation.cc:407] Connection header received
0809 13:03:40.954312 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:40.954322 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:40.954385 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:40.954506 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:03:40.955197 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.956197 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.958745 (+ 2548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:40.959988 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:40.960165 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:40.960236 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:40.961466 (+ 1230us) server_negotiation.cc:299] Negotiation successful
0809 13:03:40.961636 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10270,"thread_start_us":10148,"threads_started":1}
I20260809 13:03:40.962806 9960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6812ea45fec04653949d8cf6f92eb776" candidate_uuid: "93e0f5c2800a4e7cb522c56114b61324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22b5a2b099ae474b93f8e215f4028dd9" is_pre_election: true
I20260809 13:03:40.963083 9960 raft_consensus.cc:2454] T 6812ea45fec04653949d8cf6f92eb776 P 22b5a2b099ae474b93f8e215f4028dd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93e0f5c2800a4e7cb522c56114b61324 in term 0.
I20260809 13:03:40.963625 9634 leader_election.cc:302] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22b5a2b099ae474b93f8e215f4028dd9, 93e0f5c2800a4e7cb522c56114b61324; no voters:
I20260809 13:03:40.964155 10280 raft_consensus.cc:2781] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:03:40.964299 10280 raft_consensus.cc:482] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:03:40.964434 10280 raft_consensus.cc:3037] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:40.964597 10170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6812ea45fec04653949d8cf6f92eb776" candidate_uuid: "93e0f5c2800a4e7cb522c56114b61324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69cc3e329c5643e5997919f5a3342b19" is_pre_election: true
I20260809 13:03:40.965070 10170 raft_consensus.cc:2454] T 6812ea45fec04653949d8cf6f92eb776 P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93e0f5c2800a4e7cb522c56114b61324 in term 0.
I20260809 13:03:40.967593 10280 raft_consensus.cc:504] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:40.968257 10280 leader_election.cc:288] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324 [CANDIDATE]: Term 1 election: Requested vote from peers 22b5a2b099ae474b93f8e215f4028dd9 (127.28.155.194:36975), 69cc3e329c5643e5997919f5a3342b19 (127.28.155.195:44333)
I20260809 13:03:40.969066 10170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6812ea45fec04653949d8cf6f92eb776" candidate_uuid: "93e0f5c2800a4e7cb522c56114b61324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69cc3e329c5643e5997919f5a3342b19"
I20260809 13:03:40.969125 9958 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6812ea45fec04653949d8cf6f92eb776" candidate_uuid: "93e0f5c2800a4e7cb522c56114b61324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22b5a2b099ae474b93f8e215f4028dd9"
I20260809 13:03:40.969278 10170 raft_consensus.cc:3037] T 6812ea45fec04653949d8cf6f92eb776 P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:40.969362 9958 raft_consensus.cc:3037] T 6812ea45fec04653949d8cf6f92eb776 P 22b5a2b099ae474b93f8e215f4028dd9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:40.972458 9958 raft_consensus.cc:2454] T 6812ea45fec04653949d8cf6f92eb776 P 22b5a2b099ae474b93f8e215f4028dd9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93e0f5c2800a4e7cb522c56114b61324 in term 1.
I20260809 13:03:40.972450 10170 raft_consensus.cc:2454] T 6812ea45fec04653949d8cf6f92eb776 P 69cc3e329c5643e5997919f5a3342b19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93e0f5c2800a4e7cb522c56114b61324 in term 1.
I20260809 13:03:40.973095 9634 leader_election.cc:302] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22b5a2b099ae474b93f8e215f4028dd9, 93e0f5c2800a4e7cb522c56114b61324; no voters:
I20260809 13:03:40.973042 10278 consensus_queue.cc:1035] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:03:40.973407 10339 raft_consensus.cc:2781] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:03:40.973678 10339 raft_consensus.cc:686] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324 [term 1 LEADER]: Becoming Leader. State: Replica: 93e0f5c2800a4e7cb522c56114b61324, State: Running, Role: LEADER
I20260809 13:03:40.974177 10339 consensus_queue.cc:237] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:40.976648 10280 tablet_replica.cc:439] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324: TxnStatusTablet state changed. Reason: New leader 93e0f5c2800a4e7cb522c56114b61324. Latest consensus state: current_term: 1 leader_uuid: "93e0f5c2800a4e7cb522c56114b61324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } } }
I20260809 13:03:40.976964 10280 tablet_replica.cc:442] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324: This TxnStatusTablet replica's current role is: LEADER
I20260809 13:03:40.977674 10343 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 13:03:40.977934 10343 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 13:03:40.977954 9491 catalog_manager.cc:5495] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93e0f5c2800a4e7cb522c56114b61324 (127.28.155.193). New cstate: current_term: 1 leader_uuid: "93e0f5c2800a4e7cb522c56114b61324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } health_report { overall_health: UNKNOWN } } }
I20260809 13:03:41.030485 10348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:41.023441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:42147 (local address 127.0.0.1:40458)
0809 13:03:41.024049 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:41.024073 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:41.024264 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:41.024897 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:41.024902 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:41.024915 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 13:03:41.025195 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:41.025206 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.026422 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.026428 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:41.027486 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:41.027498 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.028372 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.028378 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:41.028644 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:41.028713 (+ 69us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 13:03:41.029781 (+ 1068us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 13:03:41.029816 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 13:03:41.029940 (+ 124us) client_negotiation.cc:240] Negotiation successful
0809 13:03:41.030109 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":276,"threads_started":1}
I20260809 13:03:41.030540 10349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:41.023541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40458 (local address 127.28.155.193:42147)
0809 13:03:41.024413 (+ 872us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:41.024419 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:41.024456 (+ 37us) server_negotiation.cc:407] Connection header received
0809 13:03:41.024600 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:41.024604 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:41.024694 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:41.024873 (+ 179us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:03:41.025387 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.026278 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.027638 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.028208 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.028355 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:41.028969 (+ 614us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:03:41.029658 (+ 689us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:03:41.029827 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:41.029989 (+ 162us) server_negotiation.cc:299] Negotiation successful
0809 13:03:41.030083 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":719,"thread_start_us":545,"threads_started":1}
I20260809 13:03:41.035470 9958 raft_consensus.cc:1261] T 6812ea45fec04653949d8cf6f92eb776 P 22b5a2b099ae474b93f8e215f4028dd9 [term 1 FOLLOWER]: Refusing update from remote peer 93e0f5c2800a4e7cb522c56114b61324: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:03:41.035632 10170 raft_consensus.cc:1261] T 6812ea45fec04653949d8cf6f92eb776 P 69cc3e329c5643e5997919f5a3342b19 [term 1 FOLLOWER]: Refusing update from remote peer 93e0f5c2800a4e7cb522c56114b61324: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:03:41.036319 10339 consensus_queue.cc:1035] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:03:41.036744 10280 consensus_queue.cc:1035] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:03:41.042632 10338 mvcc.cc:205] Tried to move back new op lower bound from 7316605423752814592 to 7316605423514791936. Current Snapshot: MvccSnapshot[applied={T|T < 7316605423752814592}]
I20260809 13:03:41.040261 10279 tablet_replica.cc:439] T 6812ea45fec04653949d8cf6f92eb776 P 22b5a2b099ae474b93f8e215f4028dd9: TxnStatusTablet state changed. Reason: New leader 93e0f5c2800a4e7cb522c56114b61324. Latest consensus state: current_term: 1 leader_uuid: "93e0f5c2800a4e7cb522c56114b61324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } } }
I20260809 13:03:41.043341 10279 tablet_replica.cc:442] T 6812ea45fec04653949d8cf6f92eb776 P 22b5a2b099ae474b93f8e215f4028dd9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 13:03:41.051823 10278 tablet_replica.cc:439] T 6812ea45fec04653949d8cf6f92eb776 P 69cc3e329c5643e5997919f5a3342b19: TxnStatusTablet state changed. Reason: New leader 93e0f5c2800a4e7cb522c56114b61324. Latest consensus state: current_term: 1 leader_uuid: "93e0f5c2800a4e7cb522c56114b61324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } } }
I20260809 13:03:41.052275 10278 tablet_replica.cc:442] T 6812ea45fec04653949d8cf6f92eb776 P 69cc3e329c5643e5997919f5a3342b19: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 13:03:41.053064 10339 tablet_replica.cc:439] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "93e0f5c2800a4e7cb522c56114b61324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } } }
I20260809 13:03:41.053392 10339 tablet_replica.cc:442] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324: This TxnStatusTablet replica's current role is: LEADER
I20260809 13:03:41.053745 10279 tablet_replica.cc:439] T 6812ea45fec04653949d8cf6f92eb776 P 22b5a2b099ae474b93f8e215f4028dd9: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "93e0f5c2800a4e7cb522c56114b61324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } } }
I20260809 13:03:41.053992 10279 tablet_replica.cc:442] T 6812ea45fec04653949d8cf6f92eb776 P 22b5a2b099ae474b93f8e215f4028dd9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 13:03:41.058327 10339 tablet_replica.cc:439] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "93e0f5c2800a4e7cb522c56114b61324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } } }
I20260809 13:03:41.058620 10339 tablet_replica.cc:442] T 6812ea45fec04653949d8cf6f92eb776 P 93e0f5c2800a4e7cb522c56114b61324: This TxnStatusTablet replica's current role is: LEADER
I20260809 13:03:41.059237 10278 tablet_replica.cc:439] T 6812ea45fec04653949d8cf6f92eb776 P 69cc3e329c5643e5997919f5a3342b19: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "93e0f5c2800a4e7cb522c56114b61324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } } }
I20260809 13:03:41.059490 10278 tablet_replica.cc:442] T 6812ea45fec04653949d8cf6f92eb776 P 69cc3e329c5643e5997919f5a3342b19: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 13:03:41.079140 10349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:41.073133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:59329 (local address 127.28.155.193:42147)
0809 13:03:41.073371 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:41.073402 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:41.073725 (+ 323us) server_negotiation.cc:407] Connection header received
0809 13:03:41.073953 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:41.073959 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:41.074039 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:41.074142 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:03:41.074662 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.075777 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.077275 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.077744 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.077891 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:41.078342 (+ 451us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:03:41.078464 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:03:41.078565 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:41.078712 (+ 147us) server_negotiation.cc:299] Negotiation successful
0809 13:03:41.078799 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 13:03:41.079216 10363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:41.072990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:42147 (local address 127.28.155.195:59329)
0809 13:03:41.073589 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:41.073605 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:41.073797 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:41.074159 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:41.074164 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:41.074176 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 13:03:41.074485 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:41.074495 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.076003 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.076007 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:41.077131 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:41.077146 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.077911 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.077917 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:41.078080 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:41.078142 (+ 62us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 13:03:41.078570 (+ 428us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 13:03:41.078585 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 13:03:41.078686 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 13:03:41.078839 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":288,"threads_started":1}
I20260809 13:03:41.125429 10335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:41.118626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:48463 (local address 127.28.155.195:44333)
0809 13:03:41.118848 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:41.118855 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:41.119365 (+ 510us) server_negotiation.cc:407] Connection header received
0809 13:03:41.119513 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:41.119519 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:41.119619 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:41.119720 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:03:41.120210 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.121364 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.123314 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.124008 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.124140 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:41.124600 (+ 460us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:03:41.124739 (+ 139us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:03:41.124832 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:41.125030 (+ 198us) server_negotiation.cc:299] Negotiation successful
0809 13:03:41.125121 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 13:03:41.125594 10369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:41.118097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:44333 (local address 127.28.155.193:48463)
0809 13:03:41.119254 (+ 1157us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:41.119271 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:41.119408 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:41.119739 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:41.119742 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:41.119751 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 13:03:41.120038 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:41.120049 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.121514 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.121518 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:41.123169 (+ 1651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:41.123183 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.124157 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.124161 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:41.124312 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:41.124372 (+ 60us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 13:03:41.124859 (+ 487us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 13:03:41.124885 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 13:03:41.124985 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 13:03:41.125147 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":945,"thread_start_us":791,"threads_started":1}
I20260809 13:03:41.162354 9490 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55074:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:03:41.162598 9490 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55074:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:03:41.166193 9490 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 957868b5ea3f4caf803efe9a4e5b30d0: Sending DeleteTablet for 3 replicas of tablet baa95bfd68ea4b10bbb72805bf4b217e
I20260809 13:03:41.167110 10134 tablet_service.cc:1514] Processing DeleteTablet for tablet baa95bfd68ea4b10bbb72805bf4b217e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:03:41 UTC) from {username='oryx', principal='oryx/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:41498
I20260809 13:03:41.167131 9916 tablet_service.cc:1514] Processing DeleteTablet for tablet baa95bfd68ea4b10bbb72805bf4b217e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:03:41 UTC) from {username='oryx', principal='oryx/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:49318
I20260809 13:03:41.168156 9715 tablet_service.cc:1514] Processing DeleteTablet for tablet baa95bfd68ea4b10bbb72805bf4b217e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:03:41 UTC) from {username='oryx', principal='oryx/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:40452
I20260809 13:03:41.178860 10375 tablet_replica.cc:330] T baa95bfd68ea4b10bbb72805bf4b217e P 22b5a2b099ae474b93f8e215f4028dd9: stopping tablet replica
I20260809 13:03:41.179152 10375 raft_consensus.cc:2229] T baa95bfd68ea4b10bbb72805bf4b217e P 22b5a2b099ae474b93f8e215f4028dd9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:03:41.179512 10375 raft_consensus.cc:2258] T baa95bfd68ea4b10bbb72805bf4b217e P 22b5a2b099ae474b93f8e215f4028dd9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:03:41.180930 10375 ts_tablet_manager.cc:1905] T baa95bfd68ea4b10bbb72805bf4b217e P 22b5a2b099ae474b93f8e215f4028dd9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:03:41.188362 10375 ts_tablet_manager.cc:1918] T baa95bfd68ea4b10bbb72805bf4b217e P 22b5a2b099ae474b93f8e215f4028dd9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 13:03:41.188596 10375 log.cc:1196] T baa95bfd68ea4b10bbb72805bf4b217e P 22b5a2b099ae474b93f8e215f4028dd9: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-1/wal/wals/baa95bfd68ea4b10bbb72805bf4b217e
I20260809 13:03:41.189055 10375 ts_tablet_manager.cc:1939] T baa95bfd68ea4b10bbb72805bf4b217e P 22b5a2b099ae474b93f8e215f4028dd9: Deleting consensus metadata
I20260809 13:03:41.190167 9464 catalog_manager.cc:4841] TS 22b5a2b099ae474b93f8e215f4028dd9 (127.28.155.194:36975): tablet baa95bfd68ea4b10bbb72805bf4b217e (table test-table [id=ea8ab090211344e7823b76be9d58ef56]) successfully deleted
I20260809 13:03:41.191946 10374 tablet_replica.cc:330] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19: stopping tablet replica
I20260809 13:03:41.192188 10374 raft_consensus.cc:2229] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19 [term 1 LEADER]: Raft consensus shutting down.
I20260809 13:03:41.192719 10374 raft_consensus.cc:2258] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:03:41.193476 10377 tablet_replica.cc:330] T baa95bfd68ea4b10bbb72805bf4b217e P 93e0f5c2800a4e7cb522c56114b61324: stopping tablet replica
I20260809 13:03:41.193701 10377 raft_consensus.cc:2229] T baa95bfd68ea4b10bbb72805bf4b217e P 93e0f5c2800a4e7cb522c56114b61324 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:03:41.194017 10377 raft_consensus.cc:2258] T baa95bfd68ea4b10bbb72805bf4b217e P 93e0f5c2800a4e7cb522c56114b61324 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:03:41.195003 10374 ts_tablet_manager.cc:1905] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:03:41.201364 10377 ts_tablet_manager.cc:1905] T baa95bfd68ea4b10bbb72805bf4b217e P 93e0f5c2800a4e7cb522c56114b61324: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:03:41.203675 10374 ts_tablet_manager.cc:1918] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 13:03:41.203920 10374 log.cc:1196] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-2/wal/wals/baa95bfd68ea4b10bbb72805bf4b217e
I20260809 13:03:41.204519 10374 ts_tablet_manager.cc:1939] T baa95bfd68ea4b10bbb72805bf4b217e P 69cc3e329c5643e5997919f5a3342b19: Deleting consensus metadata
I20260809 13:03:41.206025 9467 catalog_manager.cc:4841] TS 69cc3e329c5643e5997919f5a3342b19 (127.28.155.195:44333): tablet baa95bfd68ea4b10bbb72805bf4b217e (table test-table [id=ea8ab090211344e7823b76be9d58ef56]) successfully deleted
I20260809 13:03:41.209939 10377 ts_tablet_manager.cc:1918] T baa95bfd68ea4b10bbb72805bf4b217e P 93e0f5c2800a4e7cb522c56114b61324: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 13:03:41.210114 10377 log.cc:1196] T baa95bfd68ea4b10bbb72805bf4b217e P 93e0f5c2800a4e7cb522c56114b61324: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-0/wal/wals/baa95bfd68ea4b10bbb72805bf4b217e
I20260809 13:03:41.210640 10377 ts_tablet_manager.cc:1939] T baa95bfd68ea4b10bbb72805bf4b217e P 93e0f5c2800a4e7cb522c56114b61324: Deleting consensus metadata
I20260809 13:03:41.211930 9467 catalog_manager.cc:4841] TS 93e0f5c2800a4e7cb522c56114b61324 (127.28.155.193:42147): tablet baa95bfd68ea4b10bbb72805bf4b217e (table test-table [id=ea8ab090211344e7823b76be9d58ef56]) successfully deleted
Aug 09 13:03:41 dist-test-slave-jq4t krb5kdc[9417](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280621, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 13:03:41 dist-test-slave-jq4t krb5kdc[9417](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:41 dist-test-slave-jq4t krb5kdc[9417](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
W20260809 13:03:41.260665 10388 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:41.248199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55092 (local address 127.28.155.254:45637)
0809 13:03:41.249040 (+ 841us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:41.249047 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:41.249271 (+ 224us) server_negotiation.cc:407] Connection header received
0809 13:03:41.249428 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:41.249434 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:41.249545 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:41.249687 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:41.251175 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.252392 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.253740 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.254438 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.254582 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:41.260292 (+ 5710us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55092: BlockingRecv error: recv got EOF from 127.0.0.1:55092 (error 108)
Metrics: {"server-negotiator.queue_time_us":654,"thread_start_us":361,"threads_started":1}
Aug 09 13:03:41 dist-test-slave-jq4t krb5kdc[9417](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280621, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM
I20260809 13:03:41.281613 10388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:41.263592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55102 (local address 127.28.155.254:45637)
0809 13:03:41.263819 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:41.263825 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:41.264141 (+ 316us) server_negotiation.cc:407] Connection header received
0809 13:03:41.264347 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:41.264351 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:41.264422 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:41.264625 (+ 203us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:41.266283 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.267178 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.269102 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.269527 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.269632 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:41.274303 (+ 4671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:41.274310 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:41.274314 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:41.274360 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:41.278436 (+ 4076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:41.279316 (+ 880us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:41.279325 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:41.279329 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:41.279531 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:41.279932 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:41.279937 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:41.279940 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:41.280320 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:41.280617 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:41.280975 (+ 358us) server_negotiation.cc:299] Negotiation successful
0809 13:03:41.281232 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 13:03:41.286072 9490 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55102:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 13:03:41.286868 9490 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:03:41.295110 9715 tablet_service.cc:1467] Processing CreateTablet for tablet c962ebd6670d4d098308102d3c808cae (DEFAULT_TABLE table=test-table [id=07265146142b40128aad21d8bc944365]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:03:41.295297 9916 tablet_service.cc:1467] Processing CreateTablet for tablet c962ebd6670d4d098308102d3c808cae (DEFAULT_TABLE table=test-table [id=07265146142b40128aad21d8bc944365]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:03:41.295703 9715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c962ebd6670d4d098308102d3c808cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:41.295735 9916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c962ebd6670d4d098308102d3c808cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:41.297230 10134 tablet_service.cc:1467] Processing CreateTablet for tablet c962ebd6670d4d098308102d3c808cae (DEFAULT_TABLE table=test-table [id=07265146142b40128aad21d8bc944365]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:03:41.297710 10134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c962ebd6670d4d098308102d3c808cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:41.311508 10396 tablet_bootstrap.cc:492] T c962ebd6670d4d098308102d3c808cae P 69cc3e329c5643e5997919f5a3342b19: Bootstrap starting.
I20260809 13:03:41.316361 10397 tablet_bootstrap.cc:492] T c962ebd6670d4d098308102d3c808cae P 22b5a2b099ae474b93f8e215f4028dd9: Bootstrap starting.
I20260809 13:03:41.316850 10396 tablet_bootstrap.cc:654] T c962ebd6670d4d098308102d3c808cae P 69cc3e329c5643e5997919f5a3342b19: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:41.319231 10397 tablet_bootstrap.cc:654] T c962ebd6670d4d098308102d3c808cae P 22b5a2b099ae474b93f8e215f4028dd9: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:41.321166 10394 tablet_bootstrap.cc:492] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324: Bootstrap starting.
I20260809 13:03:41.323228 10396 tablet_bootstrap.cc:492] T c962ebd6670d4d098308102d3c808cae P 69cc3e329c5643e5997919f5a3342b19: No bootstrap required, opened a new log
I20260809 13:03:41.323426 10396 ts_tablet_manager.cc:1397] T c962ebd6670d4d098308102d3c808cae P 69cc3e329c5643e5997919f5a3342b19: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20260809 13:03:41.323939 10394 tablet_bootstrap.cc:654] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:41.324508 10396 raft_consensus.cc:348] T c962ebd6670d4d098308102d3c808cae P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:41.325277 10396 raft_consensus.cc:374] T c962ebd6670d4d098308102d3c808cae P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:41.325397 10396 raft_consensus.cc:729] T c962ebd6670d4d098308102d3c808cae P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69cc3e329c5643e5997919f5a3342b19, State: Initialized, Role: FOLLOWER
I20260809 13:03:41.325821 10396 consensus_queue.cc:260] T c962ebd6670d4d098308102d3c808cae P 69cc3e329c5643e5997919f5a3342b19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:41.326547 10396 ts_tablet_manager.cc:1428] T c962ebd6670d4d098308102d3c808cae P 69cc3e329c5643e5997919f5a3342b19: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 13:03:41.328917 10394 tablet_bootstrap.cc:492] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324: No bootstrap required, opened a new log
I20260809 13:03:41.329208 10394 ts_tablet_manager.cc:1397] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260809 13:03:41.330309 10394 raft_consensus.cc:348] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:41.330729 10394 raft_consensus.cc:374] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:41.330848 10397 tablet_bootstrap.cc:492] T c962ebd6670d4d098308102d3c808cae P 22b5a2b099ae474b93f8e215f4028dd9: No bootstrap required, opened a new log
I20260809 13:03:41.330996 10394 raft_consensus.cc:729] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93e0f5c2800a4e7cb522c56114b61324, State: Initialized, Role: FOLLOWER
I20260809 13:03:41.331049 10397 ts_tablet_manager.cc:1397] T c962ebd6670d4d098308102d3c808cae P 22b5a2b099ae474b93f8e215f4028dd9: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.004s
I20260809 13:03:41.331435 10394 consensus_queue.cc:260] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:41.332240 10394 ts_tablet_manager.cc:1428] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260809 13:03:41.332643 10397 raft_consensus.cc:348] T c962ebd6670d4d098308102d3c808cae P 22b5a2b099ae474b93f8e215f4028dd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:41.332935 10397 raft_consensus.cc:374] T c962ebd6670d4d098308102d3c808cae P 22b5a2b099ae474b93f8e215f4028dd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:41.333050 10397 raft_consensus.cc:729] T c962ebd6670d4d098308102d3c808cae P 22b5a2b099ae474b93f8e215f4028dd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22b5a2b099ae474b93f8e215f4028dd9, State: Initialized, Role: FOLLOWER
I20260809 13:03:41.333323 10397 consensus_queue.cc:260] T c962ebd6670d4d098308102d3c808cae P 22b5a2b099ae474b93f8e215f4028dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:41.333961 10397 ts_tablet_manager.cc:1428] T c962ebd6670d4d098308102d3c808cae P 22b5a2b099ae474b93f8e215f4028dd9: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260809 13:03:41.386926 10365 raft_consensus.cc:482] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:03:41.387240 10365 raft_consensus.cc:504] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:41.388309 10365 leader_election.cc:288] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22b5a2b099ae474b93f8e215f4028dd9 (127.28.155.194:36975), 69cc3e329c5643e5997919f5a3342b19 (127.28.155.195:44333)
I20260809 13:03:41.389266 9958 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c962ebd6670d4d098308102d3c808cae" candidate_uuid: "93e0f5c2800a4e7cb522c56114b61324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22b5a2b099ae474b93f8e215f4028dd9" is_pre_election: true
I20260809 13:03:41.389587 9958 raft_consensus.cc:2454] T c962ebd6670d4d098308102d3c808cae P 22b5a2b099ae474b93f8e215f4028dd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93e0f5c2800a4e7cb522c56114b61324 in term 0.
I20260809 13:03:41.390425 9634 leader_election.cc:302] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22b5a2b099ae474b93f8e215f4028dd9, 93e0f5c2800a4e7cb522c56114b61324; no voters:
I20260809 13:03:41.390357 10170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c962ebd6670d4d098308102d3c808cae" candidate_uuid: "93e0f5c2800a4e7cb522c56114b61324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69cc3e329c5643e5997919f5a3342b19" is_pre_election: true
I20260809 13:03:41.390633 10170 raft_consensus.cc:2454] T c962ebd6670d4d098308102d3c808cae P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93e0f5c2800a4e7cb522c56114b61324 in term 0.
I20260809 13:03:41.390717 10365 raft_consensus.cc:2781] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:03:41.390870 10365 raft_consensus.cc:482] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:03:41.390988 10365 raft_consensus.cc:3037] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:41.393724 10365 raft_consensus.cc:504] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:41.394433 10365 leader_election.cc:288] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324 [CANDIDATE]: Term 1 election: Requested vote from peers 22b5a2b099ae474b93f8e215f4028dd9 (127.28.155.194:36975), 69cc3e329c5643e5997919f5a3342b19 (127.28.155.195:44333)
I20260809 13:03:41.395027 9958 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c962ebd6670d4d098308102d3c808cae" candidate_uuid: "93e0f5c2800a4e7cb522c56114b61324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22b5a2b099ae474b93f8e215f4028dd9"
I20260809 13:03:41.395110 10170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c962ebd6670d4d098308102d3c808cae" candidate_uuid: "93e0f5c2800a4e7cb522c56114b61324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69cc3e329c5643e5997919f5a3342b19"
I20260809 13:03:41.395328 9958 raft_consensus.cc:3037] T c962ebd6670d4d098308102d3c808cae P 22b5a2b099ae474b93f8e215f4028dd9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:41.395327 10170 raft_consensus.cc:3037] T c962ebd6670d4d098308102d3c808cae P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:41.398602 10170 raft_consensus.cc:2454] T c962ebd6670d4d098308102d3c808cae P 69cc3e329c5643e5997919f5a3342b19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93e0f5c2800a4e7cb522c56114b61324 in term 1.
I20260809 13:03:41.398593 9958 raft_consensus.cc:2454] T c962ebd6670d4d098308102d3c808cae P 22b5a2b099ae474b93f8e215f4028dd9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93e0f5c2800a4e7cb522c56114b61324 in term 1.
I20260809 13:03:41.399181 9634 leader_election.cc:302] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22b5a2b099ae474b93f8e215f4028dd9, 93e0f5c2800a4e7cb522c56114b61324; no voters:
I20260809 13:03:41.399595 10365 raft_consensus.cc:2781] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:03:41.399883 10365 raft_consensus.cc:686] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324 [term 1 LEADER]: Becoming Leader. State: Replica: 93e0f5c2800a4e7cb522c56114b61324, State: Running, Role: LEADER
I20260809 13:03:41.400228 10365 consensus_queue.cc:237] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:41.404177 9487 catalog_manager.cc:5495] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93e0f5c2800a4e7cb522c56114b61324 (127.28.155.193). New cstate: current_term: 1 leader_uuid: "93e0f5c2800a4e7cb522c56114b61324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } health_report { overall_health: UNKNOWN } } }
I20260809 13:03:41.440735 10349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:41.434940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40464 (local address 127.28.155.193:42147)
0809 13:03:41.435186 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:41.435192 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:41.435218 (+ 26us) server_negotiation.cc:407] Connection header received
0809 13:03:41.435303 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:41.435309 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:41.435432 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:41.435558 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:03:41.435887 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.437129 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.438625 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.439307 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.439446 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:41.439829 (+ 383us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:03:41.439974 (+ 145us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:03:41.440086 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:41.440230 (+ 144us) server_negotiation.cc:299] Negotiation successful
0809 13:03:41.440322 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260809 13:03:41.444865 9958 raft_consensus.cc:1261] T c962ebd6670d4d098308102d3c808cae P 22b5a2b099ae474b93f8e215f4028dd9 [term 1 FOLLOWER]: Refusing update from remote peer 93e0f5c2800a4e7cb522c56114b61324: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:03:41.444861 10170 raft_consensus.cc:1261] T c962ebd6670d4d098308102d3c808cae P 69cc3e329c5643e5997919f5a3342b19 [term 1 FOLLOWER]: Refusing update from remote peer 93e0f5c2800a4e7cb522c56114b61324: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:03:41.445600 10365 consensus_queue.cc:1035] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:03:41.445932 10280 consensus_queue.cc:1035] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:03:41.460748 9490 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55102:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:03:41.461048 9490 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55102:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:03:41.465647 9490 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 957868b5ea3f4caf803efe9a4e5b30d0: Sending DeleteTablet for 3 replicas of tablet c962ebd6670d4d098308102d3c808cae
I20260809 13:03:41.466231 9715 tablet_service.cc:1514] Processing DeleteTablet for tablet c962ebd6670d4d098308102d3c808cae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:03:41 UTC) from {username='oryx', principal='oryx/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:40452
I20260809 13:03:41.466537 10377 tablet_replica.cc:330] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324: stopping tablet replica
I20260809 13:03:41.466748 10377 raft_consensus.cc:2229] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324 [term 1 LEADER]: Raft consensus shutting down.
I20260809 13:03:41.467010 9916 tablet_service.cc:1514] Processing DeleteTablet for tablet c962ebd6670d4d098308102d3c808cae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:03:41 UTC) from {username='oryx', principal='oryx/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:49318
I20260809 13:03:41.467303 10375 tablet_replica.cc:330] T c962ebd6670d4d098308102d3c808cae P 22b5a2b099ae474b93f8e215f4028dd9: stopping tablet replica
I20260809 13:03:41.467304 10377 raft_consensus.cc:2258] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:03:41.467542 10375 raft_consensus.cc:2229] T c962ebd6670d4d098308102d3c808cae P 22b5a2b099ae474b93f8e215f4028dd9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:03:41.467800 10375 raft_consensus.cc:2258] T c962ebd6670d4d098308102d3c808cae P 22b5a2b099ae474b93f8e215f4028dd9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:03:41.468411 10134 tablet_service.cc:1514] Processing DeleteTablet for tablet c962ebd6670d4d098308102d3c808cae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:03:41 UTC) from {username='oryx', principal='oryx/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:41498
I20260809 13:03:41.468739 10374 tablet_replica.cc:330] T c962ebd6670d4d098308102d3c808cae P 69cc3e329c5643e5997919f5a3342b19: stopping tablet replica
I20260809 13:03:41.468953 10374 raft_consensus.cc:2229] T c962ebd6670d4d098308102d3c808cae P 69cc3e329c5643e5997919f5a3342b19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:03:41.469156 10375 ts_tablet_manager.cc:1905] T c962ebd6670d4d098308102d3c808cae P 22b5a2b099ae474b93f8e215f4028dd9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:03:41.469185 10374 raft_consensus.cc:2258] T c962ebd6670d4d098308102d3c808cae P 69cc3e329c5643e5997919f5a3342b19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:03:41.469456 9715 tablet_service.cc:1514] Processing DeleteTablet for tablet c962ebd6670d4d098308102d3c808cae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:03:41 UTC) from {username='oryx', principal='oryx/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:40452
I20260809 13:03:41.469770 10134 tablet_service.cc:1514] Processing DeleteTablet for tablet c962ebd6670d4d098308102d3c808cae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:03:41 UTC) from {username='oryx', principal='oryx/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:41498
I20260809 13:03:41.470577 10377 ts_tablet_manager.cc:1905] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:03:41.474920 10374 ts_tablet_manager.cc:1905] T c962ebd6670d4d098308102d3c808cae P 69cc3e329c5643e5997919f5a3342b19: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:03:41.474767 9487 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55102:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 13:03:41.475520 9487 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:03:41.477316 10375 ts_tablet_manager.cc:1918] T c962ebd6670d4d098308102d3c808cae P 22b5a2b099ae474b93f8e215f4028dd9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:03:41.477492 10375 log.cc:1196] T c962ebd6670d4d098308102d3c808cae P 22b5a2b099ae474b93f8e215f4028dd9: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-1/wal/wals/c962ebd6670d4d098308102d3c808cae
I20260809 13:03:41.477885 10375 ts_tablet_manager.cc:1939] T c962ebd6670d4d098308102d3c808cae P 22b5a2b099ae474b93f8e215f4028dd9: Deleting consensus metadata
I20260809 13:03:41.478912 9464 catalog_manager.cc:4841] TS 22b5a2b099ae474b93f8e215f4028dd9 (127.28.155.194:36975): tablet c962ebd6670d4d098308102d3c808cae (table test-table [id=07265146142b40128aad21d8bc944365]) successfully deleted
I20260809 13:03:41.482561 10374 ts_tablet_manager.cc:1918] T c962ebd6670d4d098308102d3c808cae P 69cc3e329c5643e5997919f5a3342b19: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:03:41.482729 10374 log.cc:1196] T c962ebd6670d4d098308102d3c808cae P 69cc3e329c5643e5997919f5a3342b19: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-2/wal/wals/c962ebd6670d4d098308102d3c808cae
I20260809 13:03:41.483124 10374 ts_tablet_manager.cc:1939] T c962ebd6670d4d098308102d3c808cae P 69cc3e329c5643e5997919f5a3342b19: Deleting consensus metadata
I20260809 13:03:41.484359 9467 catalog_manager.cc:4841] TS 69cc3e329c5643e5997919f5a3342b19 (127.28.155.195:44333): tablet c962ebd6670d4d098308102d3c808cae (table test-table [id=07265146142b40128aad21d8bc944365]) successfully deleted
W20260809 13:03:41.484889 9467 catalog_manager.cc:4808] TS 69cc3e329c5643e5997919f5a3342b19 (127.28.155.195:44333): delete failed for tablet c962ebd6670d4d098308102d3c808cae because the tablet was not found. No further retry: Not found: Tablet not found: c962ebd6670d4d098308102d3c808cae
I20260809 13:03:41.487084 10377 ts_tablet_manager.cc:1918] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:03:41.487293 10377 log.cc:1196] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-0/wal/wals/c962ebd6670d4d098308102d3c808cae
I20260809 13:03:41.487804 10377 ts_tablet_manager.cc:1939] T c962ebd6670d4d098308102d3c808cae P 93e0f5c2800a4e7cb522c56114b61324: Deleting consensus metadata
I20260809 13:03:41.488674 10134 tablet_service.cc:1467] Processing CreateTablet for tablet 084614313ecc4408ab963966c5acd226 (DEFAULT_TABLE table=test-table [id=3983a43ca01b4551a3282a0e6d229a9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:03:41.488685 9715 tablet_service.cc:1467] Processing CreateTablet for tablet 084614313ecc4408ab963966c5acd226 (DEFAULT_TABLE table=test-table [id=3983a43ca01b4551a3282a0e6d229a9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:03:41.489140 10134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 084614313ecc4408ab963966c5acd226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:41.489145 9715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 084614313ecc4408ab963966c5acd226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:41.490141 9467 catalog_manager.cc:4841] TS 93e0f5c2800a4e7cb522c56114b61324 (127.28.155.193:42147): tablet c962ebd6670d4d098308102d3c808cae (table test-table [id=07265146142b40128aad21d8bc944365]) successfully deleted
W20260809 13:03:41.490424 9467 catalog_manager.cc:4808] TS 93e0f5c2800a4e7cb522c56114b61324 (127.28.155.193:42147): delete failed for tablet c962ebd6670d4d098308102d3c808cae because the tablet was not found. No further retry: Not found: Tablet not found: c962ebd6670d4d098308102d3c808cae
I20260809 13:03:41.491732 9916 tablet_service.cc:1467] Processing CreateTablet for tablet 084614313ecc4408ab963966c5acd226 (DEFAULT_TABLE table=test-table [id=3983a43ca01b4551a3282a0e6d229a9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:03:41.492304 9916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 084614313ecc4408ab963966c5acd226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:03:41.496209 10396 tablet_bootstrap.cc:492] T 084614313ecc4408ab963966c5acd226 P 69cc3e329c5643e5997919f5a3342b19: Bootstrap starting.
I20260809 13:03:41.497818 10396 tablet_bootstrap.cc:654] T 084614313ecc4408ab963966c5acd226 P 69cc3e329c5643e5997919f5a3342b19: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:41.499056 10397 tablet_bootstrap.cc:492] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9: Bootstrap starting.
I20260809 13:03:41.500770 10397 tablet_bootstrap.cc:654] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:41.501974 10394 tablet_bootstrap.cc:492] T 084614313ecc4408ab963966c5acd226 P 93e0f5c2800a4e7cb522c56114b61324: Bootstrap starting.
I20260809 13:03:41.506836 10394 tablet_bootstrap.cc:654] T 084614313ecc4408ab963966c5acd226 P 93e0f5c2800a4e7cb522c56114b61324: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:41.511103 10396 tablet_bootstrap.cc:492] T 084614313ecc4408ab963966c5acd226 P 69cc3e329c5643e5997919f5a3342b19: No bootstrap required, opened a new log
I20260809 13:03:41.511302 10396 ts_tablet_manager.cc:1397] T 084614313ecc4408ab963966c5acd226 P 69cc3e329c5643e5997919f5a3342b19: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.006s
I20260809 13:03:41.512184 10396 raft_consensus.cc:348] T 084614313ecc4408ab963966c5acd226 P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:41.512516 10396 raft_consensus.cc:374] T 084614313ecc4408ab963966c5acd226 P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:41.512607 10396 raft_consensus.cc:729] T 084614313ecc4408ab963966c5acd226 P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69cc3e329c5643e5997919f5a3342b19, State: Initialized, Role: FOLLOWER
I20260809 13:03:41.512804 10394 tablet_bootstrap.cc:492] T 084614313ecc4408ab963966c5acd226 P 93e0f5c2800a4e7cb522c56114b61324: No bootstrap required, opened a new log
I20260809 13:03:41.513006 10394 ts_tablet_manager.cc:1397] T 084614313ecc4408ab963966c5acd226 P 93e0f5c2800a4e7cb522c56114b61324: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.005s
I20260809 13:03:41.512873 10396 consensus_queue.cc:260] T 084614313ecc4408ab963966c5acd226 P 69cc3e329c5643e5997919f5a3342b19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:41.513504 10396 ts_tablet_manager.cc:1428] T 084614313ecc4408ab963966c5acd226 P 69cc3e329c5643e5997919f5a3342b19: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260809 13:03:41.514775 10397 tablet_bootstrap.cc:492] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9: No bootstrap required, opened a new log
I20260809 13:03:41.514961 10397 ts_tablet_manager.cc:1397] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.005s
I20260809 13:03:41.515837 10397 raft_consensus.cc:348] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:41.516139 10397 raft_consensus.cc:374] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:41.516230 10397 raft_consensus.cc:729] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22b5a2b099ae474b93f8e215f4028dd9, State: Initialized, Role: FOLLOWER
I20260809 13:03:41.516690 10397 consensus_queue.cc:260] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:41.516660 10394 raft_consensus.cc:348] T 084614313ecc4408ab963966c5acd226 P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:41.516963 10394 raft_consensus.cc:374] T 084614313ecc4408ab963966c5acd226 P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:41.517058 10394 raft_consensus.cc:729] T 084614313ecc4408ab963966c5acd226 P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93e0f5c2800a4e7cb522c56114b61324, State: Initialized, Role: FOLLOWER
I20260809 13:03:41.517282 10397 ts_tablet_manager.cc:1428] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 13:03:41.517366 10394 consensus_queue.cc:260] T 084614313ecc4408ab963966c5acd226 P 93e0f5c2800a4e7cb522c56114b61324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:41.518159 10394 ts_tablet_manager.cc:1428] T 084614313ecc4408ab963966c5acd226 P 93e0f5c2800a4e7cb522c56114b61324: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260809 13:03:41.649753 10279 raft_consensus.cc:482] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:03:41.650012 10279 raft_consensus.cc:504] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:41.651963 10279 leader_election.cc:288] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93e0f5c2800a4e7cb522c56114b61324 (127.28.155.193:42147), 69cc3e329c5643e5997919f5a3342b19 (127.28.155.195:44333)
I20260809 13:03:41.661614 10349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:41.652312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:37063 (local address 127.28.155.193:42147)
0809 13:03:41.652590 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:41.652597 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:41.653337 (+ 740us) server_negotiation.cc:407] Connection header received
0809 13:03:41.653429 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:41.653434 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:41.653555 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:41.653664 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:03:41.654651 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.655789 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.658593 (+ 2804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.660001 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.660145 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:41.660227 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:41.661090 (+ 863us) server_negotiation.cc:299] Negotiation successful
0809 13:03:41.661251 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 13:03:41.662122 10419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:41.652221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:42147 (local address 127.28.155.194:37063)
0809 13:03:41.652830 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:41.652853 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:41.653001 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:41.654120 (+ 1119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:41.654126 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:41.654158 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:03:41.654418 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:41.654431 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.656031 (+ 1600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.656036 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:41.658376 (+ 2340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:41.658394 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.660394 (+ 2000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.660403 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:41.660633 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:41.660677 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 13:03:41.660778 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 13:03:41.660930 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":314,"threads_started":1}
I20260809 13:03:41.662879 9746 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "084614313ecc4408ab963966c5acd226" candidate_uuid: "22b5a2b099ae474b93f8e215f4028dd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93e0f5c2800a4e7cb522c56114b61324" is_pre_election: true
I20260809 13:03:41.663183 9746 raft_consensus.cc:2454] T 084614313ecc4408ab963966c5acd226 P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22b5a2b099ae474b93f8e215f4028dd9 in term 0.
I20260809 13:03:41.663830 9846 leader_election.cc:302] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22b5a2b099ae474b93f8e215f4028dd9, 93e0f5c2800a4e7cb522c56114b61324; no voters:
I20260809 13:03:41.664328 10279 raft_consensus.cc:2781] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:03:41.664532 10279 raft_consensus.cc:482] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:03:41.664660 10279 raft_consensus.cc:3037] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:41.668695 10279 raft_consensus.cc:504] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:41.669510 10279 leader_election.cc:288] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9 [CANDIDATE]: Term 1 election: Requested vote from peers 93e0f5c2800a4e7cb522c56114b61324 (127.28.155.193:42147), 69cc3e329c5643e5997919f5a3342b19 (127.28.155.195:44333)
I20260809 13:03:41.670230 10422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:41.653171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:41449 (local address 127.28.155.195:44333)
0809 13:03:41.653717 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:41.653727 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:41.661670 (+ 7943us) server_negotiation.cc:407] Connection header received
0809 13:03:41.661928 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:41.661934 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:41.662043 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:41.662150 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:03:41.662968 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.663959 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.667168 (+ 3209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.668510 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.668672 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:41.668794 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:41.669591 (+ 797us) server_negotiation.cc:299] Negotiation successful
0809 13:03:41.669804 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":3333,"threads_started":1}
I20260809 13:03:41.670365 9746 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "084614313ecc4408ab963966c5acd226" candidate_uuid: "22b5a2b099ae474b93f8e215f4028dd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93e0f5c2800a4e7cb522c56114b61324"
I20260809 13:03:41.670660 9746 raft_consensus.cc:3037] T 084614313ecc4408ab963966c5acd226 P 93e0f5c2800a4e7cb522c56114b61324 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:41.671181 10420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:41.653009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:44333 (local address 127.28.155.194:41449)
0809 13:03:41.661543 (+ 8534us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:41.661561 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:41.661719 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:41.662375 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:41.662382 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:41.662417 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:03:41.662752 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:41.662768 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.664177 (+ 1409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.664182 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:41.666893 (+ 2711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:41.666913 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.669074 (+ 2161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.669084 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:41.669323 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:41.669370 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 13:03:41.670470 (+ 1100us) client_negotiation.cc:240] Negotiation successful
0809 13:03:41.670672 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8418,"thread_start_us":8225,"threads_started":1}
I20260809 13:03:41.673441 10170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "084614313ecc4408ab963966c5acd226" candidate_uuid: "22b5a2b099ae474b93f8e215f4028dd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69cc3e329c5643e5997919f5a3342b19" is_pre_election: true
I20260809 13:03:41.673658 10167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "084614313ecc4408ab963966c5acd226" candidate_uuid: "22b5a2b099ae474b93f8e215f4028dd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69cc3e329c5643e5997919f5a3342b19"
I20260809 13:03:41.673744 10170 raft_consensus.cc:2454] T 084614313ecc4408ab963966c5acd226 P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22b5a2b099ae474b93f8e215f4028dd9 in term 0.
I20260809 13:03:41.674973 9746 raft_consensus.cc:2454] T 084614313ecc4408ab963966c5acd226 P 93e0f5c2800a4e7cb522c56114b61324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22b5a2b099ae474b93f8e215f4028dd9 in term 1.
I20260809 13:03:41.675463 9846 leader_election.cc:302] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22b5a2b099ae474b93f8e215f4028dd9, 93e0f5c2800a4e7cb522c56114b61324; no voters: 69cc3e329c5643e5997919f5a3342b19
I20260809 13:03:41.675836 10279 raft_consensus.cc:2781] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:03:41.676405 10279 raft_consensus.cc:686] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9 [term 1 LEADER]: Becoming Leader. State: Replica: 22b5a2b099ae474b93f8e215f4028dd9, State: Running, Role: LEADER
I20260809 13:03:41.676939 10279 consensus_queue.cc:237] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } }
I20260809 13:03:41.681391 9490 catalog_manager.cc:5495] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22b5a2b099ae474b93f8e215f4028dd9 (127.28.155.194). New cstate: current_term: 1 leader_uuid: "22b5a2b099ae474b93f8e215f4028dd9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22b5a2b099ae474b93f8e215f4028dd9" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 36975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 } health_report { overall_health: UNKNOWN } } }
I20260809 13:03:41.732717 10429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:41.717149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49322 (local address 127.28.155.194:36975)
0809 13:03:41.724607 (+ 7458us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:41.724616 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:41.724645 (+ 29us) server_negotiation.cc:407] Connection header received
0809 13:03:41.724777 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:41.724782 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:41.724938 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:41.725302 (+ 364us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:03:41.725832 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.727116 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.729268 (+ 2152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.729973 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.730110 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:41.730743 (+ 633us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:03:41.731662 (+ 919us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:03:41.731821 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:41.731967 (+ 146us) server_negotiation.cc:299] Negotiation successful
0809 13:03:41.732068 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7241,"thread_start_us":7072,"threads_started":1}
I20260809 13:03:41.754987 10433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:41.745683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:42147 (local address 127.28.155.194:34621)
0809 13:03:41.749068 (+ 3385us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:41.749088 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:41.749246 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:41.749644 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:41.749647 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:41.749657 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 13:03:41.749967 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:41.749975 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.751356 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.751360 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:41.752783 (+ 1423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:41.752799 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.753830 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.753835 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:41.753966 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:41.754032 (+ 66us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 13:03:41.754462 (+ 430us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 13:03:41.754473 (+ 11us) client_negotiation.cc:769] Sending connection context
0809 13:03:41.754542 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 13:03:41.754662 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3206,"thread_start_us":3027,"threads_started":1}
I20260809 13:03:41.755020 10349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:41.745798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:34621 (local address 127.28.155.193:42147)
0809 13:03:41.746029 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:41.746036 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:41.749215 (+ 3179us) server_negotiation.cc:407] Connection header received
0809 13:03:41.749379 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:41.749385 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:41.749511 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:41.749616 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:03:41.750116 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.751188 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.752940 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.753653 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.753776 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:41.754215 (+ 439us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:03:41.754351 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:03:41.754442 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:41.754603 (+ 161us) server_negotiation.cc:299] Negotiation successful
0809 13:03:41.754700 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 13:03:41.765067 10167 raft_consensus.cc:3037] T 084614313ecc4408ab963966c5acd226 P 69cc3e329c5643e5997919f5a3342b19 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:41.765333 9746 raft_consensus.cc:1261] T 084614313ecc4408ab963966c5acd226 P 93e0f5c2800a4e7cb522c56114b61324 [term 1 FOLLOWER]: Refusing update from remote peer 22b5a2b099ae474b93f8e215f4028dd9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:03:41.766188 10423 consensus_queue.cc:1035] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93e0f5c2800a4e7cb522c56114b61324" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:03:41.768056 10167 raft_consensus.cc:1261] T 084614313ecc4408ab963966c5acd226 P 69cc3e329c5643e5997919f5a3342b19 [term 1 FOLLOWER]: Refusing update from remote peer 22b5a2b099ae474b93f8e215f4028dd9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:03:41.769256 10423 consensus_queue.cc:1035] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69cc3e329c5643e5997919f5a3342b19" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:03:41.816747 10429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:41.809504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:56651 (local address 127.28.155.194:36975)
0809 13:03:41.809786 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:41.809794 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:41.810723 (+ 929us) server_negotiation.cc:407] Connection header received
0809 13:03:41.810891 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:41.810897 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:41.811005 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:41.811117 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:03:41.811647 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.812879 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.814873 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.815312 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.815464 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:41.815961 (+ 497us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:03:41.816074 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:03:41.816178 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:41.816316 (+ 138us) server_negotiation.cc:299] Negotiation successful
0809 13:03:41.816402 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113}
I20260809 13:03:41.816913 10442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:41.809278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:36975 (local address 127.28.155.193:56651)
0809 13:03:41.810590 (+ 1312us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:41.810606 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:41.810731 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:41.811149 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:41.811152 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:41.811161 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 13:03:41.811442 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:41.811449 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.813071 (+ 1622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.813085 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:41.814673 (+ 1588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:41.814696 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.815542 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.815551 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:41.815732 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:41.815791 (+ 59us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 13:03:41.816196 (+ 405us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 13:03:41.816209 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 13:03:41.816296 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 13:03:41.816459 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1119,"thread_start_us":905,"threads_started":1}
I20260809 13:03:41.860294 9491 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55102:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:03:41.860630 9491 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55102:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:03:41.864760 9491 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 957868b5ea3f4caf803efe9a4e5b30d0: Sending DeleteTablet for 3 replicas of tablet 084614313ecc4408ab963966c5acd226
I20260809 13:03:41.866080 9916 tablet_service.cc:1514] Processing DeleteTablet for tablet 084614313ecc4408ab963966c5acd226 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:03:41 UTC) from {username='oryx', principal='oryx/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:49318
I20260809 13:03:41.866511 10375 tablet_replica.cc:330] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9: stopping tablet replica
I20260809 13:03:41.866466 10134 tablet_service.cc:1514] Processing DeleteTablet for tablet 084614313ecc4408ab963966c5acd226 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:03:41 UTC) from {username='oryx', principal='oryx/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:41498
I20260809 13:03:41.866719 10375 raft_consensus.cc:2229] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9 [term 1 LEADER]: Raft consensus shutting down.
I20260809 13:03:41.867300 10375 raft_consensus.cc:2258] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:03:41.867587 9715 tablet_service.cc:1514] Processing DeleteTablet for tablet 084614313ecc4408ab963966c5acd226 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:03:41 UTC) from {username='oryx', principal='oryx/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:40452
I20260809 13:03:41.867684 10374 tablet_replica.cc:330] T 084614313ecc4408ab963966c5acd226 P 69cc3e329c5643e5997919f5a3342b19: stopping tablet replica
I20260809 13:03:41.867900 10374 raft_consensus.cc:2229] T 084614313ecc4408ab963966c5acd226 P 69cc3e329c5643e5997919f5a3342b19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:03:41.868137 10374 raft_consensus.cc:2258] T 084614313ecc4408ab963966c5acd226 P 69cc3e329c5643e5997919f5a3342b19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:03:41.868706 10377 tablet_replica.cc:330] T 084614313ecc4408ab963966c5acd226 P 93e0f5c2800a4e7cb522c56114b61324: stopping tablet replica
I20260809 13:03:41.868922 10377 raft_consensus.cc:2229] T 084614313ecc4408ab963966c5acd226 P 93e0f5c2800a4e7cb522c56114b61324 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:03:41.869167 10377 raft_consensus.cc:2258] T 084614313ecc4408ab963966c5acd226 P 93e0f5c2800a4e7cb522c56114b61324 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:03:41.869630 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 9597
I20260809 13:03:41.871037 10374 ts_tablet_manager.cc:1905] T 084614313ecc4408ab963966c5acd226 P 69cc3e329c5643e5997919f5a3342b19: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:03:41.873762 10377 ts_tablet_manager.cc:1905] T 084614313ecc4408ab963966c5acd226 P 93e0f5c2800a4e7cb522c56114b61324: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:03:41.876919 10375 ts_tablet_manager.cc:1905] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 09 13:03:41 dist-test-slave-jq4t krb5kdc[9417](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280621, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.28.155.193@KRBTEST.COM
I20260809 13:03:41.897060 10375 ts_tablet_manager.cc:1918] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 13:03:41.897365 10374 ts_tablet_manager.cc:1918] T 084614313ecc4408ab963966c5acd226 P 69cc3e329c5643e5997919f5a3342b19: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 13:03:41.897545 10374 log.cc:1196] T 084614313ecc4408ab963966c5acd226 P 69cc3e329c5643e5997919f5a3342b19: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-2/wal/wals/084614313ecc4408ab963966c5acd226
I20260809 13:03:41.898001 10375 log.cc:1196] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-1/wal/wals/084614313ecc4408ab963966c5acd226
I20260809 13:03:41.898017 10374 ts_tablet_manager.cc:1939] T 084614313ecc4408ab963966c5acd226 P 69cc3e329c5643e5997919f5a3342b19: Deleting consensus metadata
I20260809 13:03:41.898579 10375 ts_tablet_manager.cc:1939] T 084614313ecc4408ab963966c5acd226 P 22b5a2b099ae474b93f8e215f4028dd9: Deleting consensus metadata
I20260809 13:03:41.899389 9467 catalog_manager.cc:4841] TS 69cc3e329c5643e5997919f5a3342b19 (127.28.155.195:44333): tablet 084614313ecc4408ab963966c5acd226 (table test-table [id=3983a43ca01b4551a3282a0e6d229a9b]) successfully deleted
I20260809 13:03:41.899901 9464 catalog_manager.cc:4841] TS 22b5a2b099ae474b93f8e215f4028dd9 (127.28.155.194:36975): tablet 084614313ecc4408ab963966c5acd226 (table test-table [id=3983a43ca01b4551a3282a0e6d229a9b]) successfully deleted
I20260809 13:03:41.906505 10377 ts_tablet_manager.cc:1918] T 084614313ecc4408ab963966c5acd226 P 93e0f5c2800a4e7cb522c56114b61324: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 13:03:41.906723 10377 log.cc:1196] T 084614313ecc4408ab963966c5acd226 P 93e0f5c2800a4e7cb522c56114b61324: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786280548611909-29295-0/minicluster-data/ts-0/wal/wals/084614313ecc4408ab963966c5acd226
I20260809 13:03:41.907189 10377 ts_tablet_manager.cc:1939] T 084614313ecc4408ab963966c5acd226 P 93e0f5c2800a4e7cb522c56114b61324: Deleting consensus metadata
I20260809 13:03:41.908591 9467 catalog_manager.cc:4841] TS 93e0f5c2800a4e7cb522c56114b61324 (127.28.155.193:42147): tablet 084614313ecc4408ab963966c5acd226 (table test-table [id=3983a43ca01b4551a3282a0e6d229a9b]) successfully deleted
I20260809 13:03:41.912246 10349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:41.873266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40478 (local address 127.28.155.193:42147)
0809 13:03:41.874336 (+ 1070us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:41.874343 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:41.882791 (+ 8448us) server_negotiation.cc:407] Connection header received
0809 13:03:41.883434 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:41.883441 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:41.883556 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:41.883655 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:41.885528 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.886737 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.888903 (+ 2166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:41.889580 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:41.889683 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:41.897605 (+ 7922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:41.897636 (+ 31us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:41.897659 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:41.897717 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:41.905102 (+ 7385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:41.908623 (+ 3521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:41.908635 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:41.908638 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:41.908835 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:41.909379 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:41.909384 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:41.909388 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:41.909911 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:41.910226 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:41.911608 (+ 1382us) server_negotiation.cc:299] Negotiation successful
0809 13:03:41.911899 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":926}
I20260809 13:03:41.913033 9812 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:42.099522 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 9597
I20260809 13:03:42.134125 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 9822
Aug 09 13:03:42 dist-test-slave-jq4t krb5kdc[9417](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280621, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.28.155.194@KRBTEST.COM
I20260809 13:03:42.154093 10429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:42.135055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49336 (local address 127.28.155.194:36975)
0809 13:03:42.135265 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:42.135270 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:42.135289 (+ 19us) server_negotiation.cc:407] Connection header received
0809 13:03:42.135495 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:42.135499 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:42.135585 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:42.135679 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:42.137462 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:42.138514 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:42.140466 (+ 1952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:42.141076 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:42.141186 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:42.147012 (+ 5826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:42.147028 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:42.147044 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:42.147084 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:42.150610 (+ 3526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:42.151514 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:42.151521 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:42.151524 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:42.151657 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:42.152142 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:42.152146 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:42.152148 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:42.152670 (+ 522us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:42.152949 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:42.153393 (+ 444us) server_negotiation.cc:299] Negotiation successful
0809 13:03:42.153658 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 13:03:42.154874 10021 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:42.296888 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 9822
I20260809 13:03:42.323997 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 10035
Aug 09 13:03:42 dist-test-slave-jq4t krb5kdc[9417](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280621, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.28.155.195@KRBTEST.COM
I20260809 13:03:42.340865 10454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:42.324813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41512 (local address 127.28.155.195:44333)
0809 13:03:42.325294 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:42.325299 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:42.325316 (+ 17us) server_negotiation.cc:407] Connection header received
0809 13:03:42.325376 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:42.325379 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:42.325447 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:42.325543 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:42.326859 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:42.327577 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:42.329256 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:42.329790 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:42.329946 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:42.334561 (+ 4615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:42.334582 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:42.334601 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:42.334643 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:42.337858 (+ 3215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:42.338624 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:42.338632 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:42.338634 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:42.338807 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:42.339341 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:42.339345 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:42.339347 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:42.339756 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:42.340028 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:42.340278 (+ 250us) server_negotiation.cc:299] Negotiation successful
0809 13:03:42.340529 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":249,"threads_started":1}
I20260809 13:03:42.341962 10234 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:42.477660 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 10035
I20260809 13:03:42.511039 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 9440
I20260809 13:03:42.512594 9551 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:42.639743 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 9440
2026-08-09T13:03:42Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (6752 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:03:42 dist-test-slave-jq4t krb5kdc[10459](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:03:42 dist-test-slave-jq4t krb5kdc[10459](info): set up 2 sockets
Aug 09 13:03:42 dist-test-slave-jq4t krb5kdc[10459](info): commencing operation
krb5kdc: starting...
W20260809 13:03:43.981307 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.288s user 0.000s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:03:44 dist-test-slave-jq4t krb5kdc[10459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280624, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:03:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:03:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
I20260809 13:03:44.269481 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:41471
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:41197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:41471
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:44.642918 10481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:44.643326 10481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:44.643510 10481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:44.651181 10481 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:03:44.651364 10481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:44.651489 10481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:44.651607 10481 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:03:44.651696 10481 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:03:44.662281 10481 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:41197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:41471
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:41471
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:44.663803 10481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:44.665407 10481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:44.678292 10487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:44.678503 10488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:44.678321 10490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:44.679323 10481 server_base.cc:1034] running on GCE node
I20260809 13:03:44.680300 10481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:44.682003 10481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:44.683228 10481 hybrid_clock.cc:648] HybridClock initialized: now 1786280624683162 us; error 57 us; skew 500 ppm
I20260809 13:03:44.683629 10481 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-09T13:03:44Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (2119 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:03:44 dist-test-slave-jq4t krb5kdc[10500](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:03:44 dist-test-slave-jq4t krb5kdc[10500](info): set up 2 sockets
Aug 09 13:03:44 dist-test-slave-jq4t krb5kdc[10500](info): commencing operation
krb5kdc: starting...
W20260809 13:03:46.108935 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.297s user 0.004s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:03:46 dist-test-slave-jq4t krb5kdc[10500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280626, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:03:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:03:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
I20260809 13:03:46.405318 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:42377
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:43183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:42377
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:46.770715 10517 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:46.771090 10517 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:46.771288 10517 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:46.778970 10517 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:03:46.779109 10517 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:46.779206 10517 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:46.779326 10517 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:03:46.779417 10517 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:03:46.790095 10517 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:43183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:42377
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:42377
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:46.791651 10517 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:46.793166 10517 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:46.806495 10525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:46.806519 10526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:46.806493 10528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:46.807829 10517 server_base.cc:1034] running on GCE node
I20260809 13:03:46.808784 10517 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:46.810410 10517 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:46.811630 10517 hybrid_clock.cc:648] HybridClock initialized: now 1786280626811580 us; error 35 us; skew 500 ppm
I20260809 13:03:46.812072 10517 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:46 dist-test-slave-jq4t krb5kdc[10500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280626, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:46.815595 10517 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:03:46.817452 10517 webserver.cc:460] Webserver started at http://127.28.155.254:44585/ using document root <none> and password file <none>
I20260809 13:03:46.818248 10517 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:46.818406 10517 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:46.818773 10517 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:46.822160 10517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "762b622c97e2469ab0af236301cd1cad"
format_stamp: "Formatted at 2026-08-09 13:03:46 on dist-test-slave-jq4t"
server_key: "d29789855549bba4740f06a4f29f7371"
server_key_iv: "19d9ca0617a76aa8b6f653c523c3e809"
server_key_version: "encryptionkey@0"
I20260809 13:03:46.822988 10517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "762b622c97e2469ab0af236301cd1cad"
format_stamp: "Formatted at 2026-08-09 13:03:46 on dist-test-slave-jq4t"
server_key: "d29789855549bba4740f06a4f29f7371"
server_key_iv: "19d9ca0617a76aa8b6f653c523c3e809"
server_key_version: "encryptionkey@0"
I20260809 13:03:46.828714 10517 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 13:03:46.832628 10537 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:46.834065 10517 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:03:46.834292 10517 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "762b622c97e2469ab0af236301cd1cad"
format_stamp: "Formatted at 2026-08-09 13:03:46 on dist-test-slave-jq4t"
server_key: "d29789855549bba4740f06a4f29f7371"
server_key_iv: "19d9ca0617a76aa8b6f653c523c3e809"
server_key_version: "encryptionkey@0"
I20260809 13:03:46.834522 10517 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:46.867594 10517 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:46.872288 10517 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:46.872669 10517 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:46.893905 10517 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:42377
I20260809 13:03:46.893930 10620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:42377 every 8 connection(s)
I20260809 13:03:46.895442 10517 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:03:46.896852 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 10517
I20260809 13:03:46.897089 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:03:46.898018 29295 external_mini_cluster.cc:1428] Setting key f8bda3af7f63918e5e252c8ed8b5595b
I20260809 13:03:46.900816 10621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 13:03:46 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280626, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:03:46.915561 10621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad: Bootstrap starting.
I20260809 13:03:46.920440 10621 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad: Neither blocks nor log segments found. Creating new log.
I20260809 13:03:46.921857 10621 log.cc:824] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad: Log is configured to *not* fsync() on all Append() calls
I20260809 13:03:46.925367 10628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:46.900354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44784 (local address 127.28.155.254:42377)
0809 13:03:46.901330 (+ 976us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:46.901342 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:46.901388 (+ 46us) server_negotiation.cc:407] Connection header received
0809 13:03:46.903151 (+ 1763us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:46.903175 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:46.903579 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:46.903941 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:46.905995 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:46.907479 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:46.909435 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:46.910189 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:46.910333 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:46.915525 (+ 5192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:46.915555 (+ 30us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:46.915579 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:46.915639 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:46.920045 (+ 4406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:46.921064 (+ 1019us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:46.921073 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:46.921082 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:46.921310 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:46.921708 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:46.921713 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:46.921716 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:46.922555 (+ 839us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:46.922904 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:46.923407 (+ 503us) server_negotiation.cc:299] Negotiation successful
0809 13:03:46.923932 (+ 525us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":741,"thread_start_us":438,"threads_started":1}
I20260809 13:03:46.925850 10621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad: No bootstrap required, opened a new log
I20260809 13:03:46.934522 10621 raft_consensus.cc:348] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "762b622c97e2469ab0af236301cd1cad" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42377 } }
I20260809 13:03:46.934942 10621 raft_consensus.cc:374] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:03:46.935026 10621 raft_consensus.cc:729] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762b622c97e2469ab0af236301cd1cad, State: Initialized, Role: FOLLOWER
I20260809 13:03:46.935631 10621 consensus_queue.cc:260] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "762b622c97e2469ab0af236301cd1cad" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42377 } }
I20260809 13:03:46.935861 10621 raft_consensus.cc:388] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:03:46.935968 10621 raft_consensus.cc:482] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:03:46.936126 10621 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:03:46.939453 10621 raft_consensus.cc:504] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "762b622c97e2469ab0af236301cd1cad" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42377 } }
I20260809 13:03:46.940003 10621 leader_election.cc:302] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 762b622c97e2469ab0af236301cd1cad; no voters:
I20260809 13:03:46.940665 10621 leader_election.cc:288] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:03:46.940811 10631 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:03:46.941599 10631 raft_consensus.cc:686] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [term 1 LEADER]: Becoming Leader. State: Replica: 762b622c97e2469ab0af236301cd1cad, State: Running, Role: LEADER
I20260809 13:03:46.942184 10631 consensus_queue.cc:237] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "762b622c97e2469ab0af236301cd1cad" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42377 } }
I20260809 13:03:46.943001 10621 sys_catalog.cc:564] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:03:46.945298 10634 sys_catalog.cc:455] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [sys.catalog]: SysCatalogTable state changed. Reason: New leader 762b622c97e2469ab0af236301cd1cad. Latest consensus state: current_term: 1 leader_uuid: "762b622c97e2469ab0af236301cd1cad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "762b622c97e2469ab0af236301cd1cad" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42377 } } }
I20260809 13:03:46.945873 10634 sys_catalog.cc:458] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:46.949638 10644 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:03:46.949606 10632 sys_catalog.cc:455] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "762b622c97e2469ab0af236301cd1cad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "762b622c97e2469ab0af236301cd1cad" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42377 } } }
I20260809 13:03:46.950021 10632 sys_catalog.cc:458] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:46.955008 10644 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:03:46.965538 10644 catalog_manager.cc:1347] Generated new cluster ID: 0d803634d10949a0a018f36a6f464e9b
I20260809 13:03:46.965694 10644 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:03:46.994869 10644 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:03:46.996977 10644 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:03:47.010365 10644 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad: Generated new TSK 0
I20260809 13:03:47.011545 10644 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
I20260809 13:03:47.104051 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:0
--local_ip_for_outbound_sockets=127.28.155.193
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:42377
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:43183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:47.478354 10662 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:47.478672 10662 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:47.478773 10662 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:47.486478 10662 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:47.486626 10662 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:47.486843 10662 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:03:47.497367 10662 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:43183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:42377
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:47.498816 10662 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:47.500290 10662 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:47.514894 10668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:47.514806 10669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:47.514870 10673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:47.516151 10662 server_base.cc:1034] running on GCE node
I20260809 13:03:47.516892 10662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:47.517894 10662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:47.519132 10662 hybrid_clock.cc:648] HybridClock initialized: now 1786280627519068 us; error 58 us; skew 500 ppm
I20260809 13:03:47.519479 10662 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:47 dist-test-slave-jq4t krb5kdc[10500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280627, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:47.522970 10662 init.cc:377] Logged in from keytab as kudu/127.28.155.193@KRBTEST.COM (short username kudu)
I20260809 13:03:47.524789 10662 webserver.cc:460] Webserver started at http://127.28.155.193:32825/ using document root <none> and password file <none>
I20260809 13:03:47.525611 10662 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:47.525770 10662 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:47.526134 10662 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:47.529424 10662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/data/instance:
uuid: "eb3f3c2f77644c639579f4dafdbb199c"
format_stamp: "Formatted at 2026-08-09 13:03:47 on dist-test-slave-jq4t"
server_key: "f2aba9b4ec2b737e8a01ec8f66fb1d17"
server_key_iv: "586e476e3c548e517dfd5cfccdb0d41e"
server_key_version: "encryptionkey@0"
I20260809 13:03:47.530339 10662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance:
uuid: "eb3f3c2f77644c639579f4dafdbb199c"
format_stamp: "Formatted at 2026-08-09 13:03:47 on dist-test-slave-jq4t"
server_key: "f2aba9b4ec2b737e8a01ec8f66fb1d17"
server_key_iv: "586e476e3c548e517dfd5cfccdb0d41e"
server_key_version: "encryptionkey@0"
I20260809 13:03:47.536156 10662 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260809 13:03:47.540328 10683 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:47.541900 10662 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:03:47.542131 10662 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "eb3f3c2f77644c639579f4dafdbb199c"
format_stamp: "Formatted at 2026-08-09 13:03:47 on dist-test-slave-jq4t"
server_key: "f2aba9b4ec2b737e8a01ec8f66fb1d17"
server_key_iv: "586e476e3c548e517dfd5cfccdb0d41e"
server_key_version: "encryptionkey@0"
I20260809 13:03:47.542376 10662 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:47.557459 10662 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:47.562366 10662 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:47.562722 10662 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:47.563848 10662 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:03:47.565593 10662 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:03:47.565711 10662 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:47.565867 10662 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:03:47.565946 10662 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:47.602218 10662 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:37239
I20260809 13:03:47.602284 10868 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:37239 every 8 connection(s)
I20260809 13:03:47.603724 10662 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:03:47.605798 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 10662
I20260809 13:03:47.606029 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance
I20260809 13:03:47.607035 29295 external_mini_cluster.cc:1428] Setting key d881839ec6015954a02bc6a54cd1373d
Aug 09 13:03:47 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280627, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:03:47.631376 10873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:47.606886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:56287 (local address 127.28.155.254:42377)
0809 13:03:47.609486 (+ 2600us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:47.609493 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:47.609516 (+ 23us) server_negotiation.cc:407] Connection header received
0809 13:03:47.611706 (+ 2190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:47.611711 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:47.611781 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:47.611957 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:47.614316 (+ 2359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:47.615093 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:47.617784 (+ 2691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:47.618244 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:47.618400 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:47.623397 (+ 4997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:47.623407 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:47.623414 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:47.623462 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:47.627484 (+ 4022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:47.628385 (+ 901us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:47.628394 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:47.628400 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:47.628620 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:47.629143 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:47.629151 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:47.629157 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:47.629566 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:47.629734 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:47.630572 (+ 838us) server_negotiation.cc:299] Negotiation successful
0809 13:03:47.630870 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2470,"thread_start_us":2340,"threads_started":1}
I20260809 13:03:47.632038 10874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:47.607631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.193:56287)
0809 13:03:47.608723 (+ 1092us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:47.608782 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:47.611353 (+ 2571us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:47.612251 (+ 898us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:47.612268 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:47.613202 (+ 934us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:47.614098 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:47.614129 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:47.615300 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:47.615308 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:47.617596 (+ 2288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:47.617617 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:47.618509 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:47.618519 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:47.618887 (+ 368us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:47.619754 (+ 867us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:47.619790 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:47.623073 (+ 3283us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:47.627675 (+ 4602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:47.627684 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:47.627700 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:47.628230 (+ 530us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:47.628766 (+ 536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:47.628770 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:47.628773 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:47.628998 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:47.629701 (+ 703us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:47.629707 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:47.630112 (+ 405us) client_negotiation.cc:769] Sending connection context
0809 13:03:47.630372 (+ 260us) client_negotiation.cc:240] Negotiation successful
0809 13:03:47.630806 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":720,"thread_start_us":465,"threads_started":1}
I20260809 13:03:47.633858 10870 heartbeater.cc:347] Connected to a master server at 127.28.155.254:42377
I20260809 13:03:47.634210 10870 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:47.635010 10870 heartbeater.cc:511] Master 127.28.155.254:42377 requested a full tablet report, sending...
I20260809 13:03:47.637406 10568 ts_manager.cc:194] Registered new tserver with Master: eb3f3c2f77644c639579f4dafdbb199c (127.28.155.193:37239)
I20260809 13:03:47.639138 10568 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.193@KRBTEST.COM'} at 127.28.155.193:56287
WARNING: no policy specified for kudu/127.28.155.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
I20260809 13:03:47.676083 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:0
--local_ip_for_outbound_sockets=127.28.155.194
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:42377
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:43183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:48.044119 10880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:48.044516 10880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:48.044744 10880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:48.052615 10880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:48.052793 10880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:48.052979 10880 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:03:48.062983 10880 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:43183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:42377
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:48.064500 10880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:48.065958 10880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:48.080524 10886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:48.080349 10891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:48.080349 10888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:48.081264 10880 server_base.cc:1034] running on GCE node
I20260809 13:03:48.081988 10880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:48.082995 10880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:48.084204 10880 hybrid_clock.cc:648] HybridClock initialized: now 1786280628084154 us; error 41 us; skew 500 ppm
I20260809 13:03:48.084618 10880 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:48 dist-test-slave-jq4t krb5kdc[10500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280628, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:48.087905 10880 init.cc:377] Logged in from keytab as kudu/127.28.155.194@KRBTEST.COM (short username kudu)
I20260809 13:03:48.089689 10880 webserver.cc:460] Webserver started at http://127.28.155.194:40555/ using document root <none> and password file <none>
I20260809 13:03:48.090474 10880 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:48.090631 10880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:48.090991 10880 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:48.094313 10880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/data/instance:
uuid: "dd34d6e087914b7eb477ef3265726f8f"
format_stamp: "Formatted at 2026-08-09 13:03:48 on dist-test-slave-jq4t"
server_key: "fa72ee645560db2b8f53c30273daeab1"
server_key_iv: "a8d34eaf4f57fcc41ee19d06954702f8"
server_key_version: "encryptionkey@0"
I20260809 13:03:48.095155 10880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance:
uuid: "dd34d6e087914b7eb477ef3265726f8f"
format_stamp: "Formatted at 2026-08-09 13:03:48 on dist-test-slave-jq4t"
server_key: "fa72ee645560db2b8f53c30273daeab1"
server_key_iv: "a8d34eaf4f57fcc41ee19d06954702f8"
server_key_version: "encryptionkey@0"
I20260809 13:03:48.100692 10880 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 13:03:48.104460 10901 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:48.106145 10880 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:03:48.106349 10880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "dd34d6e087914b7eb477ef3265726f8f"
format_stamp: "Formatted at 2026-08-09 13:03:48 on dist-test-slave-jq4t"
server_key: "fa72ee645560db2b8f53c30273daeab1"
server_key_iv: "a8d34eaf4f57fcc41ee19d06954702f8"
server_key_version: "encryptionkey@0"
I20260809 13:03:48.106599 10880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:48.129383 10880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:48.134301 10880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:48.134650 10880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:48.135883 10880 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:03:48.137573 10880 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:03:48.137689 10880 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:48.137841 10880 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:03:48.137916 10880 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:48.173866 10880 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:43517
I20260809 13:03:48.173920 11060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:43517 every 8 connection(s)
I20260809 13:03:48.175287 10880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:03:48.176810 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 10880
I20260809 13:03:48.177011 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance
I20260809 13:03:48.177649 29295 external_mini_cluster.cc:1428] Setting key d058c44e7f4af101a579e92859f0c09b
Aug 09 13:03:48 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280628, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:03:48.197975 11064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:48.178407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:47979 (local address 127.28.155.254:42377)
0809 13:03:48.178951 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:48.178957 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:48.180076 (+ 1119us) server_negotiation.cc:407] Connection header received
0809 13:03:48.182093 (+ 2017us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:48.182099 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:48.182199 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:48.182324 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:48.183903 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:48.184765 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:48.186393 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:48.186841 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:48.186981 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:48.191341 (+ 4360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:48.191347 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:48.191351 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:48.191389 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:48.194294 (+ 2905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:48.195379 (+ 1085us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:48.195383 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:48.195385 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:48.195521 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:48.196053 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:48.196056 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:48.196058 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:48.196332 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:48.196447 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:48.197476 (+ 1029us) server_negotiation.cc:299] Negotiation successful
0809 13:03:48.197670 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":415,"thread_start_us":278,"threads_started":1}
I20260809 13:03:48.199731 11065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:48.178989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.194:47979)
0809 13:03:48.179893 (+ 904us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:48.179944 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:48.181806 (+ 1862us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:48.182580 (+ 774us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:48.182588 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:48.183128 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:48.183718 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:48.183740 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:48.184932 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:48.184936 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:48.186229 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:48.186242 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:48.187098 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:48.187106 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:48.187336 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:48.188089 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:48.188112 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:48.191037 (+ 2925us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:48.194483 (+ 3446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:48.194496 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:48.194518 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:48.195248 (+ 730us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:48.195639 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:48.195648 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:48.195654 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:48.195934 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:48.196510 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:48.196522 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:48.197044 (+ 522us) client_negotiation.cc:769] Sending connection context
0809 13:03:48.197387 (+ 343us) client_negotiation.cc:240] Negotiation successful
0809 13:03:48.198037 (+ 650us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"thread_start_us":315,"threads_started":1}
I20260809 13:03:48.201514 11062 heartbeater.cc:347] Connected to a master server at 127.28.155.254:42377
I20260809 13:03:48.201879 11062 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:48.202679 11062 heartbeater.cc:511] Master 127.28.155.254:42377 requested a full tablet report, sending...
I20260809 13:03:48.204397 10568 ts_manager.cc:194] Registered new tserver with Master: dd34d6e087914b7eb477ef3265726f8f (127.28.155.194:43517)
I20260809 13:03:48.205335 10568 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.194@KRBTEST.COM'} at 127.28.155.194:47979
WARNING: no policy specified for kudu/127.28.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
I20260809 13:03:48.244221 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:0
--local_ip_for_outbound_sockets=127.28.155.195
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:42377
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:43183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:48.615068 11070 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:48.615394 11070 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:48.615500 11070 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:48.623224 11070 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:48.623364 11070 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:48.623486 11070 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:03:48.634430 11070 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:43183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:42377
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:48.635811 11070 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:48.637264 11070 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 13:03:48.642724 10870 heartbeater.cc:503] Master 127.28.155.254:42377 was elected leader, sending a full tablet report...
W20260809 13:03:48.652415 11079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:48.652611 11081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:48.653376 11078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:48.653894 11070 server_base.cc:1034] running on GCE node
I20260809 13:03:48.654626 11070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:48.655733 11070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:48.656944 11070 hybrid_clock.cc:648] HybridClock initialized: now 1786280628656870 us; error 65 us; skew 500 ppm
I20260809 13:03:48.657311 11070 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:48 dist-test-slave-jq4t krb5kdc[10500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280628, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:48.660867 11070 init.cc:377] Logged in from keytab as kudu/127.28.155.195@KRBTEST.COM (short username kudu)
I20260809 13:03:48.662503 11070 webserver.cc:460] Webserver started at http://127.28.155.195:36363/ using document root <none> and password file <none>
I20260809 13:03:48.663225 11070 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:48.663335 11070 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:48.663610 11070 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:03:48.666838 11070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/data/instance:
uuid: "34edb0408e8c4af9a7a7593e6e806553"
format_stamp: "Formatted at 2026-08-09 13:03:48 on dist-test-slave-jq4t"
server_key: "e7db61dd17bfd391c775c646f0682787"
server_key_iv: "7a94fcfbb77c0f6e6359f6a94b96cfd4"
server_key_version: "encryptionkey@0"
I20260809 13:03:48.667699 11070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance:
uuid: "34edb0408e8c4af9a7a7593e6e806553"
format_stamp: "Formatted at 2026-08-09 13:03:48 on dist-test-slave-jq4t"
server_key: "e7db61dd17bfd391c775c646f0682787"
server_key_iv: "7a94fcfbb77c0f6e6359f6a94b96cfd4"
server_key_version: "encryptionkey@0"
I20260809 13:03:48.673692 11070 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260809 13:03:48.677557 11093 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:48.678962 11070 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260809 13:03:48.679169 11070 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "34edb0408e8c4af9a7a7593e6e806553"
format_stamp: "Formatted at 2026-08-09 13:03:48 on dist-test-slave-jq4t"
server_key: "e7db61dd17bfd391c775c646f0682787"
server_key_iv: "7a94fcfbb77c0f6e6359f6a94b96cfd4"
server_key_version: "encryptionkey@0"
I20260809 13:03:48.679407 11070 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:48.699488 11070 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:48.703832 11070 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:48.704180 11070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:48.705330 11070 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:03:48.706810 11070 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:03:48.706923 11070 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:48.707091 11070 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:03:48.707166 11070 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:48.742882 11070 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:35187
I20260809 13:03:48.742905 11262 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:35187 every 8 connection(s)
I20260809 13:03:48.744402 11070 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:03:48.745668 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 11070
I20260809 13:03:48.745887 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance
I20260809 13:03:48.746542 29295 external_mini_cluster.cc:1428] Setting key cdf14bf73d95f9bbed5fec6cda420dad
Aug 09 13:03:48 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280628, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:03:48.765982 11268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:48.747354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:56899 (local address 127.28.155.254:42377)
0809 13:03:48.747913 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:48.747919 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:48.749313 (+ 1394us) server_negotiation.cc:407] Connection header received
0809 13:03:48.751457 (+ 2144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:48.751462 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:48.751536 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:48.751635 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:48.753465 (+ 1830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:48.754249 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:48.755774 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:48.756193 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:48.756289 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:48.760024 (+ 3735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:48.760030 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:48.760033 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:48.760077 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:48.763058 (+ 2981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:48.763787 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:48.763792 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:48.763794 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:48.763920 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:48.764326 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:48.764329 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:48.764331 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:48.764665 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:48.764788 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:48.765527 (+ 739us) server_negotiation.cc:299] Negotiation successful
0809 13:03:48.765705 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":275,"threads_started":1}
I20260809 13:03:48.766999 11270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:48.747894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.195:56899)
0809 13:03:48.748903 (+ 1009us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:48.748963 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:48.751173 (+ 2210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:48.751923 (+ 750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:48.751931 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:48.752620 (+ 689us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:48.753283 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:48.753302 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:48.754384 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:48.754388 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:48.755633 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:48.755645 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:48.756408 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:48.756413 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:48.756688 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:48.757369 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:48.757397 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:48.759788 (+ 2391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:03:48.763186 (+ 3398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:48.763193 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:48.763207 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:48.763669 (+ 462us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:48.764023 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:03:48.764027 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:03:48.764029 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:03:48.764224 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:03:48.764773 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:03:48.764779 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:03:48.765117 (+ 338us) client_negotiation.cc:769] Sending connection context
0809 13:03:48.765408 (+ 291us) client_negotiation.cc:240] Negotiation successful
0809 13:03:48.765831 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":737,"thread_start_us":462,"threads_started":1}
I20260809 13:03:48.768373 11263 heartbeater.cc:347] Connected to a master server at 127.28.155.254:42377
I20260809 13:03:48.768728 11263 heartbeater.cc:464] Registering TS with master...
I20260809 13:03:48.769490 11263 heartbeater.cc:511] Master 127.28.155.254:42377 requested a full tablet report, sending...
I20260809 13:03:48.771145 10568 ts_manager.cc:194] Registered new tserver with Master: 34edb0408e8c4af9a7a7593e6e806553 (127.28.155.195:35187)
I20260809 13:03:48.772017 10568 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.195@KRBTEST.COM'} at 127.28.155.195:56899
I20260809 13:03:48.775471 29295 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.28.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.193.keytab.
Entry for principal oryx/127.28.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.193.keytab.
WARNING: no policy specified for oryx/127.28.155.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.194.keytab.
Entry for principal oryx/127.28.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.194.keytab.
WARNING: no policy specified for oryx/127.28.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.195.keytab.
Entry for principal oryx/127.28.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.195.keytab.
I20260809 13:03:48.960000 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 10662
Aug 09 13:03:48 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280626, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.193@KRBTEST.COM
I20260809 13:03:48.978500 11280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:48.961517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59262 (local address 127.28.155.193:37239)
0809 13:03:48.962232 (+ 715us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:48.962240 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:48.962290 (+ 50us) server_negotiation.cc:407] Connection header received
0809 13:03:48.962356 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:48.962362 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:48.962600 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:48.962742 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:48.964231 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:48.965416 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:48.966672 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:48.967257 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:48.967358 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:48.971993 (+ 4635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:48.972009 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:48.972034 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:48.972076 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:48.975335 (+ 3259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:48.976113 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:48.976122 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:48.976125 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:48.976280 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:48.976740 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:48.976745 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:48.976754 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:48.977144 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:48.977486 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:48.977813 (+ 327us) server_negotiation.cc:299] Negotiation successful
0809 13:03:48.978116 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":559,"thread_start_us":372,"threads_started":1}
I20260809 13:03:48.979938 10859 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:49.067477 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 10662
I20260809 13:03:49.095232 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 10880
Aug 09 13:03:49 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280626, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.194@KRBTEST.COM
I20260809 13:03:49.112622 11284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:49.096289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44022 (local address 127.28.155.194:43517)
0809 13:03:49.096967 (+ 678us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:49.096974 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:49.097001 (+ 27us) server_negotiation.cc:407] Connection header received
0809 13:03:49.097075 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:49.097082 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:49.097302 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:49.097440 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:49.098769 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:49.099833 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:49.101270 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:49.101834 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:49.101939 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:49.106314 (+ 4375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:49.106328 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:49.106344 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:49.106393 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:49.109553 (+ 3160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:49.110370 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:49.110377 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:49.110380 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:49.110535 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:49.110888 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:49.110892 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:49.110894 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:49.111405 (+ 511us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:49.111649 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:49.111911 (+ 262us) server_negotiation.cc:299] Negotiation successful
0809 13:03:49.112142 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":504,"thread_start_us":347,"threads_started":1}
I20260809 13:03:49.113933 11056 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:49.201766 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 10880
I20260809 13:03:49.230437 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 11070
Aug 09 13:03:49 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280626, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.195@KRBTEST.COM
I20260809 13:03:49.249152 11286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:49.231539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33388 (local address 127.28.155.195:35187)
0809 13:03:49.232167 (+ 628us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:49.232174 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:49.232208 (+ 34us) server_negotiation.cc:407] Connection header received
0809 13:03:49.232281 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:49.232288 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:49.232575 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:49.232719 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:49.234005 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:49.235020 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:49.236314 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:49.237416 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:49.237586 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:49.242398 (+ 4812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:49.242416 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:49.242432 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:49.242482 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:49.245831 (+ 3349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:49.246688 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:49.246706 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:49.246709 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:49.246853 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:49.247297 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:49.247303 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:49.247306 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:49.247728 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:49.248068 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:49.248422 (+ 354us) server_negotiation.cc:299] Negotiation successful
0809 13:03:49.248760 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":458,"thread_start_us":305,"threads_started":1}
I20260809 13:03:49.250543 11255 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:49.338428 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 11070
I20260809 13:03:49.360850 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 10517
I20260809 13:03:49.362118 10615 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:03:49.475682 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 10517
I20260809 13:03:49.505317 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:42377
--webserver_interface=127.28.155.254
--webserver_port=44585
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:43183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:42377
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:03:49.876768 11289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:49.877108 11289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:49.877329 11289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:49.884959 11289 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:03:49.885090 11289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:49.885211 11289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:49.885322 11289 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:03:49.885412 11289 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:03:49.896303 11289 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:43183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:42377
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:42377
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=44585
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:49.897920 11289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:49.899408 11289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:49.912710 11296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:49.912761 11301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:49.912694 11297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:49.913674 11289 server_base.cc:1034] running on GCE node
I20260809 13:03:49.914682 11289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:49.916317 11289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:49.917546 11289 hybrid_clock.cc:648] HybridClock initialized: now 1786280629917505 us; error 72 us; skew 500 ppm
I20260809 13:03:49.917963 11289 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:49 dist-test-slave-jq4t krb5kdc[10500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280629, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:49.924669 11289 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:03:49.926323 11289 webserver.cc:460] Webserver started at http://127.28.155.254:44585/ using document root <none> and password file <none>
I20260809 13:03:49.927114 11289 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:49.927275 11289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:49.933267 11289 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 13:03:49.936223 11313 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:49.937664 11289 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 13:03:49.937860 11289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "762b622c97e2469ab0af236301cd1cad"
format_stamp: "Formatted at 2026-08-09 13:03:46 on dist-test-slave-jq4t"
server_key: "d29789855549bba4740f06a4f29f7371"
server_key_iv: "19d9ca0617a76aa8b6f653c523c3e809"
server_key_version: "encryptionkey@0"
I20260809 13:03:49.938906 11289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:49.958043 11289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:49.962441 11289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:49.962761 11289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:49.984148 11289 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:42377
I20260809 13:03:49.984157 11390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:42377 every 8 connection(s)
I20260809 13:03:49.986052 11289 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:03:49.993939 11391 sys_catalog.cc:263] Verifying existing consensus state
I20260809 13:03:49.996205 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 11289
I20260809 13:03:49.997233 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:37239
--local_ip_for_outbound_sockets=127.28.155.193
--tserver_master_addrs=127.28.155.254:42377
--webserver_port=32825
--webserver_interface=127.28.155.193
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:43183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.28.155.193
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 13:03:49.997822 11391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad: Bootstrap starting.
I20260809 13:03:50.019594 11391 log.cc:824] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad: Log is configured to *not* fsync() on all Append() calls
I20260809 13:03:50.029436 11391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 13:03:50.030206 11391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad: Bootstrap complete.
I20260809 13:03:50.039875 11391 raft_consensus.cc:348] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "762b622c97e2469ab0af236301cd1cad" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42377 } }
I20260809 13:03:50.040931 11391 raft_consensus.cc:729] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762b622c97e2469ab0af236301cd1cad, State: Initialized, Role: FOLLOWER
I20260809 13:03:50.041599 11391 consensus_queue.cc:260] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "762b622c97e2469ab0af236301cd1cad" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42377 } }
I20260809 13:03:50.041880 11391 raft_consensus.cc:388] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:03:50.042028 11391 raft_consensus.cc:482] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:03:50.042244 11391 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [term 1 FOLLOWER]: Advancing to term 2
I20260809 13:03:50.046756 11391 raft_consensus.cc:504] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "762b622c97e2469ab0af236301cd1cad" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42377 } }
I20260809 13:03:50.047418 11391 leader_election.cc:302] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 762b622c97e2469ab0af236301cd1cad; no voters:
I20260809 13:03:50.048125 11391 leader_election.cc:288] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 13:03:50.048301 11395 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [term 2 FOLLOWER]: Leader election won for term 2
I20260809 13:03:50.049870 11395 raft_consensus.cc:686] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [term 2 LEADER]: Becoming Leader. State: Replica: 762b622c97e2469ab0af236301cd1cad, State: Running, Role: LEADER
I20260809 13:03:50.050580 11395 consensus_queue.cc:237] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "762b622c97e2469ab0af236301cd1cad" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42377 } }
I20260809 13:03:50.050873 11391 sys_catalog.cc:564] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:03:50.053507 11396 sys_catalog.cc:455] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "762b622c97e2469ab0af236301cd1cad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "762b622c97e2469ab0af236301cd1cad" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42377 } } }
I20260809 13:03:50.054013 11396 sys_catalog.cc:458] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:50.056381 11398 sys_catalog.cc:455] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [sys.catalog]: SysCatalogTable state changed. Reason: New leader 762b622c97e2469ab0af236301cd1cad. Latest consensus state: current_term: 2 leader_uuid: "762b622c97e2469ab0af236301cd1cad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "762b622c97e2469ab0af236301cd1cad" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42377 } } }
I20260809 13:03:50.056818 11398 sys_catalog.cc:458] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad [sys.catalog]: This master's current role is: LEADER
I20260809 13:03:50.058976 11404 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:03:50.065135 11404 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:03:50.066610 11404 catalog_manager.cc:1259] Loaded cluster ID: 0d803634d10949a0a018f36a6f464e9b
I20260809 13:03:50.066715 11404 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:03:50.070998 11404 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:03:50.072883 11404 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 762b622c97e2469ab0af236301cd1cad: Loaded TSK: 0
I20260809 13:03:50.074512 11404 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 13:03:50.386596 11393 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:50.387023 11393 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:50.387192 11393 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:50.395134 11393 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:50.395327 11393 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:50.395520 11393 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:03:50.406402 11393 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:43183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.193.keytab
--principal=oryx/127.28.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:37239
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=32825
--tserver_master_addrs=127.28.155.254:42377
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:50.408067 11393 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:50.409624 11393 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:50.424530 11428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:50.424364 11429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:50.425346 11431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:50.425765 11393 server_base.cc:1034] running on GCE node
I20260809 13:03:50.426551 11393 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:50.427764 11393 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:50.429021 11393 hybrid_clock.cc:648] HybridClock initialized: now 1786280630428967 us; error 42 us; skew 500 ppm
I20260809 13:03:50.429407 11393 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:50 dist-test-slave-jq4t krb5kdc[10500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280630, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:50.433475 11393 init.cc:377] Logged in from keytab as oryx/127.28.155.193@KRBTEST.COM (short username oryx)
I20260809 13:03:50.435073 11393 webserver.cc:460] Webserver started at http://127.28.155.193:32825/ using document root <none> and password file <none>
I20260809 13:03:50.435806 11393 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:50.435930 11393 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:50.441833 11393 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 13:03:50.445013 11441 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:50.446434 11393 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 13:03:50.446643 11393 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "eb3f3c2f77644c639579f4dafdbb199c"
format_stamp: "Formatted at 2026-08-09 13:03:47 on dist-test-slave-jq4t"
server_key: "f2aba9b4ec2b737e8a01ec8f66fb1d17"
server_key_iv: "586e476e3c548e517dfd5cfccdb0d41e"
server_key_version: "encryptionkey@0"
I20260809 13:03:50.447739 11393 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:50.470036 11393 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:50.474939 11393 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:50.475252 11393 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:50.476382 11393 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:03:50.477933 11393 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:03:50.478042 11393 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:50.478188 11393 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:03:50.478291 11393 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:50.516690 11393 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:37239
I20260809 13:03:50.516748 11606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:37239 every 8 connection(s)
I20260809 13:03:50.518237 11393 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:03:50.519899 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 11393
I20260809 13:03:50.520902 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:43517
--local_ip_for_outbound_sockets=127.28.155.194
--tserver_master_addrs=127.28.155.254:42377
--webserver_port=40555
--webserver_interface=127.28.155.194
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:43183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.28.155.194
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 13:03:50 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:50 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:50.538158 11611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:50.521873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.193:38557)
0809 13:03:50.522911 (+ 1038us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:50.522969 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:50.525046 (+ 2077us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:50.526485 (+ 1439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:50.526497 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:50.527197 (+ 700us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:50.527767 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:50.527785 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:50.529537 (+ 1752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:50.529541 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:50.530846 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:50.530859 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:50.531928 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:50.531936 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:50.532217 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:50.533060 (+ 843us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:50.533104 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:50.537146 (+ 4042us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":733,"thread_start_us":483,"threads_started":1}
W20260809 13:03:50.538877 11607 heartbeater.cc:644] Failed to heartbeat to 127.28.155.254:42377 (0 consecutive failures): Not authorized: Failed to ping master at 127.28.155.254:42377: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
W20260809 13:03:50.538899 11610 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:50.521867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:38557 (local address 127.28.155.254:42377)
0809 13:03:50.523761 (+ 1894us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:50.523777 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:50.523831 (+ 54us) server_negotiation.cc:407] Connection header received
0809 13:03:50.525604 (+ 1773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:50.525616 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:50.525946 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:50.526330 (+ 384us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:50.527984 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:50.529353 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:50.531004 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:50.531660 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:50.531880 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:50.537587 (+ 5707us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.193:38557: BlockingRecv error: recv got EOF from 127.28.155.193:38557 (error 108)
Metrics: {"server-negotiator.queue_time_us":1635,"thread_start_us":1421,"threads_started":1}
Aug 09 13:03:50 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:50 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:50.548785 11611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:50.539556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.193:50913)
0809 13:03:50.539758 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:50.539774 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:50.539861 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:50.540242 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:50.540245 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:50.540629 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:50.540781 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:50.540790 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:50.542332 (+ 1542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:50.542337 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:50.543402 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:50.543416 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:50.544578 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:50.544583 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:50.544729 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:50.545385 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:50.545403 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:50.548567 (+ 3164us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":54}
W20260809 13:03:50.549155 11610 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:50.539708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:50913 (local address 127.28.155.254:42377)
0809 13:03:50.539898 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:50.539907 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:50.539930 (+ 23us) server_negotiation.cc:407] Connection header received
0809 13:03:50.539994 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:50.540002 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:50.540100 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:50.540214 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:50.540941 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:50.542154 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:50.543555 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:50.544367 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:50.544547 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:50.548844 (+ 4297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.193:50913: BlockingRecv error: recv got EOF from 127.28.155.193:50913 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 09 13:03:50 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:50 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:50.559111 11611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:50.549693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.193:38641)
0809 13:03:50.549885 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:50.549902 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:50.549986 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:50.550404 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:50.550408 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:50.550833 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:50.550992 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:50.551000 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:50.552718 (+ 1718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:50.552722 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:50.553834 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:50.553848 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:50.554903 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:50.554908 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:50.555035 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:50.555689 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:50.555707 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:50.558877 (+ 3170us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":56}
W20260809 13:03:50.559401 11610 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:50.549800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:38641 (local address 127.28.155.254:42377)
0809 13:03:50.550004 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:50.550012 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:50.550070 (+ 58us) server_negotiation.cc:407] Connection header received
0809 13:03:50.550135 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:50.550143 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:50.550245 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:50.550370 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:50.551142 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:50.552558 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:50.553996 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:50.554754 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:50.554885 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:50.559158 (+ 4273us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.193:38641: BlockingRecv error: recv got EOF from 127.28.155.193:38641 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260809 13:03:50.559618 11607 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 13:03:50.891512 11612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:50.891834 11612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:50.892027 11612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:50.899720 11612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:50.899839 11612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:50.900031 11612 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:03:50.910513 11612 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:43183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.194.keytab
--principal=oryx/127.28.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:43517
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=40555
--tserver_master_addrs=127.28.155.254:42377
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:50.912005 11612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:50.913524 11612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:50.926971 11620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:50.926921 11625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:50.927006 11623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:50.928368 11612 server_base.cc:1034] running on GCE node
I20260809 13:03:50.929072 11612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:50.930066 11612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:50.931275 11612 hybrid_clock.cc:648] HybridClock initialized: now 1786280630931230 us; error 39 us; skew 500 ppm
I20260809 13:03:50.931619 11612 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:50 dist-test-slave-jq4t krb5kdc[10500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280630, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:50.934903 11612 init.cc:377] Logged in from keytab as oryx/127.28.155.194@KRBTEST.COM (short username oryx)
I20260809 13:03:50.936342 11612 webserver.cc:460] Webserver started at http://127.28.155.194:40555/ using document root <none> and password file <none>
I20260809 13:03:50.937088 11612 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:50.937206 11612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:50.942723 11612 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 13:03:50.945604 11633 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:50.946972 11612 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:03:50.947176 11612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "dd34d6e087914b7eb477ef3265726f8f"
format_stamp: "Formatted at 2026-08-09 13:03:48 on dist-test-slave-jq4t"
server_key: "fa72ee645560db2b8f53c30273daeab1"
server_key_iv: "a8d34eaf4f57fcc41ee19d06954702f8"
server_key_version: "encryptionkey@0"
I20260809 13:03:50.948232 11612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:50.976116 11612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:50.981117 11612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:50.981457 11612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:50.982645 11612 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:03:50.984205 11612 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:03:50.984349 11612 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:50.984521 11612 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:03:50.984633 11612 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260809 13:03:51.021535 11612 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:43517
I20260809 13:03:51.021636 11808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:43517 every 8 connection(s)
I20260809 13:03:51.023120 11612 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:03:51.026262 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 11612
I20260809 13:03:51.026906 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:35187
--local_ip_for_outbound_sockets=127.28.155.195
--tserver_master_addrs=127.28.155.254:42377
--webserver_port=36363
--webserver_interface=127.28.155.195
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:43183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.28.155.195
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 13:03:51 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:51 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
W20260809 13:03:51.042212 11610 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:51.026095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:41441 (local address 127.28.155.254:42377)
0809 13:03:51.026337 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:51.026344 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:51.027657 (+ 1313us) server_negotiation.cc:407] Connection header received
0809 13:03:51.029783 (+ 2126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:51.029791 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:51.029895 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:51.030028 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:51.031680 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:51.032856 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:51.035164 (+ 2308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:51.035920 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:51.036080 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:51.041929 (+ 5849us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.194:41441: BlockingRecv error: recv got EOF from 127.28.155.194:41441 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
I20260809 13:03:51.043046 11818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:51.026585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.194:41441)
0809 13:03:51.027443 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:51.027502 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:51.029465 (+ 1963us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:51.030242 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:51.030251 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:51.030872 (+ 621us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:51.031469 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:51.031488 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:51.033042 (+ 1554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:51.033049 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:51.034987 (+ 1938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:51.035005 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:51.036168 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:51.036176 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:51.036513 (+ 337us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:51.037361 (+ 848us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:51.037395 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:51.041719 (+ 4324us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":564,"thread_start_us":375,"threads_started":1}
W20260809 13:03:51.043851 11811 heartbeater.cc:644] Failed to heartbeat to 127.28.155.254:42377 (0 consecutive failures): Not authorized: Failed to ping master at 127.28.155.254:42377: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Aug 09 13:03:51 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:51 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
W20260809 13:03:51.053925 11610 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:51.044760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:44491 (local address 127.28.155.254:42377)
0809 13:03:51.044917 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:51.044921 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:51.045070 (+ 149us) server_negotiation.cc:407] Connection header received
0809 13:03:51.045272 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:51.045278 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:51.045348 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:51.045454 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:51.046158 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:51.046920 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:51.048158 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:51.048676 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:51.048814 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:51.053733 (+ 4919us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.194:44491: BlockingRecv error: recv got EOF from 127.28.155.194:44491 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 13:03:51.053937 11818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:51.044610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.194:44491)
0809 13:03:51.044966 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:51.044984 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:51.045136 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:51.045485 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:51.045490 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:51.045849 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:51.045997 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:51.046005 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:51.047080 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:51.047086 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:51.048005 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:51.048016 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:51.048828 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:51.048834 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:51.049028 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:51.049777 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:51.049796 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:51.053507 (+ 3711us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":65}
Aug 09 13:03:51 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:51 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:51.063695 11818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:51.054960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.194:57941)
0809 13:03:51.055122 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:51.055140 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:51.055281 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:51.055622 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:51.055627 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:51.055964 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:51.056131 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:51.056140 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:51.057311 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:51.057316 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:51.058274 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:51.058287 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:51.059121 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:51.059127 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:51.059316 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:51.060158 (+ 842us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:51.060178 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:51.063352 (+ 3174us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 13:03:51.064093 11811 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 13:03:51.064286 11610 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:51.055118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:57941 (local address 127.28.155.254:42377)
0809 13:03:51.055313 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:51.055322 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:51.055343 (+ 21us) server_negotiation.cc:407] Connection header received
0809 13:03:51.055404 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:51.055409 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:51.055481 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:51.055587 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:51.056280 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:51.057161 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:51.058447 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:51.058955 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:51.059142 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:51.063601 (+ 4459us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.194:57941: BlockingRecv error: recv got EOF from 127.28.155.194:57941 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260809 13:03:51.401297 11819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:03:51.401670 11819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:03:51.401846 11819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:03:51.409602 11819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:03:51.409799 11819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:03:51.409991 11819 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:03:51.421073 11819 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:43183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/krb5kdc/oryx_127.28.155.195.keytab
--principal=oryx/127.28.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:35187
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=36363
--tserver_master_addrs=127.28.155.254:42377
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:03:51.422621 11819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:03:51.424043 11819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:03:51.439559 11826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:51.439529 11831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:03:51.439711 11834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:03:51.440548 11819 server_base.cc:1034] running on GCE node
I20260809 13:03:51.441236 11819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:03:51.442282 11819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:03:51.443511 11819 hybrid_clock.cc:648] HybridClock initialized: now 1786280631443432 us; error 52 us; skew 500 ppm
I20260809 13:03:51.443881 11819 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:03:51 dist-test-slave-jq4t krb5kdc[10500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280631, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:03:51.447367 11819 init.cc:377] Logged in from keytab as oryx/127.28.155.195@KRBTEST.COM (short username oryx)
I20260809 13:03:51.449000 11819 webserver.cc:460] Webserver started at http://127.28.155.195:36363/ using document root <none> and password file <none>
I20260809 13:03:51.449723 11819 fs_manager.cc:359] Metadata directory not provided
I20260809 13:03:51.449847 11819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:03:51.455919 11819 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 13:03:51.458774 11841 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:51.460316 11819 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 13:03:51.460529 11819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "34edb0408e8c4af9a7a7593e6e806553"
format_stamp: "Formatted at 2026-08-09 13:03:48 on dist-test-slave-jq4t"
server_key: "e7db61dd17bfd391c775c646f0682787"
server_key_iv: "7a94fcfbb77c0f6e6359f6a94b96cfd4"
server_key_version: "encryptionkey@0"
I20260809 13:03:51.461539 11819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:03:51.479609 11819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:03:51.483944 11819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:03:51.484202 11819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:03:51.485342 11819 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:03:51.486752 11819 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:03:51.486856 11819 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:51.486937 11819 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:03:51.487000 11819 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:03:51.523803 11819 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:35187
I20260809 13:03:51.523906 12022 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:35187 every 8 connection(s)
I20260809 13:03:51.525445 11819 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:03:51.530038 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 11819
Aug 09 13:03:51 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:51 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
W20260809 13:03:51.543723 11610 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:51.528364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:44451 (local address 127.28.155.254:42377)
0809 13:03:51.528649 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:51.528655 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:51.530201 (+ 1546us) server_negotiation.cc:407] Connection header received
0809 13:03:51.532792 (+ 2591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:51.532797 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:51.532880 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:51.532991 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:51.534629 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:51.535409 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:51.537164 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:51.537792 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:51.537953 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:51.543376 (+ 5423us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.195:44451: BlockingRecv error: recv got EOF from 127.28.155.195:44451 (error 108)
Metrics: {"server-negotiator.queue_time_us":100}
I20260809 13:03:51.544436 12028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:51.528918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.195:44451)
0809 13:03:51.529913 (+ 995us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:51.529969 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:51.532439 (+ 2470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:51.533266 (+ 827us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:51.533274 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:51.533827 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:51.534439 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:51.534460 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:51.535582 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:51.535587 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:51.536966 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:51.536979 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:51.538070 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:51.538078 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:51.538319 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:51.539001 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:51.539034 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:51.543067 (+ 4033us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":611,"thread_start_us":335,"threads_started":1}
W20260809 13:03:51.545405 12024 heartbeater.cc:644] Failed to heartbeat to 127.28.155.254:42377 (0 consecutive failures): Not authorized: Failed to ping master at 127.28.155.254:42377: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
I20260809 13:03:51.547753 12030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:51.531415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44794 (local address 127.28.155.254:42377)
0809 13:03:51.532181 (+ 766us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:51.532188 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:51.532206 (+ 18us) server_negotiation.cc:407] Connection header received
0809 13:03:51.532280 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:51.532284 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:51.532345 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:51.532470 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:51.534117 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:51.534906 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:51.536201 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:51.536706 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:51.536845 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:51.539699 (+ 2854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:03:51.539708 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:03:51.539725 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:03:51.539761 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:03:51.543510 (+ 3749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:51.544622 (+ 1112us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:51.544633 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:51.544645 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:51.544920 (+ 275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:03:51.545385 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:03:51.545389 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:03:51.545391 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:03:51.546036 (+ 645us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:03:51.546395 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0809 13:03:51.547031 (+ 636us) server_negotiation.cc:299] Negotiation successful
0809 13:03:51.547371 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":625,"thread_start_us":481,"threads_started":1}
Aug 09 13:03:51 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:51 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:51.554953 12028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:51.546118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.195:43587)
0809 13:03:51.546330 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:51.546352 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:51.546457 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:51.546797 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:51.546802 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:51.547241 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:51.547436 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:51.547448 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:51.548735 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:51.548741 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:51.549662 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:51.549673 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:51.550534 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:51.550538 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:51.550720 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:51.551417 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:51.551436 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:51.554730 (+ 3294us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":65}
W20260809 13:03:51.555205 11610 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:51.546225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:43587 (local address 127.28.155.254:42377)
0809 13:03:51.546412 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:51.546419 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:51.546437 (+ 18us) server_negotiation.cc:407] Connection header received
0809 13:03:51.546592 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:51.546595 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:51.546650 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:51.546726 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:51.547603 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:51.548596 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:51.549809 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:51.550374 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:51.550511 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:51.554956 (+ 4445us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.195:43587: BlockingRecv error: recv got EOF from 127.28.155.195:43587 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 09 13:03:51 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:51 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:51.565119 12028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:51.555698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.195:46725)
0809 13:03:51.555878 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:51.555897 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:51.555995 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:51.556282 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:51.556285 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:51.556653 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:51.556813 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:51.556822 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:51.557847 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:51.557851 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:51.558790 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:51.558802 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:51.559512 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:51.559516 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:51.559740 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:51.560399 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:51.560432 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:51.564783 (+ 4351us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":56}
W20260809 13:03:51.565394 11610 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:51.555813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:46725 (local address 127.28.155.254:42377)
0809 13:03:51.556039 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:51.556043 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:51.556058 (+ 15us) server_negotiation.cc:407] Connection header received
0809 13:03:51.556103 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:51.556106 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:51.556162 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:51.556241 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:51.556940 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:51.557719 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:51.558912 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:51.559313 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:51.559446 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:51.565066 (+ 5620us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.195:46725: BlockingRecv error: recv got EOF from 127.28.155.195:46725 (error 108)
Metrics: {"server-negotiator.queue_time_us":124}
W20260809 13:03:51.565588 12024 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 09 13:03:51 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:51 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:51.572070 12031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:51.560185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.193:55795)
0809 13:03:51.562889 (+ 2704us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:51.562908 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:51.563200 (+ 292us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:51.563581 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:51.563587 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:51.564434 (+ 847us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:51.564749 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:51.564763 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:51.566183 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:51.566187 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:51.567209 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:51.567223 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:51.567954 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:51.567958 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:51.568091 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:51.568764 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:51.568784 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:51.571805 (+ 3021us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":2555,"thread_start_us":2407,"threads_started":1}
W20260809 13:03:51.572288 12030 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:51.560259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:55795 (local address 127.28.155.254:42377)
0809 13:03:51.560556 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:51.560561 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:51.563003 (+ 2442us) server_negotiation.cc:407] Connection header received
0809 13:03:51.563334 (+ 331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:51.563339 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:51.563409 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:51.563524 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:51.564931 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:51.566034 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:51.567347 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:51.567791 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:51.567888 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:51.572038 (+ 4150us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.193:55795: BlockingRecv error: recv got EOF from 127.28.155.193:55795 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 09 13:03:52 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:52 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:52.073825 12032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:52.064972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.194:58193)
0809 13:03:52.065610 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:52.065634 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:52.065887 (+ 253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:52.066312 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:52.066317 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:52.066846 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:52.067052 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:52.067061 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:52.068044 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:52.068048 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:52.069054 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:52.069065 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:52.069797 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:52.069801 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:52.069929 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:52.070554 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:52.070572 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:52.073598 (+ 3026us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":355,"threads_started":1}
W20260809 13:03:52.074054 12030 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:52.065060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:58193 (local address 127.28.155.254:42377)
0809 13:03:52.065306 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:52.065314 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:52.065746 (+ 432us) server_negotiation.cc:407] Connection header received
0809 13:03:52.066036 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:52.066041 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:52.066147 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:52.066255 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:52.067183 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:52.067914 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:52.069204 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:52.069632 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:52.069737 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:52.073814 (+ 4077us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.194:58193: BlockingRecv error: recv got EOF from 127.28.155.194:58193 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 09 13:03:52 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:52 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:52.576483 12034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:52.566341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.195:34421)
0809 13:03:52.566964 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:52.566981 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:52.567159 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:52.567655 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:52.567660 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:52.568219 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:52.568436 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:52.568448 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:52.569667 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:52.569674 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:52.570700 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:52.570714 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:52.571530 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:52.571537 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:52.571732 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:52.572376 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:52.572395 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:52.576182 (+ 3787us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":350,"threads_started":1}
W20260809 13:03:52.576802 12030 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:52.566384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:34421 (local address 127.28.155.254:42377)
0809 13:03:52.566674 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:52.566681 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:52.567109 (+ 428us) server_negotiation.cc:407] Connection header received
0809 13:03:52.567315 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:52.567320 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:52.567466 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:52.567593 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:52.568652 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:52.569494 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:52.570885 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:52.571332 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:52.571472 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:52.576524 (+ 5052us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.195:34421: BlockingRecv error: recv got EOF from 127.28.155.195:34421 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 09 13:03:52 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:52 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:52.582930 12036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:52.573166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.193:50655)
0809 13:03:52.573864 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:52.573891 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:52.574028 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:52.574537 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:52.574547 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:52.574940 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:52.575189 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:52.575206 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:52.576459 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:52.576466 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:52.577666 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:52.577684 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:52.578535 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:52.578543 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:52.578722 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:52.579375 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:52.579394 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:52.582662 (+ 3268us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":335,"threads_started":1}
W20260809 13:03:52.583304 12037 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:52.573220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:50655 (local address 127.28.155.254:42377)
0809 13:03:52.574191 (+ 971us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:52.574199 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:52.574222 (+ 23us) server_negotiation.cc:407] Connection header received
0809 13:03:52.574277 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:52.574284 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:52.574365 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:52.574489 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:52.575369 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:52.576293 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:52.577828 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:52.578340 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:52.578475 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:52.583000 (+ 4525us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.193:50655: BlockingRecv error: recv got EOF from 127.28.155.193:50655 (error 108)
Metrics: {"server-negotiator.queue_time_us":842,"thread_start_us":664,"threads_started":1}
Aug 09 13:03:53 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:53 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:53.084548 12038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:53.074979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.194:51491)
0809 13:03:53.075554 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:53.075572 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:53.075716 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:53.076087 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:53.076091 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:53.076602 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:53.076787 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:53.076797 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:53.078457 (+ 1660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:53.078462 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:53.079586 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:53.079600 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:53.080328 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:53.080332 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:53.080464 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:53.081205 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:53.081224 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:53.084225 (+ 3001us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":328,"threads_started":1}
W20260809 13:03:53.085047 12037 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:53.075091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:51491 (local address 127.28.155.254:42377)
0809 13:03:53.075400 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:53.075407 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:53.075660 (+ 253us) server_negotiation.cc:407] Connection header received
0809 13:03:53.075844 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:53.075848 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:53.075921 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:53.076010 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:53.076957 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:53.078266 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:53.079730 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:53.080180 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:53.080287 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:53.084578 (+ 4291us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.194:51491: BlockingRecv error: recv got EOF from 127.28.155.194:51491 (error 108)
Metrics: {"server-negotiator.queue_time_us":118}
Aug 09 13:03:53 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:53 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:53.587708 12039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:53.577567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.195:45059)
0809 13:03:53.578193 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:53.578210 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:53.578382 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:53.578769 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:53.578774 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:53.579250 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:53.579449 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:53.579459 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:53.580661 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:53.580666 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:53.581731 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:53.581745 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:53.582659 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:53.582665 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:53.582845 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:53.583483 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:53.583507 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:53.587366 (+ 3859us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":347,"threads_started":1}
W20260809 13:03:53.587867 12037 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:53.577787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:45059 (local address 127.28.155.254:42377)
0809 13:03:53.578049 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:53.578055 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:53.578302 (+ 247us) server_negotiation.cc:407] Connection header received
0809 13:03:53.578521 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:53.578531 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:53.578598 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:53.578714 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:53.579602 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:53.580427 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:53.581890 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:53.582496 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:53.582635 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:53.587599 (+ 4964us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.195:45059: BlockingRecv error: recv got EOF from 127.28.155.195:45059 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 09 13:03:53 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:53 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:53.593488 12042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:53.583957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.193:33407)
0809 13:03:53.584884 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:53.584906 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:53.585057 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:53.585426 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:53.585433 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:53.585916 (+ 483us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:53.586194 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:53.586211 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:53.587625 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:53.587630 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:53.588837 (+ 1207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:53.588852 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:53.589516 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:53.589520 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:53.589651 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:53.590304 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:53.590323 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:53.593119 (+ 2796us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":747,"thread_start_us":628,"threads_started":1}
W20260809 13:03:53.593782 12043 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:53.584080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:33407 (local address 127.28.155.254:42377)
0809 13:03:53.584684 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:53.584692 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:53.585005 (+ 313us) server_negotiation.cc:407] Connection header received
0809 13:03:53.585188 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:53.585192 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:53.585251 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:53.585338 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:53.586358 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:53.587458 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:53.588973 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:53.589370 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:53.589469 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:53.593443 (+ 3974us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.193:33407: BlockingRecv error: recv got EOF from 127.28.155.193:33407 (error 108)
Metrics: {"server-negotiator.queue_time_us":464,"thread_start_us":265,"threads_started":1}
Aug 09 13:03:54 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:54 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:54.095118 12044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:54.085691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.194:58413)
0809 13:03:54.086302 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:54.086320 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:54.086489 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:54.086873 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:54.086878 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:54.087311 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:54.087494 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:54.087503 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:54.088853 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:54.088861 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:54.089821 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:54.089833 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:54.090564 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:54.090571 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:54.090771 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:54.091427 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:54.091445 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:54.094735 (+ 3290us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":319,"threads_started":1}
W20260809 13:03:54.095244 12043 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:54.085742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:58413 (local address 127.28.155.254:42377)
0809 13:03:54.086007 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:54.086014 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:54.086421 (+ 407us) server_negotiation.cc:407] Connection header received
0809 13:03:54.086646 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:54.086653 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:54.086723 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:54.086831 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:54.087665 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:54.088715 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:54.089977 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:54.090408 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:54.090547 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:54.094978 (+ 4431us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.194:58413: BlockingRecv error: recv got EOF from 127.28.155.194:58413 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 09 13:03:54 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:54 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:54.598793 12045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:54.588973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.195:45065)
0809 13:03:54.589599 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:54.589616 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:54.589791 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:54.590291 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:54.590296 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:54.590830 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:54.591090 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:54.591102 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:54.592236 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:54.592240 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:54.593250 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:54.593262 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:54.593979 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:54.593983 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:54.594106 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:54.594909 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:54.594941 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:54.598505 (+ 3564us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":320,"threads_started":1}
W20260809 13:03:54.599042 12043 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:54.589245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:45065 (local address 127.28.155.254:42377)
0809 13:03:54.589481 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:54.589487 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:54.589711 (+ 224us) server_negotiation.cc:407] Connection header received
0809 13:03:54.589948 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:54.589981 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:54.590095 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:54.590213 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:54.591267 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:54.592111 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:54.593392 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:54.593813 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:54.593962 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:54.598788 (+ 4826us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.195:45065: BlockingRecv error: recv got EOF from 127.28.155.195:45065 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 09 13:03:54 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:54 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:54.604213 12046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:54.594570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.193:45593)
0809 13:03:54.595195 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:54.595215 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:54.595337 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:54.596073 (+ 736us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:54.596081 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:54.596555 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:54.596759 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:54.596773 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:54.598183 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:54.598187 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:54.599514 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:54.599529 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:54.600193 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:54.600197 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:54.600319 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:54.600955 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:54.600974 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:54.603979 (+ 3005us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":355,"threads_started":1}
W20260809 13:03:54.604539 12047 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:54.594664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:45593 (local address 127.28.155.254:42377)
0809 13:03:54.595767 (+ 1103us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:54.595771 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:54.595786 (+ 15us) server_negotiation.cc:407] Connection header received
0809 13:03:54.595824 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:54.595827 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:54.595883 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:54.595970 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:54.596923 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:54.598022 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:54.599647 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:54.600055 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:54.600160 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:54.604182 (+ 4022us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.193:45593: BlockingRecv error: recv got EOF from 127.28.155.193:45593 (error 108)
Metrics: {"server-negotiator.queue_time_us":1010,"thread_start_us":617,"threads_started":1}
Aug 09 13:03:55 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:55 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:55.111236 12048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:55.096289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.194:57077)
0809 13:03:55.096884 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:55.096903 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:55.097027 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:55.097347 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:55.097351 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:55.097763 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:55.097925 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:55.097934 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:55.098982 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:55.098986 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:55.100001 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:55.100012 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:55.100737 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:55.100750 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:55.100879 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:55.107702 (+ 6823us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:55.107726 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:55.110981 (+ 3255us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":352,"threads_started":1}
W20260809 13:03:55.111526 12047 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:55.096338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:57077 (local address 127.28.155.254:42377)
0809 13:03:55.096588 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:55.096593 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:55.096979 (+ 386us) server_negotiation.cc:407] Connection header received
0809 13:03:55.097134 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:55.097137 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:55.097201 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:55.097290 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:55.098056 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:55.098842 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:55.100134 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:55.100604 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:55.100702 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:55.111242 (+ 10540us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.194:57077: BlockingRecv error: recv got EOF from 127.28.155.194:57077 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 09 13:03:55 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:55 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:55.609624 12049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:55.600072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.195:47597)
0809 13:03:55.600678 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:55.600696 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:55.600874 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:55.601298 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:55.601303 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:55.601779 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:55.601994 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:55.602005 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:55.603185 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:55.603191 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:55.604196 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:55.604208 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:55.605011 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:55.605016 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:55.605211 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:55.606064 (+ 853us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:55.606084 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:55.609258 (+ 3174us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":312,"threads_started":1}
W20260809 13:03:55.609808 12047 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:55.600152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:47597 (local address 127.28.155.254:42377)
0809 13:03:55.600412 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:55.600421 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:55.600804 (+ 383us) server_negotiation.cc:407] Connection header received
0809 13:03:55.601010 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:55.601020 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:55.601111 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:55.601231 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:55.602147 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:55.603036 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:55.604354 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:55.604854 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:55.604997 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:55.609474 (+ 4477us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.195:47597: BlockingRecv error: recv got EOF from 127.28.155.195:47597 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
Aug 09 13:03:55 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:55 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:55.614423 12050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:55.605280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.193:51513)
0809 13:03:55.605896 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:55.605920 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:55.606053 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:55.606503 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:55.606509 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:55.606944 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:55.607136 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:55.607150 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:55.608292 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:55.608299 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:55.609380 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:55.609394 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:55.610410 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:55.610416 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:55.610610 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:55.611190 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:55.611209 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:55.614065 (+ 2856us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":293,"threads_started":1}
W20260809 13:03:55.614583 12053 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:55.605431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:51513 (local address 127.28.155.254:42377)
0809 13:03:55.606205 (+ 774us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:55.606211 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:55.606229 (+ 18us) server_negotiation.cc:407] Connection header received
0809 13:03:55.606272 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:55.606276 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:55.606325 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:55.606442 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:55.607305 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:55.608166 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:55.609539 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:55.610253 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:55.610391 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:55.614314 (+ 3923us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.193:51513: BlockingRecv error: recv got EOF from 127.28.155.193:51513 (error 108)
Metrics: {"server-negotiator.queue_time_us":649,"thread_start_us":458,"threads_started":1}
Aug 09 13:03:56 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:56 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:56.121548 12055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:56.112495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.194:48077)
0809 13:03:56.113301 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:56.113322 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:56.113473 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:56.113839 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:56.113842 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:56.114395 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:56.114580 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:56.114589 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:56.115686 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:56.115690 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:56.116677 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:56.116688 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:56.117349 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:56.117353 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:56.117474 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:56.118135 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:56.118154 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:56.121254 (+ 3100us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":667,"thread_start_us":279,"threads_started":1}
W20260809 13:03:56.121696 12053 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:56.112741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:48077 (local address 127.28.155.254:42377)
0809 13:03:56.112957 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:56.112964 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:56.113436 (+ 472us) server_negotiation.cc:407] Connection header received
0809 13:03:56.113612 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:56.113617 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:56.113702 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:56.113828 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:56.114725 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:56.115548 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:56.116808 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:56.117223 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:56.117319 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:56.121479 (+ 4160us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.194:48077: BlockingRecv error: recv got EOF from 127.28.155.194:48077 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 09 13:03:56 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:56 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:56.621459 12057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:56.610867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.195:38711)
0809 13:03:56.611397 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:56.611414 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:56.611537 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:56.611848 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:56.611851 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:56.612315 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:56.612535 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:56.612546 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:56.613547 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:56.613551 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:56.614495 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:56.614508 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:56.615532 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:56.615538 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:56.615757 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:56.616746 (+ 989us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:56.616771 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:56.621194 (+ 4423us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":267,"threads_started":1}
W20260809 13:03:56.621740 12053 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:56.611019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:38711 (local address 127.28.155.254:42377)
0809 13:03:56.611280 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:56.611287 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:56.611502 (+ 215us) server_negotiation.cc:407] Connection header received
0809 13:03:56.611638 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:56.611641 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:56.611704 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:56.611785 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:56.612659 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:56.613385 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:56.614693 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:56.615371 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:56.615496 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:56.621446 (+ 5950us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.195:38711: BlockingRecv error: recv got EOF from 127.28.155.195:38711 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
Aug 09 13:03:56 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:56 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:56.625334 12058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:56.615495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.193:55569)
0809 13:03:56.616078 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:56.616103 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:56.616236 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:56.616779 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:56.616784 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:56.617328 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:56.617540 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:56.617553 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:56.618607 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:56.618611 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:56.619534 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:56.619547 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:56.620265 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:56.620271 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:56.620460 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:56.621178 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:56.621206 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:56.625004 (+ 3798us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":320,"threads_started":1}
W20260809 13:03:56.625630 12059 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:56.615526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:55569 (local address 127.28.155.254:42377)
0809 13:03:56.616384 (+ 858us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:56.616389 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:56.616410 (+ 21us) server_negotiation.cc:407] Connection header received
0809 13:03:56.616495 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:56.616501 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:56.616594 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:56.616714 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:56.617684 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:56.618400 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:56.619671 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:56.620098 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:56.620231 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:56.625209 (+ 4978us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.193:55569: BlockingRecv error: recv got EOF from 127.28.155.193:55569 (error 108)
Metrics: {"server-negotiator.queue_time_us":732,"thread_start_us":583,"threads_started":1}
Aug 09 13:03:57 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:57 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:57.131629 12060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:57.122721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.194:56529)
0809 13:03:57.123358 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:57.123376 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:57.123509 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:57.123854 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:57.123859 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:57.124428 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:57.124658 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:57.124668 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:57.126029 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:57.126033 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:57.126950 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:57.126968 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:57.127641 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:57.127645 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:57.127771 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:57.128396 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:57.128414 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:57.131386 (+ 2972us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":373,"threads_started":1}
W20260809 13:03:57.131892 12059 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:57.122822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:56529 (local address 127.28.155.254:42377)
0809 13:03:57.123066 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:57.123071 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:57.123456 (+ 385us) server_negotiation.cc:407] Connection header received
0809 13:03:57.123617 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:57.123622 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:57.123687 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:57.123776 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:57.124851 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:57.125882 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:57.127100 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:57.127508 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:57.127602 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:57.131599 (+ 3997us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.194:56529: BlockingRecv error: recv got EOF from 127.28.155.194:56529 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 09 13:03:57 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:57 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:57.633026 12061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:57.622620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.195:45677)
0809 13:03:57.623240 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:57.623257 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:57.623391 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:57.623858 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:57.623864 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:57.624371 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:57.624646 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:57.624658 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:57.625960 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:57.625966 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:57.627024 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:57.627038 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:57.628091 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:57.628098 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:57.628292 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:57.629041 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:57.629059 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:57.632676 (+ 3617us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":342,"threads_started":1}
W20260809 13:03:57.633251 12059 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:57.622720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:45677 (local address 127.28.155.254:42377)
0809 13:03:57.622903 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:57.622908 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:57.623342 (+ 434us) server_negotiation.cc:407] Connection header received
0809 13:03:57.623577 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:57.623582 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:57.623673 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:57.623795 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:57.624799 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:57.625777 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:57.627189 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:57.627917 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:57.628056 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:57.632919 (+ 4863us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.195:45677: BlockingRecv error: recv got EOF from 127.28.155.195:45677 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 09 13:03:57 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:57 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:57.637334 12062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:57.626271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.193:51611)
0809 13:03:57.627915 (+ 1644us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:57.627931 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:57.628098 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:57.628465 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:57.628471 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:57.629087 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:57.629265 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:57.629274 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:57.630902 (+ 1628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:57.630908 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:57.632233 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:57.632251 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:57.633098 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:57.633104 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:57.633295 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:57.634071 (+ 776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:57.634090 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:57.637057 (+ 2967us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1518,"thread_start_us":1283,"threads_started":1}
W20260809 13:03:57.637626 12063 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:57.626362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:51611 (local address 127.28.155.254:42377)
0809 13:03:57.627702 (+ 1340us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:57.627708 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:57.628037 (+ 329us) server_negotiation.cc:407] Connection header received
0809 13:03:57.628225 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:57.628236 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:57.628294 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:57.628409 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:57.629424 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:57.630696 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:57.632399 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:57.632910 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:57.633071 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:57.637311 (+ 4240us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.193:51611: BlockingRecv error: recv got EOF from 127.28.155.193:51611 (error 108)
Metrics: {"server-negotiator.queue_time_us":1204,"thread_start_us":1012,"threads_started":1}
Aug 09 13:03:58 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:58 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:58.142613 12064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:58.132820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.194:33655)
0809 13:03:58.133582 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:58.133606 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:58.133776 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:58.134149 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:58.134152 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:58.134733 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:58.135137 (+ 404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:58.135161 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:58.136523 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:58.136529 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:58.137540 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:58.137552 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:58.138411 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:58.138415 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:58.138547 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:58.139237 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:58.139256 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:58.142325 (+ 3069us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":622,"thread_start_us":312,"threads_started":1}
W20260809 13:03:58.142922 12063 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:58.132904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:33655 (local address 127.28.155.254:42377)
0809 13:03:58.133138 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:58.133147 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:58.133719 (+ 572us) server_negotiation.cc:407] Connection header received
0809 13:03:58.133933 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:58.133937 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:58.134006 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:58.134086 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:58.135395 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:58.136291 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:58.137716 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:58.138263 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:58.138370 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:58.142653 (+ 4283us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.194:33655: BlockingRecv error: recv got EOF from 127.28.155.194:33655 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 09 13:03:58 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:58 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:58.645838 12065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:58.634610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.195:47529)
0809 13:03:58.635423 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:58.635441 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:58.635652 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:58.636039 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:58.636044 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:58.636718 (+ 674us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:58.637013 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:58.637027 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:58.638128 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:58.638135 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:58.639509 (+ 1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:58.639524 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:58.640720 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:58.640726 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:58.640934 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:58.641721 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:58.641746 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:58.645563 (+ 3817us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":703,"thread_start_us":449,"threads_started":1}
W20260809 13:03:58.646098 12063 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:58.634658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:47529 (local address 127.28.155.254:42377)
0809 13:03:58.634992 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:58.635001 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:58.635577 (+ 576us) server_negotiation.cc:407] Connection header received
0809 13:03:58.635805 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:58.635810 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:58.635879 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:58.635997 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:58.637175 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:58.637968 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:58.639720 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:58.640435 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:58.640585 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:58.645813 (+ 5228us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.195:47529: BlockingRecv error: recv got EOF from 127.28.155.195:47529 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
Aug 09 13:03:58 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:58 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:58.648701 12067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:58.638347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.193:50095)
0809 13:03:58.638987 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:58.639008 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:58.639151 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:58.639651 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:58.639658 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:58.640274 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:58.640533 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:58.640551 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:58.642500 (+ 1949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:58.642507 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:58.643588 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:58.643602 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:58.644410 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:58.644418 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:58.644630 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:58.645319 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:58.645337 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:58.648349 (+ 3012us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":330,"threads_started":1}
W20260809 13:03:58.648880 12068 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:58.638548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:50095 (local address 127.28.155.254:42377)
0809 13:03:58.639302 (+ 754us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:58.639309 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:58.639331 (+ 22us) server_negotiation.cc:407] Connection header received
0809 13:03:58.639383 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:58.639388 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:58.639460 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:58.639577 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:58.640703 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:58.642270 (+ 1567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:58.643737 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:58.644213 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:58.644350 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:58.648603 (+ 4253us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.193:50095: BlockingRecv error: recv got EOF from 127.28.155.193:50095 (error 108)
Metrics: {"server-negotiator.queue_time_us":615,"thread_start_us":471,"threads_started":1}
Aug 09 13:03:59 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:59 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:59.153541 12069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:59.143707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.194:36199)
0809 13:03:59.144288 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:59.144305 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:59.144471 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:59.144880 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:59.144885 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:59.145355 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:59.145531 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:59.145540 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:59.146969 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:59.146975 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:59.147992 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:59.148011 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:59.148974 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:59.148980 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:59.149128 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:59.149769 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:59.149789 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:59.153180 (+ 3391us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":313,"threads_started":1}
W20260809 13:03:59.153693 12068 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:59.143835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:36199 (local address 127.28.155.254:42377)
0809 13:03:59.144067 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:59.144076 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:59.144394 (+ 318us) server_negotiation.cc:407] Connection header received
0809 13:03:59.144653 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:59.144658 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:59.144736 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:59.144846 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:59.145683 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:59.146820 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:59.148146 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:59.148737 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:59.148884 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:59.153423 (+ 4539us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.194:36199: BlockingRecv error: recv got EOF from 127.28.155.194:36199 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 09 13:03:59 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:59 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:59.658164 12070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:59.647014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.195:40829)
0809 13:03:59.647641 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:59.647659 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:59.647793 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:59.648160 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:59.648164 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:59.648690 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:59.648871 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:59.648881 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:59.650767 (+ 1886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:59.650776 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:59.652336 (+ 1560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:59.652351 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:59.653429 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:59.653435 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:59.653600 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:59.654302 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:59.654321 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:59.657763 (+ 3442us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":329,"threads_started":1}
W20260809 13:03:59.658226 12068 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:59.647187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:40829 (local address 127.28.155.254:42377)
0809 13:03:59.647390 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:59.647395 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:59.647753 (+ 358us) server_negotiation.cc:407] Connection header received
0809 13:03:59.647913 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:59.647917 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:59.648003 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:59.648102 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:59.649057 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:59.650126 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:59.652516 (+ 2390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:59.653149 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:59.653326 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:59.657955 (+ 4629us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.195:40829: BlockingRecv error: recv got EOF from 127.28.155.195:40829 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 09 13:03:59 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:03:59 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:03:59.660385 12072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:03:59.649726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.193:41479)
0809 13:03:59.650749 (+ 1023us) negotiation.cc:107] Waiting for socket to connect
0809 13:03:59.650773 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 13:03:59.651033 (+ 260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:03:59.651660 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:03:59.651665 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:03:59.652372 (+ 707us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:03:59.652659 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:59.652672 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:59.653958 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:59.653963 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:59.655094 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:03:59.655107 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:03:59.655917 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:03:59.655924 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:03:59.656120 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:59.656794 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:03:59.656824 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:03:59.660142 (+ 3318us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":875,"thread_start_us":727,"threads_started":1}
W20260809 13:03:59.660643 12073 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:03:59.649780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:41479 (local address 127.28.155.254:42377)
0809 13:03:59.650555 (+ 775us) server_negotiation.cc:206] Beginning negotiation
0809 13:03:59.650561 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:03:59.650950 (+ 389us) server_negotiation.cc:407] Connection header received
0809 13:03:59.651200 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:03:59.651204 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:03:59.651261 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:03:59.651387 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:03:59.652811 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:59.653815 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:59.655256 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:03:59.655699 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:03:59.655855 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:03:59.660339 (+ 4484us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.193:41479: BlockingRecv error: recv got EOF from 127.28.155.193:41479 (error 108)
Metrics: {"server-negotiator.queue_time_us":641,"thread_start_us":447,"threads_started":1}
Aug 09 13:04:00 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:04:00 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:04:00.169158 12074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:00.154966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.194:48463)
0809 13:04:00.155680 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:00.155698 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:00.155820 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:00.156253 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:00.156260 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:00.156747 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:04:00.156930 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:00.156939 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:00.158209 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:00.158218 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:00.160231 (+ 2013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:00.160247 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:00.161235 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:00.161240 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:00.161381 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:00.165085 (+ 3704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:04:00.165105 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:04:00.168760 (+ 3655us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":388,"threads_started":1}
W20260809 13:04:00.169268 12073 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:04:00.155026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:48463 (local address 127.28.155.254:42377)
0809 13:04:00.155223 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:00.155227 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:00.155786 (+ 559us) server_negotiation.cc:407] Connection header received
0809 13:04:00.155971 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:00.155981 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:00.156047 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:00.156158 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:00.157071 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:00.158039 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:00.160369 (+ 2330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:00.161052 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:00.161162 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:00.168990 (+ 7828us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.194:48463: BlockingRecv error: recv got EOF from 127.28.155.194:48463 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 09 13:04:00 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:04:00 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:04:00 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:04:00 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:04:00.670645 12075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:00.659314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.195:34159)
0809 13:04:00.660156 (+ 842us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:00.660172 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:00.660391 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:00.660765 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:00.660768 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:00.661308 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:04:00.661548 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:00.661565 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:00.663055 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:00.663061 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:00.664202 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:00.664216 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:00.665241 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:00.665247 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:00.665451 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:00.666454 (+ 1003us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:04:00.666485 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:04:00.670242 (+ 3757us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":724,"thread_start_us":572,"threads_started":1}
W20260809 13:04:00.670729 12073 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:04:00.659394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:34159 (local address 127.28.155.254:42377)
0809 13:04:00.659648 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:00.659659 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:00.660329 (+ 670us) server_negotiation.cc:407] Connection header received
0809 13:04:00.660544 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:00.660548 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:00.660634 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:00.660722 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:00.661759 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:00.662900 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:00.664378 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:00.664895 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:00.665000 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:00.670477 (+ 5477us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.195:34159: BlockingRecv error: recv got EOF from 127.28.155.195:34159 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 13:04:00.671083 12078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:00.661426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.193:42787)
0809 13:04:00.662076 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:00.662095 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:00.662216 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:00.662646 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:00.662650 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:00.663157 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:04:00.663356 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:00.663369 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:00.664545 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:00.664550 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:00.665874 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:00.665893 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:00.666772 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:00.666779 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:00.666984 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:00.667626 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:04:00.667658 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:04:00.670721 (+ 3063us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":332,"threads_started":1}
W20260809 13:04:00.671273 12080 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:04:00.661486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:42787 (local address 127.28.155.254:42377)
0809 13:04:00.662320 (+ 834us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:00.662326 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:00.662343 (+ 17us) server_negotiation.cc:407] Connection header received
0809 13:04:00.662401 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:00.662406 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:00.662468 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:00.662571 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:00.663562 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:00.664354 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:00.666035 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:00.666619 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:00.666740 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:00.670948 (+ 4208us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.193:42787: BlockingRecv error: recv got EOF from 127.28.155.193:42787 (error 108)
Metrics: {"server-negotiator.queue_time_us":725,"thread_start_us":569,"threads_started":1}
Aug 09 13:04:01 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:04:01 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:04:01.179948 12082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:01.170590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.194:44277)
0809 13:04:01.171227 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:01.171245 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:01.171425 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:01.171890 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:01.171893 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:01.172305 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:04:01.172544 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:01.172555 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:01.173563 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:01.173566 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:01.174551 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:01.174562 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:01.175466 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:01.175472 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:01.175647 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:01.176427 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:04:01.176458 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:04:01.179711 (+ 3253us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":383,"threads_started":1}
W20260809 13:04:01.180215 12080 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:04:01.170711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:44277 (local address 127.28.155.254:42377)
0809 13:04:01.171010 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:01.171019 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:01.171348 (+ 329us) server_negotiation.cc:407] Connection header received
0809 13:04:01.171577 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:01.171588 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:01.171695 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:01.171812 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:01.172696 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:01.173430 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:01.174734 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:01.175289 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:01.175436 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:01.179977 (+ 4541us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.194:44277: BlockingRecv error: recv got EOF from 127.28.155.194:44277 (error 108)
Metrics: {"server-negotiator.queue_time_us":111}
Aug 09 13:04:01 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:04:01 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:04:01 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:04:01 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:04:01.685958 12086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:01.672207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.195:43243)
0809 13:04:01.673612 (+ 1405us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:01.673639 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:01.673787 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:01.674251 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:01.674256 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:01.674800 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:04:01.675046 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:01.675058 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:01.676153 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:01.676158 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:01.677355 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:01.677368 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:01.678181 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:01.678187 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:01.678375 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:01.682112 (+ 3737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:04:01.682134 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:04:01.685599 (+ 3465us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1245,"thread_start_us":1109,"threads_started":1}
I20260809 13:04:01.686268 12084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:01.672211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.193:55775)
0809 13:04:01.673838 (+ 1627us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:01.673859 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:01.674313 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:01.674724 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:01.674730 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:01.675275 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:04:01.675464 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:01.675474 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:01.676528 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:01.676537 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:01.677565 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:01.677579 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:01.678434 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:01.678440 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:01.678628 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:01.682160 (+ 3532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:04:01.682180 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:04:01.685931 (+ 3751us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":682,"thread_start_us":521,"threads_started":1}
W20260809 13:04:01.686447 12080 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:04:01.672463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:55775 (local address 127.28.155.254:42377)
0809 13:04:01.673132 (+ 669us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:01.673142 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:01.673940 (+ 798us) server_negotiation.cc:407] Connection header received
0809 13:04:01.674480 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:01.674484 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:01.674557 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:01.674655 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:01.675619 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:01.676360 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:01.677725 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:01.678248 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:01.678408 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:01.686113 (+ 7705us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.193:55775: BlockingRecv error: recv got EOF from 127.28.155.193:55775 (error 108)
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":483}
W20260809 13:04:01.687062 12087 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:04:01.672496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:43243 (local address 127.28.155.254:42377)
0809 13:04:01.673902 (+ 1406us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:01.673909 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:01.673929 (+ 20us) server_negotiation.cc:407] Connection header received
0809 13:04:01.674009 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:01.674013 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:01.674075 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:01.674164 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:01.675197 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:01.676016 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:01.677506 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:01.678009 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:01.678160 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:01.686760 (+ 8600us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.195:43243: BlockingRecv error: recv got EOF from 127.28.155.195:43243 (error 108)
Metrics: {"mutex_wait_us":401,"server-negotiator.queue_time_us":1291,"thread_start_us":714,"threads_started":1}
Aug 09 13:04:02 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:04:02 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:04:02.190369 12089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:02.181237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.194:53907)
0809 13:04:02.181777 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:02.181794 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:02.181918 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:02.182229 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:02.182232 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:02.182680 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:04:02.182865 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:02.182874 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:02.183861 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:02.183865 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:02.184873 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:02.184885 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:02.185544 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:02.185548 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:02.185670 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:02.186311 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:04:02.186329 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:04:02.190104 (+ 3775us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":307,"threads_started":1}
W20260809 13:04:02.190589 12087 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:04:02.181364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:53907 (local address 127.28.155.254:42377)
0809 13:04:02.181639 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:02.181646 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:02.181885 (+ 239us) server_negotiation.cc:407] Connection header received
0809 13:04:02.182029 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:02.182032 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:02.182097 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:02.182180 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:02.182993 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:02.183740 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:02.184995 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:02.185408 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:02.185499 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:02.190326 (+ 4827us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.194:53907: BlockingRecv error: recv got EOF from 127.28.155.194:53907 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 09 13:04:02 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:04:02 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:04:02 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:04:02 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:04:02.698961 12090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:02.687516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.193:54603)
0809 13:04:02.688325 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:02.688346 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:02.688608 (+ 262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:02.689257 (+ 649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:02.689260 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:02.689847 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:04:02.690093 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:02.690108 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:02.691828 (+ 1720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:02.691835 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:02.693168 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:02.693190 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:02.694277 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:02.694286 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:02.694480 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:02.695226 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:04:02.695256 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:04:02.698591 (+ 3335us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":688,"thread_start_us":558,"threads_started":1}
W20260809 13:04:02.699199 12087 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:04:02.687579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:54603 (local address 127.28.155.254:42377)
0809 13:04:02.687821 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:02.687830 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:02.688443 (+ 613us) server_negotiation.cc:407] Connection header received
0809 13:04:02.688785 (+ 342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:02.688794 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:02.688945 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:02.689033 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:02.690270 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:02.691586 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:02.693351 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:02.694106 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:02.694346 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:02.698844 (+ 4498us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.193:54603: BlockingRecv error: recv got EOF from 127.28.155.193:54603 (error 108)
Metrics: {"mutex_wait_us":116,"server-negotiator.queue_time_us":80}
W20260809 13:04:02.699455 12092 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:04:02.687745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:55963 (local address 127.28.155.254:42377)
0809 13:04:02.689188 (+ 1443us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:02.689192 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:02.689207 (+ 15us) server_negotiation.cc:407] Connection header received
0809 13:04:02.689248 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:02.689251 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:02.689304 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:02.689391 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:02.690417 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:02.691578 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:02.693259 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:02.694093 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:02.694262 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:02.699099 (+ 4837us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.195:55963: BlockingRecv error: recv got EOF from 127.28.155.195:55963 (error 108)
Metrics: {"mutex_wait_us":77,"server-negotiator.queue_time_us":1351,"thread_start_us":1171,"threads_started":1}
I20260809 13:04:02.699615 12091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:02.687703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.195:55963)
0809 13:04:02.688732 (+ 1029us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:02.688751 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:02.688868 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:02.689475 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:02.689480 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:02.689996 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:04:02.690248 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:02.690261 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:02.691733 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:02.691738 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:02.693112 (+ 1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:02.693126 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:02.694309 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:02.694316 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:02.694540 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:02.695367 (+ 827us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:04:02.695398 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:04:02.698811 (+ 3413us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":894,"thread_start_us":758,"threads_started":1}
Aug 09 13:04:03 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:04:03 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:04:03.200862 12093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:03.191692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.194:46385)
0809 13:04:03.192255 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:03.192274 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:03.192409 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:03.192848 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:03.192851 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:03.193275 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:04:03.193437 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:03.193445 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:03.194832 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:03.194839 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:03.196050 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:03.196062 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:03.196737 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:03.196741 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:03.196867 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:03.197495 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:04:03.197513 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:04:03.200621 (+ 3108us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":341,"threads_started":1}
W20260809 13:04:03.201071 12092 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:04:03.191821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:46385 (local address 127.28.155.254:42377)
0809 13:04:03.192137 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:03.192145 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:03.192374 (+ 229us) server_negotiation.cc:407] Connection header received
0809 13:04:03.192611 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:03.192615 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:03.192685 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:03.192780 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:03.193615 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:03.194652 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:03.196180 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:03.196606 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:03.196699 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:03.200814 (+ 4115us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.194:46385: BlockingRecv error: recv got EOF from 127.28.155.194:46385 (error 108)
Metrics: {"server-negotiator.queue_time_us":140}
Aug 09 13:04:03 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:04:03 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:04:03 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:04:03 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:04:03.710604 12095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:03.700708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.195:53275)
0809 13:04:03.701312 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:03.701336 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:03.701475 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:03.701949 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:03.701953 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:03.702357 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:04:03.702520 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:03.702528 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:03.703723 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:03.703727 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:03.704752 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:03.704771 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:03.705613 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:03.705618 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:03.705814 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:03.706669 (+ 855us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:04:03.706695 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:04:03.710246 (+ 3551us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":320,"threads_started":1}
W20260809 13:04:03.710793 12097 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:04:03.700775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:53275 (local address 127.28.155.254:42377)
0809 13:04:03.701614 (+ 839us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:03.701618 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:03.701632 (+ 14us) server_negotiation.cc:407] Connection header received
0809 13:04:03.701673 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:03.701676 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:03.701772 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:03.701897 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:03.702709 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:03.703569 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:03.704917 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:03.705430 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:03.705605 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:03.710452 (+ 4847us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.195:53275: BlockingRecv error: recv got EOF from 127.28.155.195:53275 (error 108)
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":716,"thread_start_us":568,"threads_started":1}
I20260809 13:04:03.710908 12094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:03.700102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.193:43417)
0809 13:04:03.700796 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:03.700818 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:03.701056 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:03.701809 (+ 753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:03.701817 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:03.702324 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:04:03.702509 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:03.702518 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:03.703641 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:03.703649 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:03.704659 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:03.704672 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:03.705609 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:03.705615 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:03.705813 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:03.706787 (+ 974us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:04:03.706811 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:04:03.710504 (+ 3693us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":419,"threads_started":1}
W20260809 13:04:03.711112 12092 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:04:03.700294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:43417 (local address 127.28.155.254:42377)
0809 13:04:03.700472 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:03.700520 (+ 48us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:03.700911 (+ 391us) server_negotiation.cc:407] Connection header received
0809 13:04:03.701552 (+ 641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:03.701557 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:03.701657 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:03.701734 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:03.702669 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:03.703484 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:03.704802 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:03.705409 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:03.705501 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:03.710701 (+ 5200us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.193:43417: BlockingRecv error: recv got EOF from 127.28.155.193:43417 (error 108)
Metrics: {"mutex_wait_us":78,"server-negotiator.queue_time_us":39}
Aug 09 13:04:04 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:04:04 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:04:04.211532 12098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:04.202116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.194:48603)
0809 13:04:04.202966 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:04.202984 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:04.203113 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:04.203504 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:04.203511 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:04.204008 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:04:04.204217 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:04.204227 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:04.205359 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:04.205364 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:04.206353 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:04.206365 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:04.207211 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:04.207217 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:04.207415 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:04.208069 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:04:04.208087 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:04:04.211106 (+ 3019us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":722,"thread_start_us":337,"threads_started":1}
W20260809 13:04:04.211611 12092 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:04:04.202438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:48603 (local address 127.28.155.254:42377)
0809 13:04:04.202649 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:04.202658 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:04.203088 (+ 430us) server_negotiation.cc:407] Connection header received
0809 13:04:04.203216 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:04.203224 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:04.203325 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:04.203452 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:04.204395 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:04.205199 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:04.206527 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:04.207016 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:04.207163 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:04.211356 (+ 4193us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.194:48603: BlockingRecv error: recv got EOF from 127.28.155.194:48603 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 09 13:04:04 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:04:04 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:04:04 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:04:04.723644 12099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:04.712059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.195:39341)
0809 13:04:04.712894 (+ 835us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:04.712922 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:04.713111 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:04.713815 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:04.713823 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:04.714500 (+ 677us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:04:04.714761 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:04.714777 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:04.716313 (+ 1536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:04.716319 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:04.717851 (+ 1532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:04.717865 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:04.718833 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:04.718837 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:04.718956 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:04.719656 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:04:04.719682 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:04:04.723250 (+ 3568us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":643,"thread_start_us":457,"threads_started":1}
Aug 09 13:04:04 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
W20260809 13:04:04.723852 12102 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:04:04.712463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:39341 (local address 127.28.155.254:42377)
0809 13:04:04.713103 (+ 640us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:04.713109 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:04.713131 (+ 22us) server_negotiation.cc:407] Connection header received
0809 13:04:04.713335 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:04.713344 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:04.713450 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:04.713573 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:04.714954 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:04.716133 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:04.718004 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:04.718656 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:04.718785 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:04.723534 (+ 4749us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.195:39341: BlockingRecv error: recv got EOF from 127.28.155.195:39341 (error 108)
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":364,"threads_started":1}
I20260809 13:04:04.724961 12101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:04.712105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.193:51393)
0809 13:04:04.714878 (+ 2773us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:04.714903 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:04.715044 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:04.715382 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:04.715387 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:04.715872 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:04:04.716117 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:04.716129 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:04.717732 (+ 1603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:04.717735 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:04.719125 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:04.719138 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:04.720068 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:04.720072 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:04.720194 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:04.720852 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:04:04.720871 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:04:04.724682 (+ 3811us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":2626,"thread_start_us":2186,"threads_started":1}
W20260809 13:04:04.725469 12103 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:04:04.713022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:51393 (local address 127.28.155.254:42377)
0809 13:04:04.714942 (+ 1920us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:04.714947 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:04.714974 (+ 27us) server_negotiation.cc:407] Connection header received
0809 13:04:04.715171 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:04.715174 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:04.715224 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:04.715305 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:04.716304 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:04.717591 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:04.719279 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:04.719904 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:04.720042 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:04.724947 (+ 4905us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.193:51393: BlockingRecv error: recv got EOF from 127.28.155.193:51393 (error 108)
Metrics: {"server-negotiator.queue_time_us":1760,"thread_start_us":1546,"threads_started":1}
Aug 09 13:04:05 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:04:05 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:04:05.228863 12104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:05.212635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.194:53475)
0809 13:04:05.213184 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:05.213206 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:05.213381 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:05.213835 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:05.213843 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:05.214433 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:04:05.214717 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:05.214731 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:05.218305 (+ 3574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:05.218315 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:05.220016 (+ 1701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:05.220031 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:05.221378 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:05.221386 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:05.221566 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:05.225199 (+ 3633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:04:05.225220 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:04:05.228554 (+ 3334us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":285,"threads_started":1}
W20260809 13:04:05.228998 12103 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:04:05.212790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:53475 (local address 127.28.155.254:42377)
0809 13:04:05.213389 (+ 599us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:05.213395 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:05.213418 (+ 23us) server_negotiation.cc:407] Connection header received
0809 13:04:05.213571 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:05.213577 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:05.213657 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:05.213744 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:05.214914 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:05.215938 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:05.220196 (+ 4258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:05.221003 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:05.221138 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:05.228792 (+ 7654us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.194:53475: BlockingRecv error: recv got EOF from 127.28.155.194:53475 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 09 13:04:05 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:04:05 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:04:05 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.195@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:04:05 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.193@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:04:05.734879 12105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:05.724817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.195:42315)
0809 13:04:05.725357 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:05.725374 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:05.725556 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:05.725940 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:05.725946 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:05.726575 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:04:05.726877 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:05.726890 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:05.728023 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:05.728030 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:05.729068 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:05.729080 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:05.729825 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:05.729831 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:05.730006 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:05.730686 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:04:05.730704 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:04:05.734472 (+ 3768us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":296,"threads_started":1}
W20260809 13:04:05.734953 12103 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:04:05.724917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:42315 (local address 127.28.155.254:42377)
0809 13:04:05.725174 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:05.725183 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:05.725471 (+ 288us) server_negotiation.cc:407] Connection header received
0809 13:04:05.725697 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:05.725706 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:05.725786 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:05.725898 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:05.727045 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:05.727865 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:05.729207 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:05.729664 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:05.729795 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:05.734690 (+ 4895us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.195:42315: BlockingRecv error: recv got EOF from 127.28.155.195:42315 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
I20260809 13:04:05.735759 12106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:05.726142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.193:54287)
0809 13:04:05.726727 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:05.726750 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:05.726891 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:05.727311 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:05.727318 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:05.727751 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:04:05.727921 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:05.727931 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:05.729073 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:05.729077 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:05.730149 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:05.730162 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:05.730898 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:05.730904 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:05.731087 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:05.731677 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:04:05.731695 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:04:05.735488 (+ 3793us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":304,"threads_started":1}
W20260809 13:04:05.735847 12107 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:04:05.726185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:54287 (local address 127.28.155.254:42377)
0809 13:04:05.727018 (+ 833us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:05.727023 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:05.727038 (+ 15us) server_negotiation.cc:407] Connection header received
0809 13:04:05.727089 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:05.727093 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:05.727146 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:05.727274 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:05.728085 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:05.728909 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:05.730296 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:05.730728 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:05.730879 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:05.735662 (+ 4783us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.193:54287: BlockingRecv error: recv got EOF from 127.28.155.193:54287 (error 108)
Metrics: {"server-negotiator.queue_time_us":708,"thread_start_us":571,"threads_started":1}
Aug 09 13:04:06 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 13:04:06 dist-test-slave-jq4t krb5kdc[10500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.155.194@KRBTEST.COM for oryx/127.28.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 13:04:06.239440 12108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:06.230140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42377 (local address 127.28.155.194:39665)
0809 13:04:06.230698 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:06.230715 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:06.230856 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:06.231178 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:06.231182 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:06.231628 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:04:06.231808 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:06.231818 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:06.232953 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:06.232957 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:06.233902 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:06.233914 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:06.234579 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:06.234583 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:06.234700 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:06.235469 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:04:06.235500 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:04:06.239172 (+ 3672us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.155.254:42377: Server oryx/127.28.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":301,"threads_started":1}
W20260809 13:04:06.239620 12107 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:04:06.230237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:39665 (local address 127.28.155.254:42377)
0809 13:04:06.230514 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:06.230521 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:06.230798 (+ 277us) server_negotiation.cc:407] Connection header received
0809 13:04:06.230964 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:06.230968 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:06.231031 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:06.231119 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:06.231935 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:06.232817 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:06.234026 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:06.234449 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:06.234551 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:06.239388 (+ 4837us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.155.194:39665: BlockingRecv error: recv got EOF from 127.28.155.194:39665 (error 108)
Metrics: {"server-negotiator.queue_time_us":108}
I20260809 13:04:06.536561 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 11393
I20260809 13:04:06.549778 12110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:06.537817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47624 (local address 127.28.155.193:37239)
0809 13:04:06.538436 (+ 619us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:06.538443 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:06.538476 (+ 33us) server_negotiation.cc:407] Connection header received
0809 13:04:06.538547 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:06.538554 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:06.538772 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:06.538946 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:06.540419 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:06.541491 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:06.542806 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:06.543490 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:06.543639 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:06.546321 (+ 2682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:04:06.546330 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:04:06.546344 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:04:06.546387 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:04:06.549202 (+ 2815us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.28.155.193@KRBTEST.COM not found in keytab (ticket kvno 2)
0809 13:04:06.549538 (+ 336us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47624: Request ticket server kudu/127.28.155.193@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":292,"threads_started":1}
W20260809 13:04:06.549928 12110 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47624: Request ticket server kudu/127.28.155.193@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260809 13:04:06.549983 29295 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 11393: Not authorized: Client connection negotiation failed: client connection to 127.28.155.193:37239: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.28.155.193@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260809 13:04:06.550239 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 11393
I20260809 13:04:06.578994 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 11612
I20260809 13:04:06.592574 12112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:06.580314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59886 (local address 127.28.155.194:43517)
0809 13:04:06.581021 (+ 707us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:06.581030 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:06.581063 (+ 33us) server_negotiation.cc:407] Connection header received
0809 13:04:06.581129 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:06.581136 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:06.581369 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:06.581530 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:06.582961 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:06.584116 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:06.585648 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:06.586248 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:06.586370 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:06.589253 (+ 2883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:04:06.589263 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:04:06.589277 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:04:06.589310 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:04:06.591916 (+ 2606us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.28.155.194@KRBTEST.COM not found in keytab (ticket kvno 2)
0809 13:04:06.592218 (+ 302us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59886: Request ticket server kudu/127.28.155.194@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":355,"threads_started":1}
W20260809 13:04:06.592708 12112 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59886: Request ticket server kudu/127.28.155.194@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260809 13:04:06.592797 29295 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 11612: Not authorized: Client connection negotiation failed: client connection to 127.28.155.194:43517: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.28.155.194@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260809 13:04:06.593019 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 11612
I20260809 13:04:06.619988 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 11819
I20260809 13:04:06.633572 12114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:06.621182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58332 (local address 127.28.155.195:35187)
0809 13:04:06.621810 (+ 628us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:06.621818 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:06.621852 (+ 34us) server_negotiation.cc:407] Connection header received
0809 13:04:06.621921 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:06.621927 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:06.622162 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:06.622380 (+ 218us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:06.623876 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:06.625162 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:06.626463 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:06.627065 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:06.627219 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:06.630078 (+ 2859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:04:06.630088 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:04:06.630103 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:04:06.630142 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:04:06.632791 (+ 2649us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.28.155.195@KRBTEST.COM not found in keytab (ticket kvno 2)
0809 13:04:06.633160 (+ 369us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58332: Request ticket server kudu/127.28.155.195@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":329,"threads_started":1}
W20260809 13:04:06.633618 29295 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 11819: Not authorized: Client connection negotiation failed: client connection to 127.28.155.195:35187: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.28.155.195@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260809 13:04:06.633705 12114 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58332: Request ticket server kudu/127.28.155.195@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260809 13:04:06.633867 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 11819
I20260809 13:04:06.660334 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 11289
I20260809 13:04:06.661999 11380 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:04:06.789093 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 11289
2026-08-09T13:04:06Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (22037 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-09T13:04:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:04:06Z Disabled control of system clock
I20260809 13:04:06.891763 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:42067
--webserver_interface=127.28.155.254
--webserver_port=0
--builtin_ntp_servers=127.28.155.212:41479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:42067
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 13:04:07.250969 12124 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:04:07.251305 12124 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:04:07.251392 12124 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:04:07.258900 12124 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:04:07.259023 12124 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:04:07.259063 12124 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:04:07.259124 12124 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:04:07.259171 12124 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:04:07.268620 12124 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:41479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:42067
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:42067
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:04:07.270148 12124 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:04:07.272022 12124 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:04:07.285022 12140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:04:07.285046 12135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:04:07.285028 12131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:04:07.285856 12124 server_base.cc:1034] running on GCE node
I20260809 13:04:07.286725 12124 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:04:07.288278 12124 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:04:07.289551 12124 hybrid_clock.cc:648] HybridClock initialized: now 1786280647289491 us; error 64 us; skew 500 ppm
I20260809 13:04:07.289987 12124 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 13:04:07.292528 12124 webserver.cc:460] Webserver started at http://127.28.155.254:39571/ using document root <none> and password file <none>
I20260809 13:04:07.293293 12124 fs_manager.cc:359] Metadata directory not provided
I20260809 13:04:07.293442 12124 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:04:07.293787 12124 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:04:07.296944 12124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "ebd94c9778df4527a6e75da7a6f895f4"
format_stamp: "Formatted at 2026-08-09 13:04:07 on dist-test-slave-jq4t"
server_key: "37f13767eab7837ef94469706f7c7779"
server_key_iv: "b310965f3b2a4cdf181071fca3b3a2bf"
server_key_version: "encryptionkey@0"
I20260809 13:04:07.297801 12124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "ebd94c9778df4527a6e75da7a6f895f4"
format_stamp: "Formatted at 2026-08-09 13:04:07 on dist-test-slave-jq4t"
server_key: "37f13767eab7837ef94469706f7c7779"
server_key_iv: "b310965f3b2a4cdf181071fca3b3a2bf"
server_key_version: "encryptionkey@0"
I20260809 13:04:07.303516 12124 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 13:04:07.307235 12152 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:04:07.308779 12124 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 13:04:07.309006 12124 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "ebd94c9778df4527a6e75da7a6f895f4"
format_stamp: "Formatted at 2026-08-09 13:04:07 on dist-test-slave-jq4t"
server_key: "37f13767eab7837ef94469706f7c7779"
server_key_iv: "b310965f3b2a4cdf181071fca3b3a2bf"
server_key_version: "encryptionkey@0"
I20260809 13:04:07.309248 12124 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:04:07.328239 12124 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:04:07.329176 12124 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:04:07.329501 12124 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:04:07.350298 12124 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:42067
I20260809 13:04:07.350493 12222 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:42067 every 8 connection(s)
I20260809 13:04:07.352331 12124 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:04:07.356618 12224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:04:07.361106 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 12124
I20260809 13:04:07.361341 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:04:07.362238 29295 external_mini_cluster.cc:1428] Setting key 1ddb1d4dc09da954d36e435a45565d53
I20260809 13:04:07.369239 12224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebd94c9778df4527a6e75da7a6f895f4: Bootstrap starting.
I20260809 13:04:07.372611 12224 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ebd94c9778df4527a6e75da7a6f895f4: Neither blocks nor log segments found. Creating new log.
I20260809 13:04:07.373773 12224 log.cc:824] T 00000000000000000000000000000000 P ebd94c9778df4527a6e75da7a6f895f4: Log is configured to *not* fsync() on all Append() calls
I20260809 13:04:07.377663 12224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebd94c9778df4527a6e75da7a6f895f4: No bootstrap required, opened a new log
I20260809 13:04:07.377789 12228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:07.364668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60812 (local address 127.28.155.254:42067)
0809 13:04:07.365741 (+ 1073us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:07.365755 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:07.365802 (+ 47us) server_negotiation.cc:407] Connection header received
0809 13:04:07.367884 (+ 2082us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:07.367911 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:07.368372 (+ 461us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:07.368842 (+ 470us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:07.369563 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:07.370921 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:07.372320 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:07.373213 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:07.373426 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:07.374945 (+ 1519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:04:07.374953 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:04:07.374968 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:04:07.375641 (+ 673us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:04:07.375750 (+ 109us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:04:07.375785 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:04:07.375915 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 13:04:07.376105 (+ 190us) server_negotiation.cc:299] Negotiation successful
0809 13:04:07.376441 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":658,"thread_start_us":394,"threads_started":1}
I20260809 13:04:07.389456 12224 raft_consensus.cc:348] T 00000000000000000000000000000000 P ebd94c9778df4527a6e75da7a6f895f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebd94c9778df4527a6e75da7a6f895f4" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42067 } }
I20260809 13:04:07.389860 12224 raft_consensus.cc:374] T 00000000000000000000000000000000 P ebd94c9778df4527a6e75da7a6f895f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:04:07.389948 12224 raft_consensus.cc:729] T 00000000000000000000000000000000 P ebd94c9778df4527a6e75da7a6f895f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebd94c9778df4527a6e75da7a6f895f4, State: Initialized, Role: FOLLOWER
I20260809 13:04:07.390569 12224 consensus_queue.cc:260] T 00000000000000000000000000000000 P ebd94c9778df4527a6e75da7a6f895f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebd94c9778df4527a6e75da7a6f895f4" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42067 } }
I20260809 13:04:07.390785 12224 raft_consensus.cc:388] T 00000000000000000000000000000000 P ebd94c9778df4527a6e75da7a6f895f4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:04:07.390913 12224 raft_consensus.cc:482] T 00000000000000000000000000000000 P ebd94c9778df4527a6e75da7a6f895f4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:04:07.391067 12224 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ebd94c9778df4527a6e75da7a6f895f4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:04:07.393695 12224 raft_consensus.cc:504] T 00000000000000000000000000000000 P ebd94c9778df4527a6e75da7a6f895f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebd94c9778df4527a6e75da7a6f895f4" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42067 } }
I20260809 13:04:07.394311 12224 leader_election.cc:302] T 00000000000000000000000000000000 P ebd94c9778df4527a6e75da7a6f895f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ebd94c9778df4527a6e75da7a6f895f4; no voters:
I20260809 13:04:07.395004 12224 leader_election.cc:288] T 00000000000000000000000000000000 P ebd94c9778df4527a6e75da7a6f895f4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:04:07.395227 12232 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ebd94c9778df4527a6e75da7a6f895f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:04:07.396035 12232 raft_consensus.cc:686] T 00000000000000000000000000000000 P ebd94c9778df4527a6e75da7a6f895f4 [term 1 LEADER]: Becoming Leader. State: Replica: ebd94c9778df4527a6e75da7a6f895f4, State: Running, Role: LEADER
I20260809 13:04:07.396723 12232 consensus_queue.cc:237] T 00000000000000000000000000000000 P ebd94c9778df4527a6e75da7a6f895f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebd94c9778df4527a6e75da7a6f895f4" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42067 } }
I20260809 13:04:07.397320 12224 sys_catalog.cc:564] T 00000000000000000000000000000000 P ebd94c9778df4527a6e75da7a6f895f4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:04:07.399780 12233 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebd94c9778df4527a6e75da7a6f895f4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ebd94c9778df4527a6e75da7a6f895f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebd94c9778df4527a6e75da7a6f895f4" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42067 } } }
I20260809 13:04:07.400133 12233 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebd94c9778df4527a6e75da7a6f895f4 [sys.catalog]: This master's current role is: LEADER
I20260809 13:04:07.399878 12234 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebd94c9778df4527a6e75da7a6f895f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ebd94c9778df4527a6e75da7a6f895f4. Latest consensus state: current_term: 1 leader_uuid: "ebd94c9778df4527a6e75da7a6f895f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebd94c9778df4527a6e75da7a6f895f4" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 42067 } } }
I20260809 13:04:07.400283 12234 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebd94c9778df4527a6e75da7a6f895f4 [sys.catalog]: This master's current role is: LEADER
I20260809 13:04:07.401165 12241 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:04:07.409291 12241 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:04:07.419519 12241 catalog_manager.cc:1347] Generated new cluster ID: 84646e8340804a27b5c1840c58bda175
I20260809 13:04:07.419660 12241 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:04:07.435371 12241 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:04:07.437299 12241 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:04:07.456621 12241 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ebd94c9778df4527a6e75da7a6f895f4: Generated new TSK 0
I20260809 13:04:07.457551 12241 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 13:04:07.469686 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:0
--local_ip_for_outbound_sockets=127.28.155.193
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:42067
--builtin_ntp_servers=127.28.155.212:41479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260809 13:04:07.845645 12255 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:04:07.845956 12255 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:04:07.846051 12255 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:04:07.853597 12255 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:04:07.853724 12255 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:04:07.853834 12255 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:04:07.863394 12255 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:41479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:42067
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:04:07.864959 12255 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:04:07.866833 12255 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:04:07.881204 12261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:04:07.881168 12263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:04:07.881258 12267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:04:07.882246 12255 server_base.cc:1034] running on GCE node
I20260809 13:04:07.882913 12255 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:04:07.883896 12255 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:04:07.885149 12255 hybrid_clock.cc:648] HybridClock initialized: now 1786280647885098 us; error 38 us; skew 500 ppm
I20260809 13:04:07.885504 12255 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 13:04:07.887867 12255 webserver.cc:460] Webserver started at http://127.28.155.193:46175/ using document root <none> and password file <none>
I20260809 13:04:07.888681 12255 fs_manager.cc:359] Metadata directory not provided
I20260809 13:04:07.888819 12255 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:04:07.889197 12255 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:04:07.892297 12255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/data/instance:
uuid: "3bb9152b3e814cea8edc6485bd693501"
format_stamp: "Formatted at 2026-08-09 13:04:07 on dist-test-slave-jq4t"
server_key: "76da2b4fcf2e3fbc3b948b81941403cd"
server_key_iv: "6ab1eb50c75bad3ebea53c8d90560131"
server_key_version: "encryptionkey@0"
I20260809 13:04:07.893283 12255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance:
uuid: "3bb9152b3e814cea8edc6485bd693501"
format_stamp: "Formatted at 2026-08-09 13:04:07 on dist-test-slave-jq4t"
server_key: "76da2b4fcf2e3fbc3b948b81941403cd"
server_key_iv: "6ab1eb50c75bad3ebea53c8d90560131"
server_key_version: "encryptionkey@0"
I20260809 13:04:07.898870 12255 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 13:04:07.902933 12276 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:04:07.904666 12255 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:04:07.904897 12255 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "3bb9152b3e814cea8edc6485bd693501"
format_stamp: "Formatted at 2026-08-09 13:04:07 on dist-test-slave-jq4t"
server_key: "76da2b4fcf2e3fbc3b948b81941403cd"
server_key_iv: "6ab1eb50c75bad3ebea53c8d90560131"
server_key_version: "encryptionkey@0"
I20260809 13:04:07.905133 12255 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:04:07.926656 12255 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:04:07.927635 12255 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:04:07.927991 12255 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:04:07.929158 12255 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:04:07.930727 12255 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:04:07.930871 12255 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:04:07.931020 12255 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:04:07.931113 12255 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:04:07.965279 12255 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:46529
I20260809 13:04:07.965378 12446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:46529 every 8 connection(s)
I20260809 13:04:07.966683 12255 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:04:07.977015 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 12255
I20260809 13:04:07.977248 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance
I20260809 13:04:07.977970 29295 external_mini_cluster.cc:1428] Setting key 5cf00165e504159611bea1abbe3e29e7
I20260809 13:04:07.979826 12450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:07.969393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:50691 (local address 127.28.155.254:42067)
0809 13:04:07.969887 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:07.969892 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:07.970992 (+ 1100us) server_negotiation.cc:407] Connection header received
0809 13:04:07.972903 (+ 1911us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:07.972909 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:07.973015 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:07.973145 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:07.974275 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:07.975049 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:07.976799 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:07.977260 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:07.977407 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:07.978871 (+ 1464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:04:07.978883 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:04:07.978886 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:04:07.978906 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:04:07.978949 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:04:07.978963 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:04:07.979063 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 13:04:07.979292 (+ 229us) server_negotiation.cc:299] Negotiation successful
0809 13:04:07.979400 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":272,"threads_started":1}
I20260809 13:04:07.981194 12451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:07.969874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42067 (local address 127.28.155.193:50691)
0809 13:04:07.970803 (+ 929us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:07.970853 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:07.972619 (+ 1766us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:07.973381 (+ 762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:07.973389 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:07.973475 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:04:07.974092 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:07.974110 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:07.975227 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:07.975231 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:07.976628 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:07.976641 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:07.977503 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:07.977511 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:07.977755 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:07.978524 (+ 769us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 13:04:07.978527 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:04:07.978579 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 13:04:07.978665 (+ 86us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:04:07.979064 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:04:07.979079 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:04:07.979089 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 13:04:07.979280 (+ 191us) client_negotiation.cc:240] Negotiation successful
0809 13:04:07.979706 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":289,"threads_started":1}
I20260809 13:04:07.981355 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:0
--local_ip_for_outbound_sockets=127.28.155.194
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:42067
--builtin_ntp_servers=127.28.155.212:41479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 13:04:07.982918 12448 heartbeater.cc:347] Connected to a master server at 127.28.155.254:42067
I20260809 13:04:07.983268 12448 heartbeater.cc:464] Registering TS with master...
I20260809 13:04:07.984153 12448 heartbeater.cc:511] Master 127.28.155.254:42067 requested a full tablet report, sending...
I20260809 13:04:07.986626 12176 ts_manager.cc:194] Registered new tserver with Master: 3bb9152b3e814cea8edc6485bd693501 (127.28.155.193:46529)
I20260809 13:04:07.988274 12176 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.155.193:50691
W20260809 13:04:08.332722 12452 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:04:08.333033 12452 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:04:08.333176 12452 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:04:08.341028 12452 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:04:08.341141 12452 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:04:08.341307 12452 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:04:08.350864 12452 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:41479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:42067
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:04:08.352281 12452 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:04:08.354689 12452 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:04:08.372916 12460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:04:08.372975 12465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:04:08.373046 12463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:04:08.373800 12452 server_base.cc:1034] running on GCE node
I20260809 13:04:08.374565 12452 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:04:08.375651 12452 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:04:08.376911 12452 hybrid_clock.cc:648] HybridClock initialized: now 1786280648376836 us; error 68 us; skew 500 ppm
I20260809 13:04:08.377254 12452 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 13:04:08.379650 12452 webserver.cc:460] Webserver started at http://127.28.155.194:41021/ using document root <none> and password file <none>
I20260809 13:04:08.380431 12452 fs_manager.cc:359] Metadata directory not provided
I20260809 13:04:08.380595 12452 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:04:08.380957 12452 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:04:08.383978 12452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/data/instance:
uuid: "8b3571bfdf1746188619422ca9b91cd7"
format_stamp: "Formatted at 2026-08-09 13:04:08 on dist-test-slave-jq4t"
server_key: "bf5578e7ff87353567d091dafb65ce38"
server_key_iv: "b4e8f6bc59fc363e20b8b0e319e18a5b"
server_key_version: "encryptionkey@0"
I20260809 13:04:08.384897 12452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance:
uuid: "8b3571bfdf1746188619422ca9b91cd7"
format_stamp: "Formatted at 2026-08-09 13:04:08 on dist-test-slave-jq4t"
server_key: "bf5578e7ff87353567d091dafb65ce38"
server_key_iv: "b4e8f6bc59fc363e20b8b0e319e18a5b"
server_key_version: "encryptionkey@0"
I20260809 13:04:08.390264 12452 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260809 13:04:08.394074 12474 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:04:08.395455 12452 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 13:04:08.395663 12452 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "8b3571bfdf1746188619422ca9b91cd7"
format_stamp: "Formatted at 2026-08-09 13:04:08 on dist-test-slave-jq4t"
server_key: "bf5578e7ff87353567d091dafb65ce38"
server_key_iv: "b4e8f6bc59fc363e20b8b0e319e18a5b"
server_key_version: "encryptionkey@0"
I20260809 13:04:08.395929 12452 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:04:08.412547 12452 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:04:08.413525 12452 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:04:08.413869 12452 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:04:08.414986 12452 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:04:08.416633 12452 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:04:08.416755 12452 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:04:08.416910 12452 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:04:08.417011 12452 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:04:08.452301 12452 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:34593
I20260809 13:04:08.452358 12642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:34593 every 8 connection(s)
I20260809 13:04:08.453696 12452 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:04:08.463594 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 12452
I20260809 13:04:08.463778 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance
I20260809 13:04:08.464346 29295 external_mini_cluster.cc:1428] Setting key 957f52cdd5ad1f1f4dfabbf0d14fe412
I20260809 13:04:08.467077 12450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:08.456384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:35317 (local address 127.28.155.254:42067)
0809 13:04:08.456631 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:08.456636 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:08.458167 (+ 1531us) server_negotiation.cc:407] Connection header received
0809 13:04:08.460004 (+ 1837us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:08.460011 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:08.460102 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:08.460221 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:08.461372 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:08.462121 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:08.464054 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:08.464585 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:08.464688 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:08.466224 (+ 1536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:04:08.466228 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:04:08.466232 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:04:08.466250 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:04:08.466282 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:04:08.466295 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:04:08.466391 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 13:04:08.466643 (+ 252us) server_negotiation.cc:299] Negotiation successful
0809 13:04:08.466747 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 13:04:08.467320 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:0
--local_ip_for_outbound_sockets=127.28.155.195
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:42067
--builtin_ntp_servers=127.28.155.212:41479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 13:04:08.468166 12647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:08.457050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42067 (local address 127.28.155.194:35317)
0809 13:04:08.457994 (+ 944us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:08.458036 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:08.459704 (+ 1668us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:08.460469 (+ 765us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:08.460519 (+ 50us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:08.460615 (+ 96us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:04:08.461199 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:08.461216 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:08.462289 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:08.462298 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:08.463896 (+ 1598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:08.463912 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:08.464833 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:08.464842 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:08.465130 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:08.465879 (+ 749us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 13:04:08.465882 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:04:08.465923 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 13:04:08.466000 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:04:08.466408 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:04:08.466424 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:04:08.466437 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 13:04:08.466631 (+ 194us) client_negotiation.cc:240] Negotiation successful
0809 13:04:08.467016 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":305,"threads_started":1}
I20260809 13:04:08.469691 12644 heartbeater.cc:347] Connected to a master server at 127.28.155.254:42067
I20260809 13:04:08.470041 12644 heartbeater.cc:464] Registering TS with master...
I20260809 13:04:08.471030 12644 heartbeater.cc:511] Master 127.28.155.254:42067 requested a full tablet report, sending...
I20260809 13:04:08.472669 12176 ts_manager.cc:194] Registered new tserver with Master: 8b3571bfdf1746188619422ca9b91cd7 (127.28.155.194:34593)
I20260809 13:04:08.473881 12176 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.155.194:35317
W20260809 13:04:08.823927 12648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:04:08.824250 12648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:04:08.824404 12648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:04:08.831986 12648 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:04:08.832098 12648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:04:08.832275 12648 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:04:08.841857 12648 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:41479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:42067
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:04:08.843273 12648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:04:08.845369 12648 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:04:08.859593 12658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:04:08.859498 12660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:04:08.859555 12662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:04:08.860528 12648 server_base.cc:1034] running on GCE node
I20260809 13:04:08.861227 12648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:04:08.862274 12648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:04:08.863543 12648 hybrid_clock.cc:648] HybridClock initialized: now 1786280648863493 us; error 37 us; skew 500 ppm
I20260809 13:04:08.863926 12648 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 13:04:08.866505 12648 webserver.cc:460] Webserver started at http://127.28.155.195:36761/ using document root <none> and password file <none>
I20260809 13:04:08.867271 12648 fs_manager.cc:359] Metadata directory not provided
I20260809 13:04:08.867369 12648 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:04:08.867722 12648 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:04:08.870808 12648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/data/instance:
uuid: "59426e26392743f58e922ff122a661e0"
format_stamp: "Formatted at 2026-08-09 13:04:08 on dist-test-slave-jq4t"
server_key: "21cf1d7c10b3cec6b6c41fcafa5dd878"
server_key_iv: "159238dd98d5e0f094fb11ae76ed55f7"
server_key_version: "encryptionkey@0"
I20260809 13:04:08.871675 12648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance:
uuid: "59426e26392743f58e922ff122a661e0"
format_stamp: "Formatted at 2026-08-09 13:04:08 on dist-test-slave-jq4t"
server_key: "21cf1d7c10b3cec6b6c41fcafa5dd878"
server_key_iv: "159238dd98d5e0f094fb11ae76ed55f7"
server_key_version: "encryptionkey@0"
I20260809 13:04:08.877206 12648 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260809 13:04:08.880875 12675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:04:08.882330 12648 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:04:08.882530 12648 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "59426e26392743f58e922ff122a661e0"
format_stamp: "Formatted at 2026-08-09 13:04:08 on dist-test-slave-jq4t"
server_key: "21cf1d7c10b3cec6b6c41fcafa5dd878"
server_key_iv: "159238dd98d5e0f094fb11ae76ed55f7"
server_key_version: "encryptionkey@0"
I20260809 13:04:08.882767 12648 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:04:08.903570 12648 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:04:08.904547 12648 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:04:08.904903 12648 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:04:08.906066 12648 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:04:08.907670 12648 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:04:08.907816 12648 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:04:08.907959 12648 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:04:08.908051 12648 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:04:08.943874 12648 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:41821
I20260809 13:04:08.943936 12846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:41821 every 8 connection(s)
I20260809 13:04:08.945367 12648 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:04:08.949355 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 12648
I20260809 13:04:08.949540 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance
I20260809 13:04:08.950033 29295 external_mini_cluster.cc:1428] Setting key 0be537563a99e4ec9cee35e0d077f252
I20260809 13:04:08.959227 12450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:08.948289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:48365 (local address 127.28.155.254:42067)
0809 13:04:08.948540 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:08.948553 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:08.950197 (+ 1644us) server_negotiation.cc:407] Connection header received
0809 13:04:08.952371 (+ 2174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:08.952377 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:08.952525 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:08.952644 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:08.953849 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:08.954619 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:08.956309 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:08.956796 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:08.956948 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:08.958352 (+ 1404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:04:08.958357 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:04:08.958360 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:04:08.958379 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:04:08.958421 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:04:08.958433 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:04:08.958533 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 13:04:08.958767 (+ 234us) server_negotiation.cc:299] Negotiation successful
0809 13:04:08.958872 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 13:04:08.960268 12849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:08.948926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:42067 (local address 127.28.155.195:48365)
0809 13:04:08.950035 (+ 1109us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:08.950082 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:08.952105 (+ 2023us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:08.952902 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:08.952932 (+ 30us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:08.953053 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:04:08.953675 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:08.953692 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:08.954788 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:08.954791 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:08.956159 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:08.956172 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:08.957032 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:08.957041 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:08.957289 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:08.958023 (+ 734us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 13:04:08.958025 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:04:08.958066 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 13:04:08.958149 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:04:08.958535 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:04:08.958550 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:04:08.958560 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 13:04:08.958755 (+ 195us) client_negotiation.cc:240] Negotiation successful
0809 13:04:08.959197 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":364,"threads_started":1}
I20260809 13:04:08.961795 12847 heartbeater.cc:347] Connected to a master server at 127.28.155.254:42067
I20260809 13:04:08.962133 12847 heartbeater.cc:464] Registering TS with master...
I20260809 13:04:08.962996 12847 heartbeater.cc:511] Master 127.28.155.254:42067 requested a full tablet report, sending...
I20260809 13:04:08.964668 12173 ts_manager.cc:194] Registered new tserver with Master: 59426e26392743f58e922ff122a661e0 (127.28.155.195:41821)
I20260809 13:04:08.965924 29295 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 13:04:08.965931 12173 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.155.195:48365
W20260809 13:04:08.973522 12450 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:04:08.971876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60818 (local address 127.28.155.254:42067)
0809 13:04:08.972092 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:08.972097 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:08.972634 (+ 537us) server_negotiation.cc:407] Connection header received
0809 13:04:08.972780 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:08.972784 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:08.972846 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:08.972954 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:08.973346 (+ 392us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60818: BlockingRecv error: recv got EOF from 127.0.0.1:60818 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
I20260809 13:04:08.974452 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 12255
I20260809 13:04:08.982592 12856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:08.975432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43434 (local address 127.28.155.193:46529)
0809 13:04:08.976005 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:08.976011 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:08.976037 (+ 26us) server_negotiation.cc:407] Connection header received
0809 13:04:08.976091 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:08.976097 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:08.976305 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:08.976434 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:08.976880 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:08.977905 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:08.979251 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:08.979835 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:08.979941 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:08.981197 (+ 1256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:04:08.981206 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:04:08.981220 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:04:08.981805 (+ 585us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:04:08.981879 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:04:08.981901 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:04:08.981992 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 13:04:08.982150 (+ 158us) server_negotiation.cc:299] Negotiation successful
0809 13:04:08.982270 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":289,"threads_started":1}
I20260809 13:04:08.983968 12441 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:04:09.067524 12448 heartbeater.cc:503] Master 127.28.155.254:42067 was elected leader, sending a full tablet report...
I20260809 13:04:09.068830 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 12255
W20260809 13:04:09.096436 12156 connection.cc:535] server connection from 127.28.155.193:50691 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 13:04:09.096961 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 12452
I20260809 13:04:09.105980 12863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:09.098063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47206 (local address 127.28.155.194:34593)
0809 13:04:09.098704 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:09.098716 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:09.098754 (+ 38us) server_negotiation.cc:407] Connection header received
0809 13:04:09.098844 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:09.098851 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:09.099078 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:09.099264 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:09.099728 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:09.101357 (+ 1629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:09.102646 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:09.103260 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:09.103368 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:09.104464 (+ 1096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:04:09.104472 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:04:09.104538 (+ 66us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:04:09.105203 (+ 665us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:04:09.105254 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:04:09.105280 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:04:09.105375 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 13:04:09.105511 (+ 136us) server_negotiation.cc:299] Negotiation successful
0809 13:04:09.105651 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":296,"threads_started":1}
I20260809 13:04:09.107291 12635 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:04:09.190549 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 12452
I20260809 13:04:09.218415 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 12648
I20260809 13:04:09.227052 12866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:09.219467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49072 (local address 127.28.155.195:41821)
0809 13:04:09.220217 (+ 750us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:09.220224 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:09.220255 (+ 31us) server_negotiation.cc:407] Connection header received
0809 13:04:09.220320 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:09.220327 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:09.220629 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:09.220763 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:09.221234 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:09.222361 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:09.223627 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:09.224239 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:09.224343 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:09.225489 (+ 1146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:04:09.225498 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:04:09.225514 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:04:09.226160 (+ 646us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:04:09.226208 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:04:09.226229 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:04:09.226323 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 13:04:09.226452 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 13:04:09.226628 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":577,"thread_start_us":406,"threads_started":1}
I20260809 13:04:09.228376 12840 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:04:09.311825 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 12648
I20260809 13:04:09.341055 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 12124
I20260809 13:04:09.342396 12218 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:04:09.456550 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 12124
2026-08-09T13:04:09Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2656 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-09T13:04:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:04:09Z Disabled control of system clock
I20260809 13:04:09.550426 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:43131
--webserver_interface=127.28.155.254
--webserver_port=0
--builtin_ntp_servers=127.28.155.212:33389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:43131
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 13:04:09.909799 12872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:04:09.910125 12872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:04:09.910218 12872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:04:09.917871 12872 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:04:09.918006 12872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:04:09.918046 12872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:04:09.918123 12872 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:04:09.918169 12872 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:04:09.928006 12872 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:33389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:43131
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:43131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:04:09.929453 12872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:04:09.931366 12872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:04:09.944243 12887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:04:09.944373 12879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:04:09.944294 12880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:04:09.945411 12872 server_base.cc:1034] running on GCE node
I20260809 13:04:09.946310 12872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:04:09.947912 12872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:04:09.949167 12872 hybrid_clock.cc:648] HybridClock initialized: now 1786280649949115 us; error 42 us; skew 500 ppm
I20260809 13:04:09.949574 12872 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 13:04:09.952263 12872 webserver.cc:460] Webserver started at http://127.28.155.254:39343/ using document root <none> and password file <none>
I20260809 13:04:09.953118 12872 fs_manager.cc:359] Metadata directory not provided
I20260809 13:04:09.953263 12872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:04:09.953613 12872 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:04:09.956809 12872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "b5b5fc4d4f7d4073aea2c8a3fe12ec60"
format_stamp: "Formatted at 2026-08-09 13:04:09 on dist-test-slave-jq4t"
server_key: "df1d2a7e4a35b084addb10347bf1216e"
server_key_iv: "00d0aa917214b32d1dc63fd3dc994c4f"
server_key_version: "encryptionkey@0"
I20260809 13:04:09.957723 12872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "b5b5fc4d4f7d4073aea2c8a3fe12ec60"
format_stamp: "Formatted at 2026-08-09 13:04:09 on dist-test-slave-jq4t"
server_key: "df1d2a7e4a35b084addb10347bf1216e"
server_key_iv: "00d0aa917214b32d1dc63fd3dc994c4f"
server_key_version: "encryptionkey@0"
I20260809 13:04:09.963438 12872 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 13:04:09.967237 12896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:04:09.968775 12872 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:04:09.968999 12872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "b5b5fc4d4f7d4073aea2c8a3fe12ec60"
format_stamp: "Formatted at 2026-08-09 13:04:09 on dist-test-slave-jq4t"
server_key: "df1d2a7e4a35b084addb10347bf1216e"
server_key_iv: "00d0aa917214b32d1dc63fd3dc994c4f"
server_key_version: "encryptionkey@0"
I20260809 13:04:09.969251 12872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:04:09.975344 12872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:04:09.976187 12872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:04:09.976581 12872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:04:09.995983 12872 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:43131
I20260809 13:04:09.996018 12975 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:43131 every 8 connection(s)
I20260809 13:04:09.997611 12872 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:04:09.998773 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 12872
I20260809 13:04:09.999006 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:04:09.999661 29295 external_mini_cluster.cc:1428] Setting key f5370054601f9aae87f13a1e51db0b44
I20260809 13:04:10.003054 12976 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:04:10.010641 12983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:10.002057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56708 (local address 127.28.155.254:43131)
0809 13:04:10.003291 (+ 1234us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:10.003307 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:10.003364 (+ 57us) server_negotiation.cc:407] Connection header received
0809 13:04:10.005883 (+ 2519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:10.005916 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:10.006518 (+ 602us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:10.007017 (+ 499us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:10.008200 (+ 1183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:04:10.008209 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:04:10.008225 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:04:10.008254 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:04:10.008353 (+ 99us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:04:10.008376 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:04:10.008697 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0809 13:04:10.008858 (+ 161us) server_negotiation.cc:299] Negotiation successful
0809 13:04:10.009193 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":647,"thread_start_us":407,"threads_started":1}
I20260809 13:04:10.017617 12976 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5b5fc4d4f7d4073aea2c8a3fe12ec60: Bootstrap starting.
I20260809 13:04:10.021533 12976 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b5b5fc4d4f7d4073aea2c8a3fe12ec60: Neither blocks nor log segments found. Creating new log.
I20260809 13:04:10.022840 12976 log.cc:824] T 00000000000000000000000000000000 P b5b5fc4d4f7d4073aea2c8a3fe12ec60: Log is configured to *not* fsync() on all Append() calls
I20260809 13:04:10.026151 12976 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5b5fc4d4f7d4073aea2c8a3fe12ec60: No bootstrap required, opened a new log
I20260809 13:04:10.034837 12976 raft_consensus.cc:348] T 00000000000000000000000000000000 P b5b5fc4d4f7d4073aea2c8a3fe12ec60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5b5fc4d4f7d4073aea2c8a3fe12ec60" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 43131 } }
I20260809 13:04:10.035285 12976 raft_consensus.cc:374] T 00000000000000000000000000000000 P b5b5fc4d4f7d4073aea2c8a3fe12ec60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:04:10.035395 12976 raft_consensus.cc:729] T 00000000000000000000000000000000 P b5b5fc4d4f7d4073aea2c8a3fe12ec60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5b5fc4d4f7d4073aea2c8a3fe12ec60, State: Initialized, Role: FOLLOWER
I20260809 13:04:10.036024 12976 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5b5fc4d4f7d4073aea2c8a3fe12ec60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5b5fc4d4f7d4073aea2c8a3fe12ec60" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 43131 } }
I20260809 13:04:10.036253 12976 raft_consensus.cc:388] T 00000000000000000000000000000000 P b5b5fc4d4f7d4073aea2c8a3fe12ec60 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:04:10.036418 12976 raft_consensus.cc:482] T 00000000000000000000000000000000 P b5b5fc4d4f7d4073aea2c8a3fe12ec60 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:04:10.036695 12976 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b5b5fc4d4f7d4073aea2c8a3fe12ec60 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:04:10.039345 12976 raft_consensus.cc:504] T 00000000000000000000000000000000 P b5b5fc4d4f7d4073aea2c8a3fe12ec60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5b5fc4d4f7d4073aea2c8a3fe12ec60" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 43131 } }
I20260809 13:04:10.039937 12976 leader_election.cc:302] T 00000000000000000000000000000000 P b5b5fc4d4f7d4073aea2c8a3fe12ec60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b5b5fc4d4f7d4073aea2c8a3fe12ec60; no voters:
I20260809 13:04:10.040699 12976 leader_election.cc:288] T 00000000000000000000000000000000 P b5b5fc4d4f7d4073aea2c8a3fe12ec60 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:04:10.040853 12985 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b5b5fc4d4f7d4073aea2c8a3fe12ec60 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:04:10.041841 12985 raft_consensus.cc:686] T 00000000000000000000000000000000 P b5b5fc4d4f7d4073aea2c8a3fe12ec60 [term 1 LEADER]: Becoming Leader. State: Replica: b5b5fc4d4f7d4073aea2c8a3fe12ec60, State: Running, Role: LEADER
I20260809 13:04:10.042482 12985 consensus_queue.cc:237] T 00000000000000000000000000000000 P b5b5fc4d4f7d4073aea2c8a3fe12ec60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5b5fc4d4f7d4073aea2c8a3fe12ec60" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 43131 } }
I20260809 13:04:10.043138 12976 sys_catalog.cc:564] T 00000000000000000000000000000000 P b5b5fc4d4f7d4073aea2c8a3fe12ec60 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:04:10.046145 12986 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5b5fc4d4f7d4073aea2c8a3fe12ec60 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b5b5fc4d4f7d4073aea2c8a3fe12ec60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5b5fc4d4f7d4073aea2c8a3fe12ec60" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 43131 } } }
I20260809 13:04:10.046630 12986 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5b5fc4d4f7d4073aea2c8a3fe12ec60 [sys.catalog]: This master's current role is: LEADER
I20260809 13:04:10.047521 12987 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5b5fc4d4f7d4073aea2c8a3fe12ec60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5b5fc4d4f7d4073aea2c8a3fe12ec60. Latest consensus state: current_term: 1 leader_uuid: "b5b5fc4d4f7d4073aea2c8a3fe12ec60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5b5fc4d4f7d4073aea2c8a3fe12ec60" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 43131 } } }
I20260809 13:04:10.048004 12987 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5b5fc4d4f7d4073aea2c8a3fe12ec60 [sys.catalog]: This master's current role is: LEADER
I20260809 13:04:10.049345 12998 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:04:10.055486 12998 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:04:10.065703 12998 catalog_manager.cc:1347] Generated new cluster ID: c11c5fa8b20c4dd69e91723e59f32d19
I20260809 13:04:10.065845 12998 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:04:10.092099 12998 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:04:10.092669 12998 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:04:10.100510 12998 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b5b5fc4d4f7d4073aea2c8a3fe12ec60: Generated new TSK 0
I20260809 13:04:10.101406 12998 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 13:04:10.110103 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:0
--local_ip_for_outbound_sockets=127.28.155.193
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:43131
--builtin_ntp_servers=127.28.155.212:33389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 13:04:10.484032 13016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:04:10.484359 13016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:04:10.484599 13016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:04:10.492441 13016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:04:10.492621 13016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:04:10.492744 13016 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:04:10.502215 13016 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:33389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:43131
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:04:10.503573 13016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:04:10.505577 13016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:04:10.520125 13027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:04:10.520289 13022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:04:10.520212 13024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:04:10.521296 13016 server_base.cc:1034] running on GCE node
I20260809 13:04:10.522082 13016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:04:10.523162 13016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:04:10.524433 13016 hybrid_clock.cc:648] HybridClock initialized: now 1786280650524372 us; error 47 us; skew 500 ppm
I20260809 13:04:10.524843 13016 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 13:04:10.531008 13016 webserver.cc:460] Webserver started at http://127.28.155.193:44237/ using document root <none> and password file <none>
I20260809 13:04:10.531991 13016 fs_manager.cc:359] Metadata directory not provided
I20260809 13:04:10.532128 13016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:04:10.532553 13016 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:04:10.535771 13016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/data/instance:
uuid: "4acd393b90dd4b24963056fc8ac55e81"
format_stamp: "Formatted at 2026-08-09 13:04:10 on dist-test-slave-jq4t"
server_key: "93edfe792f2f6686fe41eb62d93415ba"
server_key_iv: "20a235aa6c605d02964ac1ede7f7ce75"
server_key_version: "encryptionkey@0"
I20260809 13:04:10.536732 13016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance:
uuid: "4acd393b90dd4b24963056fc8ac55e81"
format_stamp: "Formatted at 2026-08-09 13:04:10 on dist-test-slave-jq4t"
server_key: "93edfe792f2f6686fe41eb62d93415ba"
server_key_iv: "20a235aa6c605d02964ac1ede7f7ce75"
server_key_version: "encryptionkey@0"
I20260809 13:04:10.543094 13016 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260809 13:04:10.547195 13034 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:04:10.549124 13016 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260809 13:04:10.549388 13016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "4acd393b90dd4b24963056fc8ac55e81"
format_stamp: "Formatted at 2026-08-09 13:04:10 on dist-test-slave-jq4t"
server_key: "93edfe792f2f6686fe41eb62d93415ba"
server_key_iv: "20a235aa6c605d02964ac1ede7f7ce75"
server_key_version: "encryptionkey@0"
I20260809 13:04:10.549690 13016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:04:10.556731 13016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:04:10.557672 13016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:04:10.557992 13016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:04:10.559082 13016 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:04:10.560765 13016 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:04:10.560902 13016 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:04:10.561046 13016 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:04:10.561141 13016 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:04:10.597738 13016 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:40203
I20260809 13:04:10.597791 13206 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:40203 every 8 connection(s)
I20260809 13:04:10.599288 13016 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:04:10.604643 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 13016
I20260809 13:04:10.604882 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance
I20260809 13:04:10.605566 29295 external_mini_cluster.cc:1428] Setting key b9c7d45305054cacd46bc148f31e3f90
I20260809 13:04:10.609067 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:0
--local_ip_for_outbound_sockets=127.28.155.194
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:43131
--builtin_ntp_servers=127.28.155.212:33389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 13:04:10.609305 13210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:10.602275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:44929 (local address 127.28.155.254:43131)
0809 13:04:10.602875 (+ 600us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:10.602880 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:10.604131 (+ 1251us) server_negotiation.cc:407] Connection header received
0809 13:04:10.606512 (+ 2381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:10.606519 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:10.606615 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:10.606748 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:10.608410 (+ 1662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:04:10.608417 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:04:10.608421 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:04:10.608442 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:04:10.608530 (+ 88us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:04:10.608559 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:04:10.608703 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 13:04:10.608881 (+ 178us) server_negotiation.cc:299] Negotiation successful
0809 13:04:10.608951 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":284,"threads_started":1}
I20260809 13:04:10.610265 13212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:10.602951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:43131 (local address 127.28.155.193:44929)
0809 13:04:10.603938 (+ 987us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:10.603980 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:10.606083 (+ 2103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:10.607051 (+ 968us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:10.607064 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:10.607197 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:04:10.608081 (+ 884us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 13:04:10.608084 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:04:10.608126 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 13:04:10.608221 (+ 95us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:04:10.608665 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:04:10.608675 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:04:10.608681 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 13:04:10.608942 (+ 261us) client_negotiation.cc:240] Negotiation successful
0809 13:04:10.609192 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":285,"threads_started":1}
I20260809 13:04:10.611990 13207 heartbeater.cc:347] Connected to a master server at 127.28.155.254:43131
I20260809 13:04:10.612322 13207 heartbeater.cc:464] Registering TS with master...
I20260809 13:04:10.613041 13207 heartbeater.cc:511] Master 127.28.155.254:43131 requested a full tablet report, sending...
I20260809 13:04:10.615156 12921 ts_manager.cc:194] Registered new tserver with Master: 4acd393b90dd4b24963056fc8ac55e81 (127.28.155.193:40203)
W20260809 13:04:10.969556 13213 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:04:10.969928 13213 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:04:10.970093 13213 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:04:10.977677 13213 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:04:10.977840 13213 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:04:10.978034 13213 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:04:10.987538 13213 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:33389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:43131
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:04:10.989220 13213 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:04:10.991106 13213 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:04:11.005049 13221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:04:11.005100 13219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:04:11.005792 13218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:04:11.013298 13213 server_base.cc:1034] running on GCE node
I20260809 13:04:11.014009 13213 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:04:11.015065 13213 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:04:11.016310 13213 hybrid_clock.cc:648] HybridClock initialized: now 1786280651016269 us; error 65 us; skew 500 ppm
I20260809 13:04:11.016706 13213 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 13:04:11.019480 13213 webserver.cc:460] Webserver started at http://127.28.155.194:44145/ using document root <none> and password file <none>
I20260809 13:04:11.020291 13213 fs_manager.cc:359] Metadata directory not provided
I20260809 13:04:11.020437 13213 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:04:11.020834 13213 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:04:11.024014 13213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/data/instance:
uuid: "f793928fd9224f70b6ef6682549ff780"
format_stamp: "Formatted at 2026-08-09 13:04:11 on dist-test-slave-jq4t"
server_key: "4e4d9cf56bf716ee16daee3c9c635dad"
server_key_iv: "92928ef2d33a34c620f0d33dcf1ef0ec"
server_key_version: "encryptionkey@0"
I20260809 13:04:11.024926 13213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance:
uuid: "f793928fd9224f70b6ef6682549ff780"
format_stamp: "Formatted at 2026-08-09 13:04:11 on dist-test-slave-jq4t"
server_key: "4e4d9cf56bf716ee16daee3c9c635dad"
server_key_iv: "92928ef2d33a34c620f0d33dcf1ef0ec"
server_key_version: "encryptionkey@0"
I20260809 13:04:11.030660 13213 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 13:04:11.034569 13237 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:04:11.036044 13213 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 13:04:11.036252 13213 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "f793928fd9224f70b6ef6682549ff780"
format_stamp: "Formatted at 2026-08-09 13:04:11 on dist-test-slave-jq4t"
server_key: "4e4d9cf56bf716ee16daee3c9c635dad"
server_key_iv: "92928ef2d33a34c620f0d33dcf1ef0ec"
server_key_version: "encryptionkey@0"
I20260809 13:04:11.036556 13213 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:04:11.042701 13213 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:04:11.043723 13213 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:04:11.044034 13213 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:04:11.045145 13213 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:04:11.046800 13213 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:04:11.046931 13213 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:04:11.047083 13213 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:04:11.047178 13213 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:04:11.083356 13213 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:34823
I20260809 13:04:11.083415 13423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:34823 every 8 connection(s)
I20260809 13:04:11.084832 13213 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:04:11.091238 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 13213
I20260809 13:04:11.091464 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance
I20260809 13:04:11.091936 29295 external_mini_cluster.cc:1428] Setting key 6467b6df41dd3cc43cf0c416b6497787
I20260809 13:04:11.094048 13210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:11.087684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:38365 (local address 127.28.155.254:43131)
0809 13:04:11.087887 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:11.087892 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:11.089410 (+ 1518us) server_negotiation.cc:407] Connection header received
0809 13:04:11.091282 (+ 1872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:11.091288 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:11.091375 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:11.091525 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:11.093212 (+ 1687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:04:11.093220 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:04:11.093229 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:04:11.093248 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:04:11.093284 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:04:11.093297 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:04:11.093455 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 13:04:11.093652 (+ 197us) server_negotiation.cc:299] Negotiation successful
0809 13:04:11.093734 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 13:04:11.095052 13427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:11.088193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:43131 (local address 127.28.155.194:38365)
0809 13:04:11.089217 (+ 1024us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:11.089259 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:11.090970 (+ 1711us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:11.091798 (+ 828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:11.091806 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:11.091903 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:04:11.092842 (+ 939us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 13:04:11.092848 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:04:11.092909 (+ 61us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 13:04:11.093028 (+ 119us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:04:11.093408 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:04:11.093424 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:04:11.093433 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 13:04:11.093747 (+ 314us) client_negotiation.cc:240] Negotiation successful
0809 13:04:11.094031 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":353,"threads_started":1}
I20260809 13:04:11.095098 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:0
--local_ip_for_outbound_sockets=127.28.155.195
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:43131
--builtin_ntp_servers=127.28.155.212:33389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 13:04:11.096582 13425 heartbeater.cc:347] Connected to a master server at 127.28.155.254:43131
I20260809 13:04:11.096961 13425 heartbeater.cc:464] Registering TS with master...
I20260809 13:04:11.097761 13425 heartbeater.cc:511] Master 127.28.155.254:43131 requested a full tablet report, sending...
I20260809 13:04:11.099535 12921 ts_manager.cc:194] Registered new tserver with Master: f793928fd9224f70b6ef6682549ff780 (127.28.155.194:34823)
W20260809 13:04:11.461820 13428 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:04:11.462152 13428 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:04:11.462328 13428 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:04:11.469983 13428 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:04:11.470124 13428 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:04:11.470322 13428 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:04:11.479941 13428 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:33389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:43131
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:04:11.481519 13428 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:04:11.483461 13428 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:04:11.497818 13436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:04:11.497848 13438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:04:11.497771 13441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:04:11.499001 13428 server_base.cc:1034] running on GCE node
I20260809 13:04:11.499804 13428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:04:11.501032 13428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:04:11.502290 13428 hybrid_clock.cc:648] HybridClock initialized: now 1786280651502235 us; error 43 us; skew 500 ppm
I20260809 13:04:11.502657 13428 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 13:04:11.505295 13428 webserver.cc:460] Webserver started at http://127.28.155.195:40159/ using document root <none> and password file <none>
I20260809 13:04:11.506083 13428 fs_manager.cc:359] Metadata directory not provided
I20260809 13:04:11.506230 13428 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:04:11.506599 13428 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:04:11.509764 13428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/data/instance:
uuid: "a3ca68ab8dde4a54a375b5a4c87fd017"
format_stamp: "Formatted at 2026-08-09 13:04:11 on dist-test-slave-jq4t"
server_key: "037b1a0dc7f98b5dcfa16f8271fa2b78"
server_key_iv: "f942f32f59aa2d8994c0e916bcb24926"
server_key_version: "encryptionkey@0"
I20260809 13:04:11.510614 13428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance:
uuid: "a3ca68ab8dde4a54a375b5a4c87fd017"
format_stamp: "Formatted at 2026-08-09 13:04:11 on dist-test-slave-jq4t"
server_key: "037b1a0dc7f98b5dcfa16f8271fa2b78"
server_key_iv: "f942f32f59aa2d8994c0e916bcb24926"
server_key_version: "encryptionkey@0"
I20260809 13:04:11.516520 13428 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 13:04:11.520311 13452 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:04:11.521811 13428 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:04:11.521976 13428 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "a3ca68ab8dde4a54a375b5a4c87fd017"
format_stamp: "Formatted at 2026-08-09 13:04:11 on dist-test-slave-jq4t"
server_key: "037b1a0dc7f98b5dcfa16f8271fa2b78"
server_key_iv: "f942f32f59aa2d8994c0e916bcb24926"
server_key_version: "encryptionkey@0"
I20260809 13:04:11.522190 13428 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:04:11.528082 13428 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:04:11.528996 13428 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:04:11.529248 13428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:04:11.530241 13428 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:04:11.531821 13428 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:04:11.531915 13428 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:04:11.532003 13428 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:04:11.532063 13428 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:04:11.566792 13428 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:38399
I20260809 13:04:11.566850 13624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:38399 every 8 connection(s)
I20260809 13:04:11.568302 13428 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:04:11.576910 13210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:11.571242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:39957 (local address 127.28.155.254:43131)
0809 13:04:11.571442 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:11.571447 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:11.573035 (+ 1588us) server_negotiation.cc:407] Connection header received
0809 13:04:11.574744 (+ 1709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:11.574748 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:11.574809 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:11.574902 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:11.576217 (+ 1315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:04:11.576222 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:04:11.576225 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:04:11.576243 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:04:11.576281 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:04:11.576292 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:04:11.576391 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 13:04:11.576586 (+ 195us) server_negotiation.cc:299] Negotiation successful
0809 13:04:11.576647 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 13:04:11.577867 13637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:11.571813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:43131 (local address 127.28.155.195:39957)
0809 13:04:11.572849 (+ 1036us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:11.572886 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:11.574491 (+ 1605us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:11.575138 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:11.575146 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:11.575237 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:04:11.575894 (+ 657us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 13:04:11.575896 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:04:11.575949 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 13:04:11.576038 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:04:11.576385 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:04:11.576393 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:04:11.576399 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 13:04:11.576642 (+ 243us) client_negotiation.cc:240] Negotiation successful
0809 13:04:11.576844 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":307,"threads_started":1}
I20260809 13:04:11.578689 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 13428
I20260809 13:04:11.578891 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance
I20260809 13:04:11.579476 29295 external_mini_cluster.cc:1428] Setting key 29513027edd3a177e58b45a85bd00152
I20260809 13:04:11.579501 13629 heartbeater.cc:347] Connected to a master server at 127.28.155.254:43131
I20260809 13:04:11.579815 13629 heartbeater.cc:464] Registering TS with master...
I20260809 13:04:11.580608 13629 heartbeater.cc:511] Master 127.28.155.254:43131 requested a full tablet report, sending...
I20260809 13:04:11.582185 12920 ts_manager.cc:194] Registered new tserver with Master: a3ca68ab8dde4a54a375b5a4c87fd017 (127.28.155.195:38399)
I20260809 13:04:11.595678 29295 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 13:04:11.602778 13210 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:04:11.600850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56714 (local address 127.28.155.254:43131)
0809 13:04:11.601054 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:11.601058 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:11.601623 (+ 565us) server_negotiation.cc:407] Connection header received
0809 13:04:11.601858 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:11.601864 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:11.601941 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:11.602052 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:11.602454 (+ 402us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56714: BlockingRecv error: recv got EOF from 127.0.0.1:56714 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 13:04:11.603775 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 13016
I20260809 13:04:11.607980 13645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:11.604948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33980 (local address 127.28.155.193:40203)
0809 13:04:11.605610 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:11.605627 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:11.605656 (+ 29us) server_negotiation.cc:407] Connection header received
0809 13:04:11.605719 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:11.605725 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:11.605932 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:11.606066 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:11.607198 (+ 1132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:04:11.607206 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:04:11.607218 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:04:11.607239 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:04:11.607303 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:04:11.607320 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:04:11.607483 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 13:04:11.607596 (+ 113us) server_negotiation.cc:299] Negotiation successful
0809 13:04:11.607685 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":499,"thread_start_us":324,"threads_started":1}
I20260809 13:04:11.609328 13199 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:04:11.693688 13207 heartbeater.cc:503] Master 127.28.155.254:43131 was elected leader, sending a full tablet report...
I20260809 13:04:11.695137 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 13016
W20260809 13:04:11.718689 12897 connection.cc:535] server connection from 127.28.155.193:44929 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 13:04:11.719086 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 13213
I20260809 13:04:11.722965 13647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:11.720113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54240 (local address 127.28.155.194:34823)
0809 13:04:11.720688 (+ 575us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:11.720696 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:11.720723 (+ 27us) server_negotiation.cc:407] Connection header received
0809 13:04:11.720791 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:11.720798 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:11.721025 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:11.721208 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:11.722225 (+ 1017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:04:11.722231 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:04:11.722242 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:04:11.722254 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:04:11.722296 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:04:11.722313 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:04:11.722471 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 13:04:11.722581 (+ 110us) server_negotiation.cc:299] Negotiation successful
0809 13:04:11.722701 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":219,"threads_started":1}
I20260809 13:04:11.724224 13418 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:04:11.813319 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 13213
I20260809 13:04:11.847471 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 13428
I20260809 13:04:11.852218 13649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:11.848791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55856 (local address 127.28.155.195:38399)
0809 13:04:11.849604 (+ 813us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:11.849612 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:11.849645 (+ 33us) server_negotiation.cc:407] Connection header received
0809 13:04:11.849716 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:11.849722 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:11.849968 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:11.850121 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:11.851343 (+ 1222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:04:11.851349 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:04:11.851361 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:04:11.851378 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:04:11.851418 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:04:11.851431 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:04:11.851567 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 13:04:11.851712 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 13:04:11.851801 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":644,"thread_start_us":809,"threads_started":1}
I20260809 13:04:11.854148 13619 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:04:11.942147 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 13428
I20260809 13:04:11.967711 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 12872
I20260809 13:04:11.969158 12967 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:04:12.078989 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 12872
2026-08-09T13:04:12Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2623 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:04:12 dist-test-slave-jq4t krb5kdc[13654](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:04:12 dist-test-slave-jq4t krb5kdc[13654](info): set up 2 sockets
Aug 09 13:04:12 dist-test-slave-jq4t krb5kdc[13654](info): commencing operation
krb5kdc: starting...
W20260809 13:04:13.410370 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.000s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:04:13 dist-test-slave-jq4t krb5kdc[13654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280653, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:04:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:04:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
I20260809 13:04:13.720580 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:46455
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:33599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:46455
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:04:14.086723 13673 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:04:14.087092 13673 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:04:14.087203 13673 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:04:14.094933 13673 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:04:14.095063 13673 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:04:14.095113 13673 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:04:14.095166 13673 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:04:14.095212 13673 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:04:14.105954 13673 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:33599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:46455
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:46455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:04:14.107379 13673 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:04:14.108798 13673 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:04:14.121538 13681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:04:14.121482 13688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:04:14.121460 13685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:04:14.122713 13673 server_base.cc:1034] running on GCE node
I20260809 13:04:14.123505 13673 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:04:14.125090 13673 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:04:14.126305 13673 hybrid_clock.cc:648] HybridClock initialized: now 1786280654126251 us; error 52 us; skew 500 ppm
I20260809 13:04:14.126698 13673 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:04:14 dist-test-slave-jq4t krb5kdc[13654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280654, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:04:14.130285 13673 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:04:14.131893 13673 webserver.cc:460] Webserver started at http://127.28.155.254:35241/ using document root <none> and password file <none>
I20260809 13:04:14.132663 13673 fs_manager.cc:359] Metadata directory not provided
I20260809 13:04:14.132781 13673 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:04:14.133060 13673 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:04:14.136184 13673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "4004d03388094df784dba7e7589d8f78"
format_stamp: "Formatted at 2026-08-09 13:04:14 on dist-test-slave-jq4t"
server_key: "6232271c88d7e6c127ffd2e2f5a82ae1"
server_key_iv: "7a5f09ec399cb95a97a985fb7efde8a7"
server_key_version: "encryptionkey@0"
I20260809 13:04:14.137032 13673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "4004d03388094df784dba7e7589d8f78"
format_stamp: "Formatted at 2026-08-09 13:04:14 on dist-test-slave-jq4t"
server_key: "6232271c88d7e6c127ffd2e2f5a82ae1"
server_key_iv: "7a5f09ec399cb95a97a985fb7efde8a7"
server_key_version: "encryptionkey@0"
I20260809 13:04:14.142443 13673 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 13:04:14.146024 13701 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:04:14.147384 13673 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 13:04:14.147588 13673 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "4004d03388094df784dba7e7589d8f78"
format_stamp: "Formatted at 2026-08-09 13:04:14 on dist-test-slave-jq4t"
server_key: "6232271c88d7e6c127ffd2e2f5a82ae1"
server_key_iv: "7a5f09ec399cb95a97a985fb7efde8a7"
server_key_version: "encryptionkey@0"
I20260809 13:04:14.147799 13673 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:04:14.163564 13673 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:04:14.168113 13673 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:04:14.168439 13673 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:04:14.187788 13673 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:46455
I20260809 13:04:14.187821 13778 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:46455 every 8 connection(s)
I20260809 13:04:14.189327 13673 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:04:14.193063 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 13673
I20260809 13:04:14.193351 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:04:14.193744 13779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:04:14.194269 29295 external_mini_cluster.cc:1428] Setting key 48180d36a2fdcceb0dd5f8c8df8200cb
I20260809 13:04:14.209826 13779 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4004d03388094df784dba7e7589d8f78: Bootstrap starting.
Aug 09 13:04:14 dist-test-slave-jq4t krb5kdc[13654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280653, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:04:14.213603 13779 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4004d03388094df784dba7e7589d8f78: Neither blocks nor log segments found. Creating new log.
I20260809 13:04:14.214804 13779 log.cc:824] T 00000000000000000000000000000000 P 4004d03388094df784dba7e7589d8f78: Log is configured to *not* fsync() on all Append() calls
I20260809 13:04:14.218291 13779 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4004d03388094df784dba7e7589d8f78: No bootstrap required, opened a new log
I20260809 13:04:14.219523 13784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:14.196445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55960 (local address 127.28.155.254:46455)
0809 13:04:14.197401 (+ 956us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:14.197413 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:14.197462 (+ 49us) server_negotiation.cc:407] Connection header received
0809 13:04:14.199156 (+ 1694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:14.199181 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:14.199600 (+ 419us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:14.199965 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:14.202020 (+ 2055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:14.203340 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:14.205233 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:14.206054 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:14.206215 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:14.211546 (+ 5331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:04:14.211556 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:04:14.211572 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:04:14.211623 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:04:14.215024 (+ 3401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:04:14.215814 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:04:14.215822 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:04:14.215833 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:04:14.216026 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:04:14.216530 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:04:14.216535 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:04:14.216539 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:04:14.217128 (+ 589us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:04:14.217493 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0809 13:04:14.217957 (+ 464us) server_negotiation.cc:299] Negotiation successful
0809 13:04:14.218461 (+ 504us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":745,"thread_start_us":436,"threads_started":1}
I20260809 13:04:14.227892 13779 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4004d03388094df784dba7e7589d8f78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4004d03388094df784dba7e7589d8f78" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46455 } }
I20260809 13:04:14.228271 13779 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4004d03388094df784dba7e7589d8f78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:04:14.228433 13779 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4004d03388094df784dba7e7589d8f78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4004d03388094df784dba7e7589d8f78, State: Initialized, Role: FOLLOWER
I20260809 13:04:14.229120 13779 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4004d03388094df784dba7e7589d8f78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4004d03388094df784dba7e7589d8f78" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46455 } }
I20260809 13:04:14.229337 13779 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4004d03388094df784dba7e7589d8f78 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:04:14.229442 13779 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4004d03388094df784dba7e7589d8f78 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:04:14.229576 13779 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4004d03388094df784dba7e7589d8f78 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:04:14.231820 13779 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4004d03388094df784dba7e7589d8f78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4004d03388094df784dba7e7589d8f78" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46455 } }
I20260809 13:04:14.232352 13779 leader_election.cc:302] T 00000000000000000000000000000000 P 4004d03388094df784dba7e7589d8f78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4004d03388094df784dba7e7589d8f78; no voters:
I20260809 13:04:14.233009 13779 leader_election.cc:288] T 00000000000000000000000000000000 P 4004d03388094df784dba7e7589d8f78 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:04:14.233170 13788 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4004d03388094df784dba7e7589d8f78 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:04:14.234769 13788 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4004d03388094df784dba7e7589d8f78 [term 1 LEADER]: Becoming Leader. State: Replica: 4004d03388094df784dba7e7589d8f78, State: Running, Role: LEADER
I20260809 13:04:14.235347 13788 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4004d03388094df784dba7e7589d8f78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4004d03388094df784dba7e7589d8f78" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46455 } }
I20260809 13:04:14.235558 13779 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4004d03388094df784dba7e7589d8f78 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:04:14.238837 13794 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4004d03388094df784dba7e7589d8f78 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4004d03388094df784dba7e7589d8f78. Latest consensus state: current_term: 1 leader_uuid: "4004d03388094df784dba7e7589d8f78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4004d03388094df784dba7e7589d8f78" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46455 } } }
I20260809 13:04:14.239024 13791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4004d03388094df784dba7e7589d8f78 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4004d03388094df784dba7e7589d8f78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4004d03388094df784dba7e7589d8f78" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46455 } } }
I20260809 13:04:14.239281 13794 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4004d03388094df784dba7e7589d8f78 [sys.catalog]: This master's current role is: LEADER
I20260809 13:04:14.239375 13791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4004d03388094df784dba7e7589d8f78 [sys.catalog]: This master's current role is: LEADER
I20260809 13:04:14.241427 13803 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:04:14.246639 13803 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:04:14.256212 13803 catalog_manager.cc:1347] Generated new cluster ID: 8e1ded414b8344b38b18578e9ff07598
I20260809 13:04:14.256349 13803 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:04:14.264130 13803 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:04:14.265535 13803 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:04:14.276583 13803 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4004d03388094df784dba7e7589d8f78: Generated new TSK 0
I20260809 13:04:14.277621 13803 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
I20260809 13:04:14.346261 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:0
--local_ip_for_outbound_sockets=127.28.155.193
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:46455
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:33599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:04:14.717813 13822 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:04:14.718120 13822 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:04:14.718308 13822 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:04:14.726240 13822 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:04:14.726370 13822 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:04:14.726548 13822 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:04:14.737977 13822 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:33599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:46455
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:04:14.739477 13822 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:04:14.741101 13822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:04:14.756219 13832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:04:14.756251 13835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:04:14.756297 13833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:04:14.757550 13822 server_base.cc:1034] running on GCE node
I20260809 13:04:14.758302 13822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:04:14.759441 13822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:04:14.760704 13822 hybrid_clock.cc:648] HybridClock initialized: now 1786280654760646 us; error 47 us; skew 500 ppm
I20260809 13:04:14.761317 13822 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:04:14 dist-test-slave-jq4t krb5kdc[13654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280654, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:04:14.764969 13822 init.cc:377] Logged in from keytab as kudu/127.28.155.193@KRBTEST.COM (short username kudu)
I20260809 13:04:14.766615 13822 webserver.cc:460] Webserver started at http://127.28.155.193:39403/ using document root <none> and password file <none>
I20260809 13:04:14.767410 13822 fs_manager.cc:359] Metadata directory not provided
I20260809 13:04:14.767529 13822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:04:14.767863 13822 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:04:14.771087 13822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/data/instance:
uuid: "e046740df37f4e7e90e872d8aba1672c"
format_stamp: "Formatted at 2026-08-09 13:04:14 on dist-test-slave-jq4t"
server_key: "2a05788759790a0d25f08fe6ff46db83"
server_key_iv: "1bfa10f100c62943a3cdd95d99adb512"
server_key_version: "encryptionkey@0"
I20260809 13:04:14.771896 13822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance:
uuid: "e046740df37f4e7e90e872d8aba1672c"
format_stamp: "Formatted at 2026-08-09 13:04:14 on dist-test-slave-jq4t"
server_key: "2a05788759790a0d25f08fe6ff46db83"
server_key_iv: "1bfa10f100c62943a3cdd95d99adb512"
server_key_version: "encryptionkey@0"
I20260809 13:04:14.777626 13822 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 13:04:14.781399 13843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:04:14.782831 13822 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:04:14.783028 13822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "e046740df37f4e7e90e872d8aba1672c"
format_stamp: "Formatted at 2026-08-09 13:04:14 on dist-test-slave-jq4t"
server_key: "2a05788759790a0d25f08fe6ff46db83"
server_key_iv: "1bfa10f100c62943a3cdd95d99adb512"
server_key_version: "encryptionkey@0"
I20260809 13:04:14.783262 13822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:04:14.830161 13822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:04:14.835404 13822 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:04:14.835855 13822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:04:14.837136 13822 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:04:14.838872 13822 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:04:14.838994 13822 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:04:14.839164 13822 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:04:14.839249 13822 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:04:14.876732 13822 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:34693
I20260809 13:04:14.876768 14014 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:34693 every 8 connection(s)
I20260809 13:04:14.878280 13822 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:04:14.879540 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 13822
I20260809 13:04:14.879789 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance
I20260809 13:04:14.880748 29295 external_mini_cluster.cc:1428] Setting key 002f52ad735320270fdaa5ccd56cf1a9
Aug 09 13:04:14 dist-test-slave-jq4t krb5kdc[13654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280654, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:04:14.900913 14018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:14.881555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:44529 (local address 127.28.155.254:46455)
0809 13:04:14.882102 (+ 547us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:14.882106 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:14.883184 (+ 1078us) server_negotiation.cc:407] Connection header received
0809 13:04:14.885205 (+ 2021us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:14.885215 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:14.885309 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:14.885447 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:14.886987 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:14.888167 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:14.889823 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:14.890548 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:14.890698 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:14.894497 (+ 3799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:04:14.894506 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:04:14.894513 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:04:14.894560 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:04:14.897475 (+ 2915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:04:14.898439 (+ 964us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:04:14.898443 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:04:14.898445 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:04:14.898564 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:04:14.899065 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:04:14.899068 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:04:14.899070 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:04:14.899335 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:04:14.899459 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 13:04:14.900368 (+ 909us) server_negotiation.cc:299] Negotiation successful
0809 13:04:14.900632 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":297,"threads_started":1}
I20260809 13:04:14.902441 14019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:14.882117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:46455 (local address 127.28.155.193:44529)
0809 13:04:14.883008 (+ 891us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:14.883064 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:14.884929 (+ 1865us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:14.885643 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:14.885651 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:14.886163 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:04:14.886806 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:14.886825 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:14.888341 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:14.888345 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:14.889667 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:14.889679 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:14.890772 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:14.890776 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:14.891007 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:14.891730 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:04:14.891753 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:04:14.894260 (+ 2507us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:04:14.897634 (+ 3374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:04:14.897646 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:04:14.897666 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:04:14.898309 (+ 643us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:04:14.898671 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:04:14.898679 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:04:14.898686 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:04:14.898950 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:04:14.899489 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:04:14.899500 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:04:14.899961 (+ 461us) client_negotiation.cc:769] Sending connection context
0809 13:04:14.900271 (+ 310us) client_negotiation.cc:240] Negotiation successful
0809 13:04:14.900885 (+ 614us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":332,"threads_started":1}
I20260809 13:04:14.904141 14016 heartbeater.cc:347] Connected to a master server at 127.28.155.254:46455
I20260809 13:04:14.904536 14016 heartbeater.cc:464] Registering TS with master...
I20260809 13:04:14.905414 14016 heartbeater.cc:511] Master 127.28.155.254:46455 requested a full tablet report, sending...
I20260809 13:04:14.907775 13725 ts_manager.cc:194] Registered new tserver with Master: e046740df37f4e7e90e872d8aba1672c (127.28.155.193:34693)
I20260809 13:04:14.909374 13725 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.193@KRBTEST.COM'} at 127.28.155.193:44529
WARNING: no policy specified for kudu/127.28.155.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
I20260809 13:04:14.951872 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:0
--local_ip_for_outbound_sockets=127.28.155.194
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:46455
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:33599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:04:15.315178 14022 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:04:15.315455 14022 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:04:15.315614 14022 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:04:15.323051 14022 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:04:15.323159 14022 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:04:15.323328 14022 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:04:15.333235 14022 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:33599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:46455
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:04:15.334602 14022 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:04:15.335954 14022 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:04:15.350098 14030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:04:15.350543 14029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:04:15.350144 14034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:04:15.351369 14022 server_base.cc:1034] running on GCE node
I20260809 13:04:15.352180 14022 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:04:15.353323 14022 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:04:15.354560 14022 hybrid_clock.cc:648] HybridClock initialized: now 1786280655354499 us; error 56 us; skew 500 ppm
I20260809 13:04:15.354912 14022 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:04:15 dist-test-slave-jq4t krb5kdc[13654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280655, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:04:15.358253 14022 init.cc:377] Logged in from keytab as kudu/127.28.155.194@KRBTEST.COM (short username kudu)
I20260809 13:04:15.359846 14022 webserver.cc:460] Webserver started at http://127.28.155.194:35481/ using document root <none> and password file <none>
I20260809 13:04:15.360769 14022 fs_manager.cc:359] Metadata directory not provided
I20260809 13:04:15.360970 14022 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:04:15.361389 14022 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:04:15.365032 14022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/data/instance:
uuid: "068fa242033d4440ae73c4383363d2a3"
format_stamp: "Formatted at 2026-08-09 13:04:15 on dist-test-slave-jq4t"
server_key: "e7e8fe37367a8c39d2601fc2fca8b24c"
server_key_iv: "f56c0850fc5a9b3505fba25413daf114"
server_key_version: "encryptionkey@0"
I20260809 13:04:15.365885 14022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance:
uuid: "068fa242033d4440ae73c4383363d2a3"
format_stamp: "Formatted at 2026-08-09 13:04:15 on dist-test-slave-jq4t"
server_key: "e7e8fe37367a8c39d2601fc2fca8b24c"
server_key_iv: "f56c0850fc5a9b3505fba25413daf114"
server_key_version: "encryptionkey@0"
I20260809 13:04:15.371420 14022 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 13:04:15.375149 14046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:04:15.376606 14022 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:04:15.376808 14022 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "068fa242033d4440ae73c4383363d2a3"
format_stamp: "Formatted at 2026-08-09 13:04:15 on dist-test-slave-jq4t"
server_key: "e7e8fe37367a8c39d2601fc2fca8b24c"
server_key_iv: "f56c0850fc5a9b3505fba25413daf114"
server_key_version: "encryptionkey@0"
I20260809 13:04:15.377050 14022 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:04:15.403081 14022 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:04:15.407933 14022 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:04:15.408291 14022 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:04:15.409487 14022 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:04:15.411027 14022 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:04:15.411144 14022 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:04:15.411300 14022 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:04:15.411375 14022 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:04:15.447919 14022 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:38829
I20260809 13:04:15.447994 14201 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:38829 every 8 connection(s)
I20260809 13:04:15.449393 14022 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:04:15.454279 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 14022
I20260809 13:04:15.454504 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance
I20260809 13:04:15.455026 29295 external_mini_cluster.cc:1428] Setting key cdc2d41d1c50a613f84a35e8d6829866
Aug 09 13:04:15 dist-test-slave-jq4t krb5kdc[13654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280655, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:04:15.471527 14205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:15.452263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:41933 (local address 127.28.155.254:46455)
0809 13:04:15.452756 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:15.452760 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:15.454088 (+ 1328us) server_negotiation.cc:407] Connection header received
0809 13:04:15.456380 (+ 2292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:15.456385 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:15.456502 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:15.456653 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:15.458351 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:15.459099 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:15.460805 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:15.461257 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:15.461412 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:15.465412 (+ 4000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:04:15.465417 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:04:15.465421 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:04:15.465456 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:04:15.468152 (+ 2696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:04:15.469028 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:04:15.469036 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:04:15.469039 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:04:15.469183 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:04:15.469658 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:04:15.469663 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:04:15.469665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:04:15.469946 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:04:15.470112 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 13:04:15.470876 (+ 764us) server_negotiation.cc:299] Negotiation successful
0809 13:04:15.471137 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":271,"threads_started":1}
I20260809 13:04:15.472681 14206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:15.452997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:46455 (local address 127.28.155.194:41933)
0809 13:04:15.453851 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:15.453915 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:15.456077 (+ 2162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:15.456939 (+ 862us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:15.456953 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:15.457548 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:04:15.458160 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:15.458183 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:15.459259 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:15.459265 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:15.460654 (+ 1389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:15.460668 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:15.461505 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:15.461513 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:15.461778 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:15.462553 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:04:15.462576 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:04:15.465135 (+ 2559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:04:15.468308 (+ 3173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:04:15.468318 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:04:15.468337 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:04:15.468890 (+ 553us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:04:15.469308 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:04:15.469313 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:04:15.469317 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:04:15.469526 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:04:15.470089 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:04:15.470098 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:04:15.470472 (+ 374us) client_negotiation.cc:769] Sending connection context
0809 13:04:15.470756 (+ 284us) client_negotiation.cc:240] Negotiation successful
0809 13:04:15.471358 (+ 602us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":295,"threads_started":1}
I20260809 13:04:15.474308 14202 heartbeater.cc:347] Connected to a master server at 127.28.155.254:46455
I20260809 13:04:15.474726 14202 heartbeater.cc:464] Registering TS with master...
I20260809 13:04:15.475716 14202 heartbeater.cc:511] Master 127.28.155.254:46455 requested a full tablet report, sending...
I20260809 13:04:15.477715 13725 ts_manager.cc:194] Registered new tserver with Master: 068fa242033d4440ae73c4383363d2a3 (127.28.155.194:38829)
I20260809 13:04:15.479084 13725 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.194@KRBTEST.COM'} at 127.28.155.194:41933
WARNING: no policy specified for kudu/127.28.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
I20260809 13:04:15.529181 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:0
--local_ip_for_outbound_sockets=127.28.155.195
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:46455
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:33599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:04:15.895578 14212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:04:15.895892 14212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:04:15.895993 14212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:04:15.903379 14212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:04:15.903504 14212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:04:15.903620 14212 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:04:15.912590 14016 heartbeater.cc:503] Master 127.28.155.254:46455 was elected leader, sending a full tablet report...
I20260809 13:04:15.915082 14212 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:33599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:46455
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:04:15.916460 14212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:04:15.917870 14212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:04:15.931980 14218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:04:15.931914 14219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:04:15.931939 14224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:04:15.933223 14212 server_base.cc:1034] running on GCE node
I20260809 13:04:15.933929 14212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:04:15.935019 14212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:04:15.936281 14212 hybrid_clock.cc:648] HybridClock initialized: now 1786280655936219 us; error 55 us; skew 500 ppm
I20260809 13:04:15.936721 14212 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:04:15 dist-test-slave-jq4t krb5kdc[13654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280655, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:04:15.944669 14212 init.cc:377] Logged in from keytab as kudu/127.28.155.195@KRBTEST.COM (short username kudu)
I20260809 13:04:15.946813 14212 webserver.cc:460] Webserver started at http://127.28.155.195:36357/ using document root <none> and password file <none>
I20260809 13:04:15.947651 14212 fs_manager.cc:359] Metadata directory not provided
I20260809 13:04:15.947829 14212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:04:15.948194 14212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:04:15.951844 14212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/data/instance:
uuid: "225dacb46ae044bf90db7a8f4cf64a8c"
format_stamp: "Formatted at 2026-08-09 13:04:15 on dist-test-slave-jq4t"
server_key: "43ac57ce565b2c07593ae2c1555a543a"
server_key_iv: "22c591f9599ec04ce59a289d1eca45e0"
server_key_version: "encryptionkey@0"
I20260809 13:04:15.952890 14212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance:
uuid: "225dacb46ae044bf90db7a8f4cf64a8c"
format_stamp: "Formatted at 2026-08-09 13:04:15 on dist-test-slave-jq4t"
server_key: "43ac57ce565b2c07593ae2c1555a543a"
server_key_iv: "22c591f9599ec04ce59a289d1eca45e0"
server_key_version: "encryptionkey@0"
I20260809 13:04:15.958873 14212 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260809 13:04:15.962945 14234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:04:15.964434 14212 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 13:04:15.964700 14212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "225dacb46ae044bf90db7a8f4cf64a8c"
format_stamp: "Formatted at 2026-08-09 13:04:15 on dist-test-slave-jq4t"
server_key: "43ac57ce565b2c07593ae2c1555a543a"
server_key_iv: "22c591f9599ec04ce59a289d1eca45e0"
server_key_version: "encryptionkey@0"
I20260809 13:04:15.964962 14212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:04:15.993424 14212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:04:15.998507 14212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:04:15.998878 14212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:04:16.000015 14212 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:04:16.001698 14212 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:04:16.001809 14212 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:04:16.001973 14212 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:04:16.002053 14212 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:04:16.039569 14212 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:45287
I20260809 13:04:16.039625 14390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:45287 every 8 connection(s)
I20260809 13:04:16.041078 14212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:04:16.042495 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 14212
I20260809 13:04:16.042724 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance
I20260809 13:04:16.043332 29295 external_mini_cluster.cc:1428] Setting key 69867de47c71062d7310c8eb7f707e10
Aug 09 13:04:16 dist-test-slave-jq4t krb5kdc[13654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280655, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:04:16.063479 14393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:16.044298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:39011 (local address 127.28.155.254:46455)
0809 13:04:16.044867 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:16.044874 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:16.046354 (+ 1480us) server_negotiation.cc:407] Connection header received
0809 13:04:16.048316 (+ 1962us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:16.048320 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:16.048389 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:16.048527 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:16.050131 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.050964 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.052572 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.053067 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.053167 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:16.057074 (+ 3907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:04:16.057082 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:04:16.057086 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:04:16.057141 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:04:16.060560 (+ 3419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:04:16.061362 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:04:16.061366 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:04:16.061368 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:04:16.061497 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:04:16.061888 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:04:16.061891 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:04:16.061893 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:04:16.062172 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:04:16.062297 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 13:04:16.062996 (+ 699us) server_negotiation.cc:299] Negotiation successful
0809 13:04:16.063190 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":279,"threads_started":1}
I20260809 13:04:16.064580 14394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:16.045054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:46455 (local address 127.28.155.195:39011)
0809 13:04:16.046175 (+ 1121us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:16.046224 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:16.048056 (+ 1832us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:16.048779 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:16.048788 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:16.049355 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:04:16.049953 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:16.049971 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.051104 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.051108 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:16.052383 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:16.052402 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.053276 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.053280 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:16.053490 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:16.054315 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:04:16.054339 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:04:16.056798 (+ 2459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:04:16.060703 (+ 3905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:04:16.060710 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:04:16.060725 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:04:16.061248 (+ 523us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:04:16.061592 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:04:16.061596 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:04:16.061598 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:04:16.061788 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:04:16.062288 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:04:16.062294 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:04:16.062645 (+ 351us) client_negotiation.cc:769] Sending connection context
0809 13:04:16.062895 (+ 250us) client_negotiation.cc:240] Negotiation successful
0809 13:04:16.063322 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":828,"thread_start_us":609,"threads_started":1}
I20260809 13:04:16.065964 14391 heartbeater.cc:347] Connected to a master server at 127.28.155.254:46455
I20260809 13:04:16.066299 14391 heartbeater.cc:464] Registering TS with master...
I20260809 13:04:16.067081 14391 heartbeater.cc:511] Master 127.28.155.254:46455 requested a full tablet report, sending...
I20260809 13:04:16.068553 13725 ts_manager.cc:194] Registered new tserver with Master: 225dacb46ae044bf90db7a8f4cf64a8c (127.28.155.195:45287)
I20260809 13:04:16.069507 13725 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.195@KRBTEST.COM'} at 127.28.155.195:39011
I20260809 13:04:16.072281 29295 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 13:04:16.090072 14393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:16.076901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49064 (local address 127.28.155.254:46455)
0809 13:04:16.077121 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:16.077131 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:16.077552 (+ 421us) server_negotiation.cc:407] Connection header received
0809 13:04:16.077758 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:16.077763 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:16.077840 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:16.077943 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:16.079401 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.080142 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.081487 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.082037 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.082182 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:16.084610 (+ 2428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:04:16.084617 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:04:16.084623 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:04:16.084662 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:04:16.087288 (+ 2626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:04:16.087953 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:04:16.087959 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:04:16.087963 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:04:16.088127 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:04:16.088527 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:04:16.088532 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:04:16.088535 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:04:16.088900 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:04:16.089176 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0809 13:04:16.089510 (+ 334us) server_negotiation.cc:299] Negotiation successful
0809 13:04:16.089746 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 13:04:16.094442 13725 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49064:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 13:04:16.101713 13725 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:04:16.142905 14414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:16.116714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54448 (local address 127.28.155.195:45287)
0809 13:04:16.126930 (+ 10216us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:16.126944 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:16.132959 (+ 6015us) server_negotiation.cc:407] Connection header received
0809 13:04:16.134062 (+ 1103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:16.134069 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:16.134241 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:16.134467 (+ 226us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:04:16.135253 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.137182 (+ 1929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.139891 (+ 2709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.141587 (+ 1696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.141805 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:16.142004 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0809 13:04:16.142315 (+ 311us) server_negotiation.cc:299] Negotiation successful
0809 13:04:16.142527 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8242,"thread_start_us":8032,"threads_started":1}
I20260809 13:04:16.142978 14410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:16.116065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:45287 (local address 127.0.0.1:54448)
0809 13:04:16.132799 (+ 16734us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:16.132821 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:16.133858 (+ 1037us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:16.134499 (+ 641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:16.134506 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:16.134553 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:04:16.135008 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:16.135024 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.137362 (+ 2338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.137368 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:16.139725 (+ 2357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:16.139741 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.141814 (+ 2073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.141820 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:16.142032 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:16.142093 (+ 61us) client_negotiation.cc:769] Sending connection context
0809 13:04:16.142245 (+ 152us) client_negotiation.cc:240] Negotiation successful
0809 13:04:16.142477 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16610,"mutex_wait_us":64,"thread_start_us":15454,"threads_started":1}
I20260809 13:04:16.144032 14412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:16.116071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49086 (local address 127.28.155.193:34693)
0809 13:04:16.134522 (+ 18451us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:16.134528 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:16.134552 (+ 24us) server_negotiation.cc:407] Connection header received
0809 13:04:16.134627 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:16.134632 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:16.134781 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:16.135013 (+ 232us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:04:16.136129 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.137795 (+ 1666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.140777 (+ 2982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.142277 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.142491 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:16.142664 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0809 13:04:16.143476 (+ 812us) server_negotiation.cc:299] Negotiation successful
0809 13:04:16.143661 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18254,"thread_start_us":18081,"threads_started":1}
I20260809 13:04:16.144078 14409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:16.115538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:34693 (local address 127.0.0.1:49086)
0809 13:04:16.130799 (+ 15261us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:16.130907 (+ 108us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:16.131241 (+ 334us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:16.135282 (+ 4041us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:16.135288 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:16.135320 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:04:16.135895 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:16.135910 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.137955 (+ 2045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.137960 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:16.140567 (+ 2607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:16.140585 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.142839 (+ 2254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.142846 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:16.143237 (+ 391us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:16.143276 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 13:04:16.143394 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 13:04:16.143557 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14803,"mutex_wait_us":53,"thread_start_us":15988,"threads_started":1}
I20260809 13:04:16.145160 14413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:16.116263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45996 (local address 127.28.155.194:38829)
0809 13:04:16.133438 (+ 17175us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:16.133449 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:16.133494 (+ 45us) server_negotiation.cc:407] Connection header received
0809 13:04:16.133606 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:16.133614 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:16.133894 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:16.134974 (+ 1080us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:04:16.135822 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.137445 (+ 1623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.141375 (+ 3930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.142830 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.143025 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:16.143202 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0809 13:04:16.144188 (+ 986us) server_negotiation.cc:299] Negotiation successful
0809 13:04:16.144793 (+ 605us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16990,"thread_start_us":17276,"threads_started":1}
I20260809 13:04:16.146296 14411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:16.115628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:38829 (local address 127.0.0.1:45996)
0809 13:04:16.131067 (+ 15439us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:16.131095 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:16.131274 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:16.134997 (+ 3723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:16.135002 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:16.135029 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:04:16.135610 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:16.135624 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.137602 (+ 1978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.137608 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:16.141048 (+ 3440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:16.141062 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.143347 (+ 2285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.143381 (+ 34us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:16.143574 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:16.143610 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 13:04:16.143709 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 13:04:16.143915 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15255,"mutex_wait_us":33,"thread_start_us":16854,"threads_started":1}
I20260809 13:04:16.148025 13927 tablet_service.cc:1467] Processing CreateTablet for tablet 917d057737fa4f97884f75871eb5e4c4 (DEFAULT_TABLE table=test-table [id=8af86f926dfa4f249d2b0861d25395f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:04:16.148077 14296 tablet_service.cc:1467] Processing CreateTablet for tablet 917d057737fa4f97884f75871eb5e4c4 (DEFAULT_TABLE table=test-table [id=8af86f926dfa4f249d2b0861d25395f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:04:16.149492 13927 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 917d057737fa4f97884f75871eb5e4c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:04:16.149641 14296 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 917d057737fa4f97884f75871eb5e4c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:04:16.150316 14112 tablet_service.cc:1467] Processing CreateTablet for tablet 917d057737fa4f97884f75871eb5e4c4 (DEFAULT_TABLE table=test-table [id=8af86f926dfa4f249d2b0861d25395f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:04:16.152190 14112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 917d057737fa4f97884f75871eb5e4c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:04:16.162245 14415 tablet_bootstrap.cc:492] T 917d057737fa4f97884f75871eb5e4c4 P e046740df37f4e7e90e872d8aba1672c: Bootstrap starting.
I20260809 13:04:16.166424 14415 tablet_bootstrap.cc:654] T 917d057737fa4f97884f75871eb5e4c4 P e046740df37f4e7e90e872d8aba1672c: Neither blocks nor log segments found. Creating new log.
I20260809 13:04:16.167577 14415 log.cc:824] T 917d057737fa4f97884f75871eb5e4c4 P e046740df37f4e7e90e872d8aba1672c: Log is configured to *not* fsync() on all Append() calls
I20260809 13:04:16.169989 14419 tablet_bootstrap.cc:492] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3: Bootstrap starting.
I20260809 13:04:16.171334 14415 tablet_bootstrap.cc:492] T 917d057737fa4f97884f75871eb5e4c4 P e046740df37f4e7e90e872d8aba1672c: No bootstrap required, opened a new log
I20260809 13:04:16.171646 14415 ts_tablet_manager.cc:1397] T 917d057737fa4f97884f75871eb5e4c4 P e046740df37f4e7e90e872d8aba1672c: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260809 13:04:16.172658 14417 tablet_bootstrap.cc:492] T 917d057737fa4f97884f75871eb5e4c4 P 225dacb46ae044bf90db7a8f4cf64a8c: Bootstrap starting.
I20260809 13:04:16.174176 14419 tablet_bootstrap.cc:654] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3: Neither blocks nor log segments found. Creating new log.
I20260809 13:04:16.175561 14419 log.cc:824] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3: Log is configured to *not* fsync() on all Append() calls
I20260809 13:04:16.176229 14417 tablet_bootstrap.cc:654] T 917d057737fa4f97884f75871eb5e4c4 P 225dacb46ae044bf90db7a8f4cf64a8c: Neither blocks nor log segments found. Creating new log.
I20260809 13:04:16.177500 14417 log.cc:824] T 917d057737fa4f97884f75871eb5e4c4 P 225dacb46ae044bf90db7a8f4cf64a8c: Log is configured to *not* fsync() on all Append() calls
I20260809 13:04:16.179111 14419 tablet_bootstrap.cc:492] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3: No bootstrap required, opened a new log
I20260809 13:04:16.179409 14419 ts_tablet_manager.cc:1397] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260809 13:04:16.180212 14417 tablet_bootstrap.cc:492] T 917d057737fa4f97884f75871eb5e4c4 P 225dacb46ae044bf90db7a8f4cf64a8c: No bootstrap required, opened a new log
I20260809 13:04:16.180524 14417 ts_tablet_manager.cc:1397] T 917d057737fa4f97884f75871eb5e4c4 P 225dacb46ae044bf90db7a8f4cf64a8c: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.000s
I20260809 13:04:16.183251 14415 raft_consensus.cc:348] T 917d057737fa4f97884f75871eb5e4c4 P e046740df37f4e7e90e872d8aba1672c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e046740df37f4e7e90e872d8aba1672c" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34693 } } peers { permanent_uuid: "068fa242033d4440ae73c4383363d2a3" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 38829 } } peers { permanent_uuid: "225dacb46ae044bf90db7a8f4cf64a8c" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 45287 } }
I20260809 13:04:16.183820 14415 raft_consensus.cc:374] T 917d057737fa4f97884f75871eb5e4c4 P e046740df37f4e7e90e872d8aba1672c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:04:16.183928 14415 raft_consensus.cc:729] T 917d057737fa4f97884f75871eb5e4c4 P e046740df37f4e7e90e872d8aba1672c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e046740df37f4e7e90e872d8aba1672c, State: Initialized, Role: FOLLOWER
I20260809 13:04:16.184628 14415 consensus_queue.cc:260] T 917d057737fa4f97884f75871eb5e4c4 P e046740df37f4e7e90e872d8aba1672c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e046740df37f4e7e90e872d8aba1672c" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34693 } } peers { permanent_uuid: "068fa242033d4440ae73c4383363d2a3" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 38829 } } peers { permanent_uuid: "225dacb46ae044bf90db7a8f4cf64a8c" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 45287 } }
I20260809 13:04:16.189841 14417 raft_consensus.cc:348] T 917d057737fa4f97884f75871eb5e4c4 P 225dacb46ae044bf90db7a8f4cf64a8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e046740df37f4e7e90e872d8aba1672c" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34693 } } peers { permanent_uuid: "068fa242033d4440ae73c4383363d2a3" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 38829 } } peers { permanent_uuid: "225dacb46ae044bf90db7a8f4cf64a8c" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 45287 } }
I20260809 13:04:16.190266 14417 raft_consensus.cc:374] T 917d057737fa4f97884f75871eb5e4c4 P 225dacb46ae044bf90db7a8f4cf64a8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:04:16.190342 14417 raft_consensus.cc:729] T 917d057737fa4f97884f75871eb5e4c4 P 225dacb46ae044bf90db7a8f4cf64a8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225dacb46ae044bf90db7a8f4cf64a8c, State: Initialized, Role: FOLLOWER
I20260809 13:04:16.191042 14417 consensus_queue.cc:260] T 917d057737fa4f97884f75871eb5e4c4 P 225dacb46ae044bf90db7a8f4cf64a8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e046740df37f4e7e90e872d8aba1672c" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34693 } } peers { permanent_uuid: "068fa242033d4440ae73c4383363d2a3" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 38829 } } peers { permanent_uuid: "225dacb46ae044bf90db7a8f4cf64a8c" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 45287 } }
I20260809 13:04:16.192621 14419 raft_consensus.cc:348] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e046740df37f4e7e90e872d8aba1672c" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34693 } } peers { permanent_uuid: "068fa242033d4440ae73c4383363d2a3" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 38829 } } peers { permanent_uuid: "225dacb46ae044bf90db7a8f4cf64a8c" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 45287 } }
I20260809 13:04:16.193177 14419 raft_consensus.cc:374] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:04:16.193286 14419 raft_consensus.cc:729] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 068fa242033d4440ae73c4383363d2a3, State: Initialized, Role: FOLLOWER
I20260809 13:04:16.194165 14419 consensus_queue.cc:260] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e046740df37f4e7e90e872d8aba1672c" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34693 } } peers { permanent_uuid: "068fa242033d4440ae73c4383363d2a3" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 38829 } } peers { permanent_uuid: "225dacb46ae044bf90db7a8f4cf64a8c" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 45287 } }
I20260809 13:04:16.196381 14415 ts_tablet_manager.cc:1428] T 917d057737fa4f97884f75871eb5e4c4 P e046740df37f4e7e90e872d8aba1672c: Time spent starting tablet: real 0.025s user 0.015s sys 0.009s
I20260809 13:04:16.199993 14417 ts_tablet_manager.cc:1428] T 917d057737fa4f97884f75871eb5e4c4 P 225dacb46ae044bf90db7a8f4cf64a8c: Time spent starting tablet: real 0.019s user 0.008s sys 0.009s
I20260809 13:04:16.200675 14391 heartbeater.cc:503] Master 127.28.155.254:46455 was elected leader, sending a full tablet report...
I20260809 13:04:16.201105 14419 ts_tablet_manager.cc:1428] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3: Time spent starting tablet: real 0.022s user 0.021s sys 0.000s
I20260809 13:04:16.201510 14202 heartbeater.cc:503] Master 127.28.155.254:46455 was elected leader, sending a full tablet report...
W20260809 13:04:16.201540 14203 tablet.cc:2369] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:04:16.262405 14426 raft_consensus.cc:482] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:04:16.262737 14426 raft_consensus.cc:504] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e046740df37f4e7e90e872d8aba1672c" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34693 } } peers { permanent_uuid: "068fa242033d4440ae73c4383363d2a3" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 38829 } } peers { permanent_uuid: "225dacb46ae044bf90db7a8f4cf64a8c" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 45287 } }
I20260809 13:04:16.264664 14426 leader_election.cc:288] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e046740df37f4e7e90e872d8aba1672c (127.28.155.193:34693), 225dacb46ae044bf90db7a8f4cf64a8c (127.28.155.195:45287)
I20260809 13:04:16.272339 14414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:16.265377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:54979 (local address 127.28.155.195:45287)
0809 13:04:16.265579 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:16.265588 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:16.266149 (+ 561us) server_negotiation.cc:407] Connection header received
0809 13:04:16.266316 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:16.266321 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:16.266423 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:16.266500 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:04:16.267245 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.268023 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.270487 (+ 2464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.271292 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.271499 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:16.271574 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 13:04:16.271915 (+ 341us) server_negotiation.cc:299] Negotiation successful
0809 13:04:16.272066 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 13:04:16.272375 14412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:16.265148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:59619 (local address 127.28.155.193:34693)
0809 13:04:16.265413 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:16.265423 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:16.266282 (+ 859us) server_negotiation.cc:407] Connection header received
0809 13:04:16.266439 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:16.266442 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:16.266544 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:16.266645 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:04:16.267312 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.268050 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.270451 (+ 2401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.271268 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.271459 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:16.271559 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 13:04:16.271969 (+ 410us) server_negotiation.cc:299] Negotiation successful
0809 13:04:16.272102 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 13:04:16.272657 14427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:16.265030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:45287 (local address 127.28.155.194:54979)
0809 13:04:16.266009 (+ 979us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:16.266025 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:16.266162 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:16.266549 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:16.266554 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:16.266581 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:04:16.267074 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:16.267088 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.268172 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.268177 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:16.270286 (+ 2109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:16.270300 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.271565 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.271572 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:16.271724 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:16.271767 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 13:04:16.271853 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 13:04:16.272017 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":866,"mutex_wait_us":198,"thread_start_us":608,"threads_started":1}
I20260809 13:04:16.272991 14428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:16.265060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:34693 (local address 127.28.155.194:59619)
0809 13:04:16.266131 (+ 1071us) negotiation.cc:107] Waiting for socket to connect
0809 13:04:16.266160 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 13:04:16.266305 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:04:16.266688 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:04:16.266692 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:04:16.266727 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:04:16.267118 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:16.267128 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.268224 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.268228 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:16.270270 (+ 2042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:04:16.270285 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.271528 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.271537 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:04:16.271728 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:16.271793 (+ 65us) client_negotiation.cc:769] Sending connection context
0809 13:04:16.271920 (+ 127us) client_negotiation.cc:240] Negotiation successful
0809 13:04:16.272053 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":934,"mutex_wait_us":52,"thread_start_us":686,"threads_started":1}
I20260809 13:04:16.274025 14323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "917d057737fa4f97884f75871eb5e4c4" candidate_uuid: "068fa242033d4440ae73c4383363d2a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225dacb46ae044bf90db7a8f4cf64a8c" is_pre_election: true
I20260809 13:04:16.274266 13953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "917d057737fa4f97884f75871eb5e4c4" candidate_uuid: "068fa242033d4440ae73c4383363d2a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e046740df37f4e7e90e872d8aba1672c" is_pre_election: true
I20260809 13:04:16.274689 14323 raft_consensus.cc:2454] T 917d057737fa4f97884f75871eb5e4c4 P 225dacb46ae044bf90db7a8f4cf64a8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068fa242033d4440ae73c4383363d2a3 in term 0.
I20260809 13:04:16.274894 13953 raft_consensus.cc:2454] T 917d057737fa4f97884f75871eb5e4c4 P e046740df37f4e7e90e872d8aba1672c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068fa242033d4440ae73c4383363d2a3 in term 0.
I20260809 13:04:16.275602 14047 leader_election.cc:302] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 068fa242033d4440ae73c4383363d2a3, 225dacb46ae044bf90db7a8f4cf64a8c, e046740df37f4e7e90e872d8aba1672c; no voters:
I20260809 13:04:16.276120 14426 raft_consensus.cc:2781] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:04:16.276293 14426 raft_consensus.cc:482] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:04:16.276438 14426 raft_consensus.cc:3037] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:04:16.278834 14426 raft_consensus.cc:504] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e046740df37f4e7e90e872d8aba1672c" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34693 } } peers { permanent_uuid: "068fa242033d4440ae73c4383363d2a3" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 38829 } } peers { permanent_uuid: "225dacb46ae044bf90db7a8f4cf64a8c" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 45287 } }
I20260809 13:04:16.279626 14426 leader_election.cc:288] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3 [CANDIDATE]: Term 1 election: Requested vote from peers e046740df37f4e7e90e872d8aba1672c (127.28.155.193:34693), 225dacb46ae044bf90db7a8f4cf64a8c (127.28.155.195:45287)
I20260809 13:04:16.280222 13953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "917d057737fa4f97884f75871eb5e4c4" candidate_uuid: "068fa242033d4440ae73c4383363d2a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e046740df37f4e7e90e872d8aba1672c"
I20260809 13:04:16.280298 14323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "917d057737fa4f97884f75871eb5e4c4" candidate_uuid: "068fa242033d4440ae73c4383363d2a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225dacb46ae044bf90db7a8f4cf64a8c"
I20260809 13:04:16.280529 13953 raft_consensus.cc:3037] T 917d057737fa4f97884f75871eb5e4c4 P e046740df37f4e7e90e872d8aba1672c [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:04:16.280592 14323 raft_consensus.cc:3037] T 917d057737fa4f97884f75871eb5e4c4 P 225dacb46ae044bf90db7a8f4cf64a8c [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:04:16.283066 13953 raft_consensus.cc:2454] T 917d057737fa4f97884f75871eb5e4c4 P e046740df37f4e7e90e872d8aba1672c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068fa242033d4440ae73c4383363d2a3 in term 1.
I20260809 13:04:16.283361 14323 raft_consensus.cc:2454] T 917d057737fa4f97884f75871eb5e4c4 P 225dacb46ae044bf90db7a8f4cf64a8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068fa242033d4440ae73c4383363d2a3 in term 1.
I20260809 13:04:16.283630 14050 leader_election.cc:302] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068fa242033d4440ae73c4383363d2a3, e046740df37f4e7e90e872d8aba1672c; no voters:
I20260809 13:04:16.284003 14426 raft_consensus.cc:2781] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:04:16.284458 14426 raft_consensus.cc:686] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3 [term 1 LEADER]: Becoming Leader. State: Replica: 068fa242033d4440ae73c4383363d2a3, State: Running, Role: LEADER
I20260809 13:04:16.285053 14426 consensus_queue.cc:237] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e046740df37f4e7e90e872d8aba1672c" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34693 } } peers { permanent_uuid: "068fa242033d4440ae73c4383363d2a3" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 38829 } } peers { permanent_uuid: "225dacb46ae044bf90db7a8f4cf64a8c" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 45287 } }
I20260809 13:04:16.290313 13723 catalog_manager.cc:5495] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 068fa242033d4440ae73c4383363d2a3 (127.28.155.194). New cstate: current_term: 1 leader_uuid: "068fa242033d4440ae73c4383363d2a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e046740df37f4e7e90e872d8aba1672c" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "068fa242033d4440ae73c4383363d2a3" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 38829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "225dacb46ae044bf90db7a8f4cf64a8c" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 45287 } health_report { overall_health: UNKNOWN } } }
W20260809 13:04:16.293035 14392 tablet.cc:2369] T 917d057737fa4f97884f75871eb5e4c4 P 225dacb46ae044bf90db7a8f4cf64a8c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:04:16.341120 14413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:16.335400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46008 (local address 127.28.155.194:38829)
0809 13:04:16.335665 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:16.335671 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:16.335693 (+ 22us) server_negotiation.cc:407] Connection header received
0809 13:04:16.335850 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:16.335855 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:16.335950 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:16.336120 (+ 170us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:04:16.336561 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.337278 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.338717 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.339136 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.339275 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:16.339869 (+ 594us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:04:16.340435 (+ 566us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:04:16.340653 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0809 13:04:16.340713 (+ 60us) server_negotiation.cc:299] Negotiation successful
0809 13:04:16.340803 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 13:04:16.350406 14323 raft_consensus.cc:1261] T 917d057737fa4f97884f75871eb5e4c4 P 225dacb46ae044bf90db7a8f4cf64a8c [term 1 FOLLOWER]: Refusing update from remote peer 068fa242033d4440ae73c4383363d2a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:04:16.350406 13953 raft_consensus.cc:1261] T 917d057737fa4f97884f75871eb5e4c4 P e046740df37f4e7e90e872d8aba1672c [term 1 FOLLOWER]: Refusing update from remote peer 068fa242033d4440ae73c4383363d2a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:04:16.351649 14429 consensus_queue.cc:1035] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e046740df37f4e7e90e872d8aba1672c" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:04:16.352130 14426 consensus_queue.cc:1035] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225dacb46ae044bf90db7a8f4cf64a8c" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:04:16.366652 14436 mvcc.cc:205] Tried to move back new op lower bound from 7316605568398946304 to 7316605568147533824. Current Snapshot: MvccSnapshot[applied={T|T < 7316605568398946304}]
I20260809 13:04:16.378656 13723 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49064:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:04:16.379032 13723 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49064:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:04:16.383641 13723 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4004d03388094df784dba7e7589d8f78: Sending DeleteTablet for 3 replicas of tablet 917d057737fa4f97884f75871eb5e4c4
I20260809 13:04:16.385524 14112 tablet_service.cc:1514] Processing DeleteTablet for tablet 917d057737fa4f97884f75871eb5e4c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:04:16 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:45996
I20260809 13:04:16.385757 13927 tablet_service.cc:1514] Processing DeleteTablet for tablet 917d057737fa4f97884f75871eb5e4c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:04:16 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:49086
I20260809 13:04:16.387349 14296 tablet_service.cc:1514] Processing DeleteTablet for tablet 917d057737fa4f97884f75871eb5e4c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:04:16 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:54448
I20260809 13:04:16.388447 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 13822
I20260809 13:04:16.393673 14447 tablet_replica.cc:330] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3: stopping tablet replica
I20260809 13:04:16.393836 14450 tablet_replica.cc:330] T 917d057737fa4f97884f75871eb5e4c4 P 225dacb46ae044bf90db7a8f4cf64a8c: stopping tablet replica
I20260809 13:04:16.394243 14447 raft_consensus.cc:2229] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3 [term 1 LEADER]: Raft consensus shutting down.
I20260809 13:04:16.394243 14450 raft_consensus.cc:2229] T 917d057737fa4f97884f75871eb5e4c4 P 225dacb46ae044bf90db7a8f4cf64a8c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:04:16.394847 14450 raft_consensus.cc:2258] T 917d057737fa4f97884f75871eb5e4c4 P 225dacb46ae044bf90db7a8f4cf64a8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:04:16.394980 14447 raft_consensus.cc:2258] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:04:16.397513 14447 ts_tablet_manager.cc:1905] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:04:16.397506 14450 ts_tablet_manager.cc:1905] T 917d057737fa4f97884f75871eb5e4c4 P 225dacb46ae044bf90db7a8f4cf64a8c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:04:16.405149 14450 ts_tablet_manager.cc:1918] T 917d057737fa4f97884f75871eb5e4c4 P 225dacb46ae044bf90db7a8f4cf64a8c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:04:16.405197 14447 ts_tablet_manager.cc:1918] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:04:16.405392 14447 log.cc:1196] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-1/wal/wals/917d057737fa4f97884f75871eb5e4c4
I20260809 13:04:16.405383 14450 log.cc:1196] T 917d057737fa4f97884f75871eb5e4c4 P 225dacb46ae044bf90db7a8f4cf64a8c: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-2/wal/wals/917d057737fa4f97884f75871eb5e4c4
I20260809 13:04:16.406014 14450 ts_tablet_manager.cc:1939] T 917d057737fa4f97884f75871eb5e4c4 P 225dacb46ae044bf90db7a8f4cf64a8c: Deleting consensus metadata
I20260809 13:04:16.406024 14447 ts_tablet_manager.cc:1939] T 917d057737fa4f97884f75871eb5e4c4 P 068fa242033d4440ae73c4383363d2a3: Deleting consensus metadata
I20260809 13:04:16.408200 13704 catalog_manager.cc:4841] TS 225dacb46ae044bf90db7a8f4cf64a8c (127.28.155.195:45287): tablet 917d057737fa4f97884f75871eb5e4c4 (table test-table [id=8af86f926dfa4f249d2b0861d25395f9]) successfully deleted
I20260809 13:04:16.408669 13706 catalog_manager.cc:4841] TS 068fa242033d4440ae73c4383363d2a3 (127.28.155.194:38829): tablet 917d057737fa4f97884f75871eb5e4c4 (table test-table [id=8af86f926dfa4f249d2b0861d25395f9]) successfully deleted
I20260809 13:04:16.413157 14449 tablet_replica.cc:330] T 917d057737fa4f97884f75871eb5e4c4 P e046740df37f4e7e90e872d8aba1672c: stopping tablet replica
I20260809 13:04:16.413751 14449 raft_consensus.cc:2229] T 917d057737fa4f97884f75871eb5e4c4 P e046740df37f4e7e90e872d8aba1672c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:04:16.414368 14449 raft_consensus.cc:2258] T 917d057737fa4f97884f75871eb5e4c4 P e046740df37f4e7e90e872d8aba1672c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:04:16.416843 14449 ts_tablet_manager.cc:1905] T 917d057737fa4f97884f75871eb5e4c4 P e046740df37f4e7e90e872d8aba1672c: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 09 13:04:16 dist-test-slave-jq4t krb5kdc[13654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280653, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.193@KRBTEST.COM
I20260809 13:04:16.424716 14449 ts_tablet_manager.cc:1918] T 917d057737fa4f97884f75871eb5e4c4 P e046740df37f4e7e90e872d8aba1672c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:04:16.424954 14449 log.cc:1196] T 917d057737fa4f97884f75871eb5e4c4 P e046740df37f4e7e90e872d8aba1672c: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786280548611909-29295-0/minicluster-data/ts-0/wal/wals/917d057737fa4f97884f75871eb5e4c4
I20260809 13:04:16.425642 14449 ts_tablet_manager.cc:1939] T 917d057737fa4f97884f75871eb5e4c4 P e046740df37f4e7e90e872d8aba1672c: Deleting consensus metadata
I20260809 13:04:16.427964 13708 catalog_manager.cc:4841] TS e046740df37f4e7e90e872d8aba1672c (127.28.155.193:34693): tablet 917d057737fa4f97884f75871eb5e4c4 (table test-table [id=8af86f926dfa4f249d2b0861d25395f9]) successfully deleted
I20260809 13:04:16.432025 14412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:16.389907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49090 (local address 127.28.155.193:34693)
0809 13:04:16.390149 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:16.390159 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:16.412713 (+ 22554us) server_negotiation.cc:407] Connection header received
0809 13:04:16.413004 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:16.413011 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:16.413113 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:16.413210 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:16.415187 (+ 1977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.416353 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.418228 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.418908 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.419004 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:16.424858 (+ 5854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:04:16.424877 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:04:16.424900 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:04:16.424958 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:04:16.429012 (+ 4054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:04:16.429946 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:04:16.429955 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:04:16.429957 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:04:16.430111 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:04:16.430541 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:04:16.430545 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:04:16.430547 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:04:16.430927 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:04:16.431179 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0809 13:04:16.431532 (+ 353us) server_negotiation.cc:299] Negotiation successful
0809 13:04:16.431702 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 13:04:16.432766 14009 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:04:16.529819 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 13822
I20260809 13:04:16.562521 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 14022
Aug 09 13:04:16 dist-test-slave-jq4t krb5kdc[13654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280653, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.194@KRBTEST.COM
I20260809 13:04:16.581660 14413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:16.563470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46012 (local address 127.28.155.194:38829)
0809 13:04:16.563661 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:16.563665 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:16.563685 (+ 20us) server_negotiation.cc:407] Connection header received
0809 13:04:16.563889 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:16.563894 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:16.563963 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:16.564063 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:16.565829 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.566701 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.568773 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.569358 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.569496 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:16.574850 (+ 5354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:04:16.574871 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:04:16.574889 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:04:16.574940 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:04:16.578416 (+ 3476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:04:16.579220 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:04:16.579229 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:04:16.579232 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:04:16.579395 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:04:16.579844 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:04:16.579848 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:04:16.579850 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:04:16.580261 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:04:16.580685 (+ 424us) server_negotiation.cc:1035] Waiting for connection context
0809 13:04:16.580991 (+ 306us) server_negotiation.cc:299] Negotiation successful
0809 13:04:16.581250 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 13:04:16.582470 14194 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:04:16.703938 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 14022
I20260809 13:04:16.732365 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 14212
Aug 09 13:04:16 dist-test-slave-jq4t krb5kdc[13654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280653, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.195@KRBTEST.COM
I20260809 13:04:16.748212 14414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:04:16.733236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54454 (local address 127.28.155.195:45287)
0809 13:04:16.733417 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 13:04:16.733421 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:04:16.733440 (+ 19us) server_negotiation.cc:407] Connection header received
0809 13:04:16.733536 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:04:16.733540 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:04:16.733603 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:04:16.733690 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:04:16.734998 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.735811 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.737278 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:04:16.737688 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:04:16.737802 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:04:16.742524 (+ 4722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:04:16.742543 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:04:16.742560 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:04:16.742604 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:04:16.745547 (+ 2943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:04:16.746256 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:04:16.746263 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:04:16.746265 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:04:16.746414 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:04:16.746745 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:04:16.746748 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:04:16.746750 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:04:16.747109 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:04:16.747356 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0809 13:04:16.747585 (+ 229us) server_negotiation.cc:299] Negotiation successful
0809 13:04:16.747814 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 13:04:16.748993 14384 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:04:16.841833 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 14212
I20260809 13:04:16.868301 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 13673
I20260809 13:04:16.869602 13774 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:04:16.987010 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 13673
2026-08-09T13:04:17Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4913 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:04:17 dist-test-slave-jq4t krb5kdc[14461](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:04:17 dist-test-slave-jq4t krb5kdc[14461](info): set up 2 sockets
Aug 09 13:04:17 dist-test-slave-jq4t krb5kdc[14461](info): commencing operation
krb5kdc: starting...
W20260809 13:04:18.343511 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.301s user 0.000s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:04:18 dist-test-slave-jq4t krb5kdc[14461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280658, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:04:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:04:18Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.28.155.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.28.155.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.28.155.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/rangeradmin_127.28.155.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.28.155.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/rangeradmin_127.28.155.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.28.155.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.28.155.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.28.155.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/rangerlookup_127.28.155.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.28.155.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/rangerlookup_127.28.155.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.28.155.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.28.155.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.28.155.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/HTTP_127.28.155.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.28.155.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/HTTP_127.28.155.212@KRBTEST.COM.keytab.
I20260809 13:04:18.779727 29295 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskqeHpK4/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/postgres -l logfile start
2026-08-09 13:04:21.472 UTC [14507] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 13:04:21.472 UTC [14507] LOG: listening on IPv4 address "127.28.155.212", port 49589
2026-08-09 13:04:21.476 UTC [14507] LOG: listening on Unix socket "/tmp/.s.PGSQL.49589"
2026-08-09 13:04:21.501 UTC [14509] LOG: database system was shut down at 2026-08-09 13:04:19 UTC
2026-08-09 13:04:21.505 UTC [14507] LOG: database system is ready to accept connections
I20260809 13:04:22.711112 29295 mini_postgres.cc:96] Postgres bound to 49589
2026-08-09 13:04:22.738 UTC [14524] FATAL: database "slave" does not exist
127.28.155.212:49589 - accepting connections
I20260809 13:04:22.739404 29295 mini_ranger.cc:161] Starting Ranger...
I20260809 13:04:22.777503 29295 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 13:04:23.289409 29295 mini_ranger.cc:87] Created ranger Postgres database
I20260809 13:04:23.289535 29295 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ranger-admin
2026-08-09 13:04:23,654 [I] DB FLAVOR :POSTGRES
2026-08-09 13:04:23,655 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 13:04:23,655 [I] Checking connection..
2026-08-09 13:04:23,655 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:49589/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 13:04:23,913 [I] Checking connection passed.
2026-08-09 13:04:23,913 [I] --------- Verifying version history table ---------
2026-08-09 13:04:23,913 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:49589/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 13:04:24,187 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 13:04:24,187 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:49589/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 13:04:24,445 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 13:04:24,445 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 13:04:24,446 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:49589/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 13:04:24.713 UTC [14628] WARNING: there is no transaction in progress
2026-08-09 13:04:24,723 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 13:04:24,724 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:49589/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 13:04:24,996 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 13:04:24,997 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 13:04:24,997 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:49589/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 13:04:25,255 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:49589/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 13:04:25,522 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:49589/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-jq4t.c.gcp-upstream.internal','N') ;"
2026-08-09 13:04:25,771 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:49589/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 13:04:26,031 [I] Table x_portal_user does not exist in database ranger
2026-08-09 13:04:26,031 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:49589/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 13:04:26,272 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 13:04:26,273 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:49589/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 13:04:26,543 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:49589/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 13:04:26,812 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 13:04:26,813 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:49589/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 13:04:27.832 UTC [14805] WARNING: there is no transaction in progress
2026-08-09 13:04:27.849 UTC [14805] WARNING: there is no transaction in progress
2026-08-09 13:04:27.867 UTC [14805] WARNING: there is no transaction in progress
2026-08-09 13:04:27.884 UTC [14805] WARNING: there is no transaction in progress
2026-08-09 13:04:27.900 UTC [14805] WARNING: there is no transaction in progress
2026-08-09 13:04:27.919 UTC [14805] WARNING: there is no transaction in progress
2026-08-09 13:04:27.978 UTC [14805] WARNING: there is no transaction in progress
2026-08-09 13:04:27.987 UTC [14805] WARNING: there is no transaction in progress
2026-08-09 13:04:28.003 UTC [14805] WARNING: there is no transaction in progress
2026-08-09 13:04:28.014 UTC [14805] WARNING: there is no transaction in progress
2026-08-09 13:04:28.025 UTC [14805] WARNING: there is no transaction in progress
2026-08-09 13:04:28.041 UTC [14805] WARNING: there is no transaction in progress
2026-08-09 13:04:28.051 UTC [14805] WARNING: there is no transaction in progress
2026-08-09 13:04:28.058 UTC [14805] WARNING: there is no transaction in progress
2026-08-09 13:04:28.065 UTC [14805] WARNING: there is no transaction in progress
2026-08-09 13:04:28.072 UTC [14805] WARNING: there is no transaction in progress
2026-08-09 13:04:28,760 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 13:04:28,761 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:49589/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 13:04:29,029 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 13:04:29,029 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:49589/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 13:04:29,282 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 13:04:29,283 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:49589/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 13:04:29,556 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 13:04:29,557 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:49589/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 13:04:29,820 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:49589/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 13:04:30,083 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:49589/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-jq4t.c.gcp-upstream.internal';"
2026-08-09 13:04:30,357 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 13:04:30,357 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:49589/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 13:04:30,619 [I] DB_PATCHES have already been applied
I20260809 13:04:30.626405 29295 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ranger-admin:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskqeHpK4/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 13:04:30.626511 29295 mini_ranger.cc:193] Using host: 127.28.155.212
I20260809 13:04:30.650295 29295 mini_ranger.cc:227] Ranger admin URL: http://127.28.155.212:41617
Aug 09, 2026 1:04:31 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 1:04:31 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 1:04:31 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 1:04:31 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 1:04:31 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 1:04:31 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 1:04:31 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 13:04:32.086027 29295 mini_ranger.cc:160] Time spent starting Ranger: real 9.347s user 0.003s sys 0.072s
Aug 09, 2026 1:04:52 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 1:04:52 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 09, 2026 1:04:52 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 1:04:52 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 1:04:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 1:04:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 1:04:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 1:04:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 1:04:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 1:04:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 1:04:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 1:04:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 1:04:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 1:04:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 1:04:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 1:04:52 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 1:04:52 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 1:04:53 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 13:04:54.109639 29295 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.28.155.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.28.155.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.28.155.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/rangerkms_127.28.155.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.28.155.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/rangerkms_127.28.155.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.28.155.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.28.155.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.28.155.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/HTTP_127.28.155.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.28.155.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/HTTP_127.28.155.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 13:04:54 dist-test-slave-jq4t krb5kdc[14461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280694, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 13:04:54.346488 29295 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 13:04:54.376364 29295 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 13:04:55.306661 29295 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 13:04:55.306864 29295 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ranger-kms
I20260809 13:04:55.307024 29295 mini_ranger_kms.cc:227] Using postgres at 127.28.155.212:49589
2026-08-09 13:04:55,912 [I] DB FLAVOR :POSTGRES
2026-08-09 13:04:55,912 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 13:04:55,912 [I] Checking connection
2026-08-09 13:04:55,913 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:49589/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 13:04:56,178 [I] connection success
2026-08-09 13:04:56,178 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 13:04:56,178 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 13:04:56,178 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:49589/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 13:04:56,421 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 13:04:56,421 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 13:04:56,421 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 13:04:56,422 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:49589/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 13:04:56,724 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 13:04:57.227262 29295 mini_ranger_kms.cc:310] Created kms service
I20260809 13:04:57.465428 29295 mini_ranger_kms.cc:326] Created kudu user
I20260809 13:04:57.518924 29295 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 13:04:57 dist-test-slave-jq4t krb5kdc[14461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280694, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.28.155.212@KRBTEST.COM
I20260809 13:04:57.972395 29295 mini_ranger_kms.cc:384] Added ranger policy
I20260809 13:04:57.972811 29295 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ranger-kms:/tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 13:04:57.972885 29295 mini_ranger_kms.cc:240] Using host: 127.28.155.212
I20260809 13:04:58.005005 29295 mini_ranger_kms.cc:276] Ranger KMS PID: 15093
I20260809 13:04:58.005263 29295 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.28.155.212:53923
Aug 09, 2026 1:04:59 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 1:04:59 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 1:04:59 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 1:04:59 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 1:05:00 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 1:05:00 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 13:05:01 dist-test-slave-jq4t krb5kdc[14461](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786280701, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.28.155.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:05:01.675863 29295 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 7.329s user 0.175s sys 0.496s
I20260809 13:05:01.676257 29295 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 13:05:01.676527 29295 mini_ranger_kms.cc:401] 127.28.155.212:53923/kms/v1/keys
Aug 09 13:05:01 dist-test-slave-jq4t krb5kdc[14461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280701, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.28.155.212@KRBTEST.COM for HTTP/127.28.155.212@KRBTEST.COM
Aug 09 13:05:02 dist-test-slave-jq4t krb5kdc[14461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280701, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.28.155.212@KRBTEST.COM for HTTP/127.28.155.212@KRBTEST.COM
Aug 09 13:05:04 dist-test-slave-jq4t krb5kdc[14461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
I20260809 13:05:04.756312 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:37569
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:38475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:37569
--ranger_config_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.155.212:53923/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:05:05.127709 15174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:05:05.128055 15174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:05:05.128227 15174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:05:05.135829 15174 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:05:05.135969 15174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:05:05.136080 15174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:05:05.136190 15174 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:05:05.136276 15174 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:05:05.148151 15174 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:38475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/master-0/wal
--ranger_kms_url=127.28.155.212:53923/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:37569
--ranger_config_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:37569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:05:05.149673 15174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:05:05.151124 15174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:05:05.165899 15188 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:05:05.166005 15185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:05:05.166471 15174 server_base.cc:1034] running on GCE node
W20260809 13:05:05.165961 15183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:05:05.167529 15174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:05:05.169261 15174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:05:05.170514 15174 hybrid_clock.cc:648] HybridClock initialized: now 1786280705170479 us; error 58 us; skew 500 ppm
I20260809 13:05:05.170914 15174 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:05:05 dist-test-slave-jq4t krb5kdc[14461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280705, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:05:05.174541 15174 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:05:05.176236 15174 webserver.cc:460] Webserver started at http://127.28.155.254:45849/ using document root <none> and password file <none>
I20260809 13:05:05.177050 15174 fs_manager.cc:359] Metadata directory not provided
I20260809 13:05:05.177211 15174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:05:05.177557 15174 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 13:05:05 dist-test-slave-jq4t krb5kdc[14461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280705, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for HTTP/127.28.155.212@KRBTEST.COM
I20260809 13:05:05.240675 15174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "bbd7e113323e49a39e63c9ad02ff9f72"
format_stamp: "Formatted at 2026-08-09 13:05:05 on dist-test-slave-jq4t"
server_key: "334402e3733cf89624149d01a48ae477"
server_key_iv: "84990a14fbf49f31dbe4fe68ac2d4e93"
server_key_version: "kuduclusterkey@0"
I20260809 13:05:05.241936 15174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "bbd7e113323e49a39e63c9ad02ff9f72"
format_stamp: "Formatted at 2026-08-09 13:05:05 on dist-test-slave-jq4t"
server_key: "334402e3733cf89624149d01a48ae477"
server_key_iv: "84990a14fbf49f31dbe4fe68ac2d4e93"
server_key_version: "kuduclusterkey@0"
I20260809 13:05:05.249724 15174 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260809 13:05:05.271606 15197 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:05:05.273587 15174 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260809 13:05:05.273828 15174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "bbd7e113323e49a39e63c9ad02ff9f72"
format_stamp: "Formatted at 2026-08-09 13:05:05 on dist-test-slave-jq4t"
server_key: "334402e3733cf89624149d01a48ae477"
server_key_iv: "84990a14fbf49f31dbe4fe68ac2d4e93"
server_key_version: "kuduclusterkey@0"
I20260809 13:05:05.274130 15174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:05:05.299784 15174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:05:05.305202 15174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:05:05.305650 15174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:05:05.327051 15174 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:37569
I20260809 13:05:05.327085 15272 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:37569 every 8 connection(s)
I20260809 13:05:05.328559 15174 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:05:05.332543 15275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:05:05.336356 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 15174
I20260809 13:05:05.336624 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:05:05.337502 29295 external_mini_cluster.cc:1428] Setting key 196e28c95916d2bc0e3eb72b8ea0ce5d
I20260809 13:05:05.346647 15275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbd7e113323e49a39e63c9ad02ff9f72: Bootstrap starting.
I20260809 13:05:05.350798 15275 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bbd7e113323e49a39e63c9ad02ff9f72: Neither blocks nor log segments found. Creating new log.
I20260809 13:05:05.352311 15275 log.cc:824] T 00000000000000000000000000000000 P bbd7e113323e49a39e63c9ad02ff9f72: Log is configured to *not* fsync() on all Append() calls
Aug 09 13:05:05 dist-test-slave-jq4t krb5kdc[14461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:05:05.356317 15275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbd7e113323e49a39e63c9ad02ff9f72: No bootstrap required, opened a new log
I20260809 13:05:05.363289 15284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:05:05.339793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55984 (local address 127.28.155.254:37569)
0809 13:05:05.340652 (+ 859us) server_negotiation.cc:206] Beginning negotiation
0809 13:05:05.340663 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 13:05:05.340707 (+ 44us) server_negotiation.cc:407] Connection header received
0809 13:05:05.342383 (+ 1676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:05:05.342406 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:05:05.342809 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:05:05.343153 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:05:05.344819 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:05.346180 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:05.347993 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:05.348773 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:05.348929 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:05:05.354196 (+ 5267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:05:05.354207 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:05:05.354230 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:05:05.354277 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:05:05.358382 (+ 4105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:05:05.359195 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:05:05.359205 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:05:05.359214 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:05:05.359426 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:05:05.359837 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:05:05.359848 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:05:05.359852 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:05:05.360655 (+ 803us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:05:05.360987 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0809 13:05:05.361374 (+ 387us) server_negotiation.cc:299] Negotiation successful
0809 13:05:05.361815 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":619,"thread_start_us":410,"threads_started":1}
I20260809 13:05:05.367413 15275 raft_consensus.cc:348] T 00000000000000000000000000000000 P bbd7e113323e49a39e63c9ad02ff9f72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbd7e113323e49a39e63c9ad02ff9f72" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 37569 } }
I20260809 13:05:05.367971 15275 raft_consensus.cc:374] T 00000000000000000000000000000000 P bbd7e113323e49a39e63c9ad02ff9f72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:05:05.368089 15275 raft_consensus.cc:729] T 00000000000000000000000000000000 P bbd7e113323e49a39e63c9ad02ff9f72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbd7e113323e49a39e63c9ad02ff9f72, State: Initialized, Role: FOLLOWER
I20260809 13:05:05.368794 15275 consensus_queue.cc:260] T 00000000000000000000000000000000 P bbd7e113323e49a39e63c9ad02ff9f72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbd7e113323e49a39e63c9ad02ff9f72" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 37569 } }
I20260809 13:05:05.369028 15275 raft_consensus.cc:388] T 00000000000000000000000000000000 P bbd7e113323e49a39e63c9ad02ff9f72 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:05:05.369134 15275 raft_consensus.cc:482] T 00000000000000000000000000000000 P bbd7e113323e49a39e63c9ad02ff9f72 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:05:05.369263 15275 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bbd7e113323e49a39e63c9ad02ff9f72 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:05:05.371940 15275 raft_consensus.cc:504] T 00000000000000000000000000000000 P bbd7e113323e49a39e63c9ad02ff9f72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbd7e113323e49a39e63c9ad02ff9f72" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 37569 } }
I20260809 13:05:05.372679 15275 leader_election.cc:302] T 00000000000000000000000000000000 P bbd7e113323e49a39e63c9ad02ff9f72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bbd7e113323e49a39e63c9ad02ff9f72; no voters:
I20260809 13:05:05.373577 15275 leader_election.cc:288] T 00000000000000000000000000000000 P bbd7e113323e49a39e63c9ad02ff9f72 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:05:05.373752 15288 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bbd7e113323e49a39e63c9ad02ff9f72 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:05:05.375880 15275 sys_catalog.cc:564] T 00000000000000000000000000000000 P bbd7e113323e49a39e63c9ad02ff9f72 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:05:05.377513 15288 raft_consensus.cc:686] T 00000000000000000000000000000000 P bbd7e113323e49a39e63c9ad02ff9f72 [term 1 LEADER]: Becoming Leader. State: Replica: bbd7e113323e49a39e63c9ad02ff9f72, State: Running, Role: LEADER
I20260809 13:05:05.378324 15288 consensus_queue.cc:237] T 00000000000000000000000000000000 P bbd7e113323e49a39e63c9ad02ff9f72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbd7e113323e49a39e63c9ad02ff9f72" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 37569 } }
I20260809 13:05:05.387866 15289 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbd7e113323e49a39e63c9ad02ff9f72 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bbd7e113323e49a39e63c9ad02ff9f72" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbd7e113323e49a39e63c9ad02ff9f72" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 37569 } } }
I20260809 13:05:05.388362 15289 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbd7e113323e49a39e63c9ad02ff9f72 [sys.catalog]: This master's current role is: LEADER
I20260809 13:05:05.389065 15290 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbd7e113323e49a39e63c9ad02ff9f72 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bbd7e113323e49a39e63c9ad02ff9f72. Latest consensus state: current_term: 1 leader_uuid: "bbd7e113323e49a39e63c9ad02ff9f72" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbd7e113323e49a39e63c9ad02ff9f72" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 37569 } } }
I20260809 13:05:05.389511 15290 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbd7e113323e49a39e63c9ad02ff9f72 [sys.catalog]: This master's current role is: LEADER
I20260809 13:05:05.390151 15275 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 13:05:05.393378 15313 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:05:05.410377 15313 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:05:05.424988 15313 catalog_manager.cc:1347] Generated new cluster ID: 1ffcb7b8701f4f18bfab1291a65c55f0
I20260809 13:05:05.425138 15313 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:05:05.436966 15313 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:05:05.439180 15313 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:05:05.449903 15313 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bbd7e113323e49a39e63c9ad02ff9f72: Generated new TSK 0
I20260809 13:05:05.451229 15313 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
I20260809 13:05:06.200163 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.155.212:53923/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:0
--local_ip_for_outbound_sockets=127.28.155.193
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:37569
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:38475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 13:05:06 dist-test-slave-jq4t krb5kdc[14461](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786280706, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 13:05:06.637240 15350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:05:06.637624 15350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:05:06.637802 15350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:05:06.645958 15350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:05:06.646198 15350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:05:06.646431 15350 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:05:06.657258 15350 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:38475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.28.155.212:53923/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:37569
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:05:06.658766 15350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:05:06.660362 15350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:05:06.685849 15367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:05:06.686479 15364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:05:06.686161 15363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:05:06.686259 15350 server_base.cc:1034] running on GCE node
I20260809 13:05:06.687494 15350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:05:06.688630 15350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:05:06.689921 15350 hybrid_clock.cc:648] HybridClock initialized: now 1786280706689841 us; error 66 us; skew 500 ppm
I20260809 13:05:06.690387 15350 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:05:06 dist-test-slave-jq4t krb5kdc[14461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280706, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:05:06.694890 15350 init.cc:377] Logged in from keytab as kudu/127.28.155.193@KRBTEST.COM (short username kudu)
I20260809 13:05:06.697266 15350 webserver.cc:460] Webserver started at http://127.28.155.193:45229/ using document root <none> and password file <none>
I20260809 13:05:06.698068 15350 fs_manager.cc:359] Metadata directory not provided
I20260809 13:05:06.698251 15350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:05:06.698669 15350 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 13:05:06 dist-test-slave-jq4t krb5kdc[14461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280706, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for HTTP/127.28.155.212@KRBTEST.COM
I20260809 13:05:06.719262 15350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-0/data/instance:
uuid: "7157922db3e14f30b581564d0280289e"
format_stamp: "Formatted at 2026-08-09 13:05:06 on dist-test-slave-jq4t"
server_key: "c6c30250225f352631719241f0407c46"
server_key_iv: "621126d8d009047bc3868f84d08e71a6"
server_key_version: "kuduclusterkey@0"
I20260809 13:05:06.720467 15350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance:
uuid: "7157922db3e14f30b581564d0280289e"
format_stamp: "Formatted at 2026-08-09 13:05:06 on dist-test-slave-jq4t"
server_key: "c6c30250225f352631719241f0407c46"
server_key_iv: "621126d8d009047bc3868f84d08e71a6"
server_key_version: "kuduclusterkey@0"
I20260809 13:05:06.735896 15350 fs_manager.cc:691] Time spent creating directory manager: real 0.015s user 0.005s sys 0.007s
I20260809 13:05:06.766595 15375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:05:06.769954 15350 fs_manager.cc:725] Time spent opening block manager: real 0.014s user 0.005s sys 0.004s
I20260809 13:05:06.770298 15350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "7157922db3e14f30b581564d0280289e"
format_stamp: "Formatted at 2026-08-09 13:05:06 on dist-test-slave-jq4t"
server_key: "c6c30250225f352631719241f0407c46"
server_key_iv: "621126d8d009047bc3868f84d08e71a6"
server_key_version: "kuduclusterkey@0"
I20260809 13:05:06.770694 15350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:05:06.821472 15350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:05:06.827318 15350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:05:06.827807 15350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:05:06.830431 15350 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:05:06.832413 15350 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:05:06.832531 15350 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260809 13:05:06.832671 15350 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:05:06.832736 15350 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:05:06.913201 15350 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:34801
I20260809 13:05:06.913229 15538 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:34801 every 8 connection(s)
I20260809 13:05:06.914758 15350 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:05:06.921233 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 15350
I20260809 13:05:06.921463 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance
I20260809 13:05:06.922343 29295 external_mini_cluster.cc:1428] Setting key ece9287a08751f0c1b5bb86bda6a566c
Aug 09 13:05:06 dist-test-slave-jq4t krb5kdc[14461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280706, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.28.155.194@KRBTEST.COM; defaulting to no policy
I20260809 13:05:06.977437 15545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:05:06.920050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:43703 (local address 127.28.155.254:37569)
0809 13:05:06.945012 (+ 24962us) server_negotiation.cc:206] Beginning negotiation
0809 13:05:06.945024 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 13:05:06.945063 (+ 39us) server_negotiation.cc:407] Connection header received
0809 13:05:06.954874 (+ 9811us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:05:06.954883 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:05:06.955018 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:05:06.955117 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:05:06.957972 (+ 2855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:06.959261 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:06.962102 (+ 2841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:06.962879 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:06.963026 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:05:06.968249 (+ 5223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:05:06.968259 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:05:06.968268 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:05:06.968320 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:05:06.972804 (+ 4484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:05:06.973960 (+ 1156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:05:06.973965 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:05:06.973967 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:05:06.974106 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:05:06.974798 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:05:06.974803 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:05:06.974805 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:05:06.975094 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:05:06.975258 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 13:05:06.976432 (+ 1174us) server_negotiation.cc:299] Negotiation successful
0809 13:05:06.976851 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24752,"thread_start_us":25880,"threads_started":1}
I20260809 13:05:06.979874 15544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:05:06.919128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37569 (local address 127.28.155.193:43703)
0809 13:05:06.941080 (+ 21952us) negotiation.cc:107] Waiting for socket to connect
0809 13:05:06.941184 (+ 104us) client_negotiation.cc:174] Beginning negotiation
0809 13:05:06.954427 (+ 13243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:05:06.955846 (+ 1419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:05:06.955860 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:05:06.956738 (+ 878us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:05:06.957710 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:05:06.957742 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:05:06.959495 (+ 1753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:05:06.959502 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:05:06.961911 (+ 2409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:05:06.961931 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:05:06.963480 (+ 1549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:05:06.963490 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:05:06.963834 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:05:06.964806 (+ 972us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:05:06.964849 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:05:06.967902 (+ 3053us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:05:06.973040 (+ 5138us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:05:06.973050 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:05:06.973071 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:05:06.973770 (+ 699us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:05:06.974241 (+ 471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:05:06.974246 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:05:06.974250 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:05:06.974661 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:05:06.975243 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:05:06.975252 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:05:06.975666 (+ 414us) client_negotiation.cc:769] Sending connection context
0809 13:05:06.977979 (+ 2313us) client_negotiation.cc:240] Negotiation successful
0809 13:05:06.978508 (+ 529us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21417,"thread_start_us":25814,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.194@KRBTEST.COM" created.
I20260809 13:05:06.986747 15539 heartbeater.cc:347] Connected to a master server at 127.28.155.254:37569
I20260809 13:05:06.987145 15539 heartbeater.cc:464] Registering TS with master...
I20260809 13:05:06.988102 15539 heartbeater.cc:511] Master 127.28.155.254:37569 requested a full tablet report, sending...
I20260809 13:05:06.991063 15221 ts_manager.cc:194] Registered new tserver with Master: 7157922db3e14f30b581564d0280289e (127.28.155.193:34801)
I20260809 13:05:06.993301 15221 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.193@KRBTEST.COM'} at 127.28.155.193:43703
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
W20260809 13:05:07.027313 29295 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.28.155.194: real 0.101s user 0.001s sys 0.027s
I20260809 13:05:07.028333 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.155.212:53923/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:0
--local_ip_for_outbound_sockets=127.28.155.194
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:37569
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:38475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 13:05:07 dist-test-slave-jq4t krb5kdc[14461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280706, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for HTTP/127.28.155.212@KRBTEST.COM
Aug 09 13:05:07 dist-test-slave-jq4t krb5kdc[14461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280706, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for HTTP/127.28.155.212@KRBTEST.COM
W20260809 13:05:07.540251 15550 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:05:07.540877 15550 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:05:07.541114 15550 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:05:07.553201 15550 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:05:07.553390 15550 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:05:07.553613 15550 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:05:07.569875 15550 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:38475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.28.155.212:53923/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:37569
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:05:07.572077 15550 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:05:07.574054 15550 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:05:07.619961 15559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:05:07.620333 15560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:05:07.627405 15550 server_base.cc:1034] running on GCE node
W20260809 13:05:07.628175 15562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:05:07.629354 15550 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:05:07.640841 15550 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:05:07.644516 15550 hybrid_clock.cc:648] HybridClock initialized: now 1786280707644356 us; error 135 us; skew 500 ppm
I20260809 13:05:07.645100 15550 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:05:07 dist-test-slave-jq4t krb5kdc[14461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280707, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:05:07.654034 15550 init.cc:377] Logged in from keytab as kudu/127.28.155.194@KRBTEST.COM (short username kudu)
I20260809 13:05:07.656315 15550 webserver.cc:460] Webserver started at http://127.28.155.194:45363/ using document root <none> and password file <none>
I20260809 13:05:07.657349 15550 fs_manager.cc:359] Metadata directory not provided
I20260809 13:05:07.657522 15550 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:05:07.657963 15550 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 13:05:07 dist-test-slave-jq4t krb5kdc[14461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280707, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for HTTP/127.28.155.212@KRBTEST.COM
I20260809 13:05:07.696928 15550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-1/data/instance:
uuid: "5c9fb5c1c89f4073b56eb2f4433d626a"
format_stamp: "Formatted at 2026-08-09 13:05:07 on dist-test-slave-jq4t"
server_key: "9aa418698d1e859ff766adeac2cdc74b"
server_key_iv: "ce62cfe60f4d7d1b593de02843c4a14a"
server_key_version: "kuduclusterkey@0"
I20260809 13:05:07.698220 15550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance:
uuid: "5c9fb5c1c89f4073b56eb2f4433d626a"
format_stamp: "Formatted at 2026-08-09 13:05:07 on dist-test-slave-jq4t"
server_key: "9aa418698d1e859ff766adeac2cdc74b"
server_key_iv: "ce62cfe60f4d7d1b593de02843c4a14a"
server_key_version: "kuduclusterkey@0"
I20260809 13:05:07.711184 15550 fs_manager.cc:691] Time spent creating directory manager: real 0.012s user 0.008s sys 0.003s
I20260809 13:05:07.732852 15580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:05:07.734884 15550 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260809 13:05:07.735114 15550 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "5c9fb5c1c89f4073b56eb2f4433d626a"
format_stamp: "Formatted at 2026-08-09 13:05:07 on dist-test-slave-jq4t"
server_key: "9aa418698d1e859ff766adeac2cdc74b"
server_key_iv: "ce62cfe60f4d7d1b593de02843c4a14a"
server_key_version: "kuduclusterkey@0"
I20260809 13:05:07.735443 15550 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:05:07.757879 15550 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:05:07.764148 15550 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:05:07.764575 15550 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:05:07.765930 15550 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:05:07.767946 15550 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:05:07.768050 15550 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:05:07.768237 15550 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:05:07.768312 15550 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:05:07.810009 15550 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:33649
I20260809 13:05:07.810053 15743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:33649 every 8 connection(s)
I20260809 13:05:07.811800 15550 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:05:07.813349 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 15550
I20260809 13:05:07.813562 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance
I20260809 13:05:07.814174 29295 external_mini_cluster.cc:1428] Setting key b08e3243a734afb5dd4c87c0e8e7ed61
Aug 09 13:05:07 dist-test-slave-jq4t krb5kdc[14461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280707, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:05:07.869577 15749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:05:07.827484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:36765 (local address 127.28.155.254:37569)
0809 13:05:07.848420 (+ 20936us) server_negotiation.cc:206] Beginning negotiation
0809 13:05:07.848426 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:05:07.848450 (+ 24us) server_negotiation.cc:407] Connection header received
0809 13:05:07.848552 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:05:07.848558 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:05:07.848663 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:05:07.848780 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:05:07.851115 (+ 2335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:07.852425 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:07.855147 (+ 2722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:07.855815 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:07.855953 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:05:07.861071 (+ 5118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:05:07.861079 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:05:07.861084 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:05:07.861131 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:05:07.865050 (+ 3919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:05:07.866122 (+ 1072us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:05:07.866128 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:05:07.866131 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:05:07.866390 (+ 259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:05:07.867132 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:05:07.867138 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:05:07.867141 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:05:07.867542 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:05:07.867691 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 13:05:07.868740 (+ 1049us) server_negotiation.cc:299] Negotiation successful
0809 13:05:07.869024 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20789,"thread_start_us":20650,"threads_started":1}
I20260809 13:05:07.870908 15750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:05:07.828153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37569 (local address 127.28.155.194:36765)
0809 13:05:07.842931 (+ 14778us) negotiation.cc:107] Waiting for socket to connect
0809 13:05:07.843009 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0809 13:05:07.847559 (+ 4550us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:05:07.849268 (+ 1709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:05:07.849282 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:05:07.849959 (+ 677us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:05:07.850877 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:05:07.850906 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:05:07.852665 (+ 1759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:05:07.852671 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:05:07.854949 (+ 2278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:05:07.854966 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:05:07.856290 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:05:07.856298 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:05:07.856670 (+ 372us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:05:07.857618 (+ 948us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:05:07.857659 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:05:07.860726 (+ 3067us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:05:07.865276 (+ 4550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:05:07.865286 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:05:07.865307 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:05:07.865960 (+ 653us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:05:07.866547 (+ 587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:05:07.866552 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:05:07.866556 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:05:07.866969 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:05:07.867725 (+ 756us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:05:07.867734 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:05:07.868226 (+ 492us) client_negotiation.cc:769] Sending connection context
0809 13:05:07.868614 (+ 388us) client_negotiation.cc:240] Negotiation successful
0809 13:05:07.869205 (+ 591us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14367,"thread_start_us":16220,"threads_started":1}
I20260809 13:05:07.872818 15744 heartbeater.cc:347] Connected to a master server at 127.28.155.254:37569
WARNING: no policy specified for kudu/127.28.155.195@KRBTEST.COM; defaulting to no policy
I20260809 13:05:07.873194 15744 heartbeater.cc:464] Registering TS with master...
I20260809 13:05:07.874138 15744 heartbeater.cc:511] Master 127.28.155.254:37569 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.195@KRBTEST.COM" created.
I20260809 13:05:07.875895 15221 ts_manager.cc:194] Registered new tserver with Master: 5c9fb5c1c89f4073b56eb2f4433d626a (127.28.155.194:33649)
I20260809 13:05:07.877214 15221 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.194@KRBTEST.COM'} at 127.28.155.194:36765
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
I20260809 13:05:07.913033 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.155.212:53923/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:0
--local_ip_for_outbound_sockets=127.28.155.195
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:37569
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:38475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 13:05:07.998041 15539 heartbeater.cc:503] Master 127.28.155.254:37569 was elected leader, sending a full tablet report...
W20260809 13:05:08.287812 15754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:05:08.288131 15754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:05:08.288287 15754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:05:08.295830 15754 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:05:08.295961 15754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:05:08.296132 15754 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:05:08.306331 15754 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:38475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.28.155.212:53923/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:37569
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:05:08.307760 15754 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:05:08.309201 15754 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:05:08.322597 15767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:05:08.322552 15762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:05:08.322611 15763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:05:08.323935 15754 server_base.cc:1034] running on GCE node
I20260809 13:05:08.324647 15754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:05:08.325673 15754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:05:08.326894 15754 hybrid_clock.cc:648] HybridClock initialized: now 1786280708326851 us; error 57 us; skew 500 ppm
I20260809 13:05:08.327219 15754 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:05:08 dist-test-slave-jq4t krb5kdc[14461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280708, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:05:08.330518 15754 init.cc:377] Logged in from keytab as kudu/127.28.155.195@KRBTEST.COM (short username kudu)
I20260809 13:05:08.332139 15754 webserver.cc:460] Webserver started at http://127.28.155.195:39837/ using document root <none> and password file <none>
I20260809 13:05:08.332927 15754 fs_manager.cc:359] Metadata directory not provided
I20260809 13:05:08.333061 15754 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:05:08.333392 15754 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 13:05:08 dist-test-slave-jq4t krb5kdc[14461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280708, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for HTTP/127.28.155.212@KRBTEST.COM
I20260809 13:05:08.350343 15754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-2/data/instance:
uuid: "1b548aa7641c42c1b74b1d93a9acca07"
format_stamp: "Formatted at 2026-08-09 13:05:08 on dist-test-slave-jq4t"
server_key: "7a7fcb721b3cd7f0ab8868dcc83c9e15"
server_key_iv: "0f1b7914d6df062f0848179729e525c1"
server_key_version: "kuduclusterkey@0"
I20260809 13:05:08.351749 15754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance:
uuid: "1b548aa7641c42c1b74b1d93a9acca07"
format_stamp: "Formatted at 2026-08-09 13:05:08 on dist-test-slave-jq4t"
server_key: "7a7fcb721b3cd7f0ab8868dcc83c9e15"
server_key_iv: "0f1b7914d6df062f0848179729e525c1"
server_key_version: "kuduclusterkey@0"
I20260809 13:05:08.359189 15754 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260809 13:05:08.375751 15780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:05:08.377907 15754 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 13:05:08.378116 15754 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "1b548aa7641c42c1b74b1d93a9acca07"
format_stamp: "Formatted at 2026-08-09 13:05:08 on dist-test-slave-jq4t"
server_key: "7a7fcb721b3cd7f0ab8868dcc83c9e15"
server_key_iv: "0f1b7914d6df062f0848179729e525c1"
server_key_version: "kuduclusterkey@0"
I20260809 13:05:08.378404 15754 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:05:08.407649 15754 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:05:08.413312 15754 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:05:08.413676 15754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:05:08.414798 15754 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:05:08.416292 15754 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:05:08.416376 15754 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:05:08.416584 15754 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:05:08.416640 15754 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:05:08.450941 15754 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:39663
I20260809 13:05:08.450968 15961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:39663 every 8 connection(s)
I20260809 13:05:08.452528 15754 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:05:08.460807 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 15754
I20260809 13:05:08.461052 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance
I20260809 13:05:08.461508 29295 external_mini_cluster.cc:1428] Setting key 5055e1583116fdda81a242f6e216b43f
Aug 09 13:05:08 dist-test-slave-jq4t krb5kdc[14461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280708, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:05:08.473594 15970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:05:08.455447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:44739 (local address 127.28.155.254:37569)
0809 13:05:08.455890 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0809 13:05:08.455894 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:05:08.457008 (+ 1114us) server_negotiation.cc:407] Connection header received
0809 13:05:08.458928 (+ 1920us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:05:08.458933 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:05:08.459048 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:05:08.459202 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:05:08.460821 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.461745 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.463745 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.464280 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.464422 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:05:08.467910 (+ 3488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:05:08.467915 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:05:08.467919 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:05:08.467957 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:05:08.470663 (+ 2706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:05:08.471430 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:05:08.471435 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:05:08.471437 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:05:08.471571 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:05:08.472025 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:05:08.472028 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:05:08.472030 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:05:08.472318 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:05:08.472431 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 13:05:08.473154 (+ 723us) server_negotiation.cc:299] Negotiation successful
0809 13:05:08.473333 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":215,"threads_started":1}
I20260809 13:05:08.474613 15972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:05:08.456035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37569 (local address 127.28.155.195:44739)
0809 13:05:08.456834 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0809 13:05:08.456882 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 13:05:08.458630 (+ 1748us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:05:08.459462 (+ 832us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:05:08.459471 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:05:08.459947 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:05:08.460635 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:05:08.460656 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.461926 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.461931 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:05:08.463583 (+ 1652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:05:08.463598 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.464568 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.464578 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:05:08.464871 (+ 293us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:05:08.465570 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:05:08.465592 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:05:08.467693 (+ 2101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:05:08.470836 (+ 3143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:05:08.470843 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:05:08.470862 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:05:08.471305 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:05:08.471713 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:05:08.471717 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:05:08.471720 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:05:08.471923 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:05:08.472425 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:05:08.472431 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:05:08.472803 (+ 372us) client_negotiation.cc:769] Sending connection context
0809 13:05:08.473040 (+ 237us) client_negotiation.cc:240] Negotiation successful
0809 13:05:08.473445 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":301,"threads_started":1}
I20260809 13:05:08.476152 15964 heartbeater.cc:347] Connected to a master server at 127.28.155.254:37569
I20260809 13:05:08.476585 15964 heartbeater.cc:464] Registering TS with master...
I20260809 13:05:08.477358 15964 heartbeater.cc:511] Master 127.28.155.254:37569 requested a full tablet report, sending...
I20260809 13:05:08.478899 15221 ts_manager.cc:194] Registered new tserver with Master: 1b548aa7641c42c1b74b1d93a9acca07 (127.28.155.195:39663)
I20260809 13:05:08.479866 15221 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.195@KRBTEST.COM'} at 127.28.155.195:44739
I20260809 13:05:08.489679 29295 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 13:05:08.508028 15970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:05:08.494469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55992 (local address 127.28.155.254:37569)
0809 13:05:08.494683 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 13:05:08.494692 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:05:08.495174 (+ 482us) server_negotiation.cc:407] Connection header received
0809 13:05:08.495311 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:05:08.495315 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:05:08.495394 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:05:08.495477 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:05:08.496964 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.497706 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.499124 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.499550 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.499644 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:05:08.502209 (+ 2565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:05:08.502213 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:05:08.502217 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:05:08.502251 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:05:08.505076 (+ 2825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:05:08.505923 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:05:08.505930 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:05:08.505938 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:05:08.506085 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:05:08.506494 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:05:08.506502 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:05:08.506506 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:05:08.506813 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:05:08.507088 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0809 13:05:08.507420 (+ 332us) server_negotiation.cc:299] Negotiation successful
0809 13:05:08.507680 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 13:05:08.512537 15221 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55992:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 13:05:08.519901 15221 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:05:08.545423 15994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:05:08.534238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51330 (local address 127.28.155.194:33649)
0809 13:05:08.535488 (+ 1250us) server_negotiation.cc:206] Beginning negotiation
0809 13:05:08.535500 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 13:05:08.536233 (+ 733us) server_negotiation.cc:407] Connection header received
0809 13:05:08.536434 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:05:08.536440 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:05:08.536720 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:05:08.536909 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:05:08.538242 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.539786 (+ 1544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.542980 (+ 3194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.544122 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.544259 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:05:08.544426 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 13:05:08.544856 (+ 430us) server_negotiation.cc:299] Negotiation successful
0809 13:05:08.545050 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1043,"thread_start_us":903,"threads_started":1}
I20260809 13:05:08.546205 15988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:05:08.533676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:33649 (local address 127.0.0.1:51330)
0809 13:05:08.536131 (+ 2455us) negotiation.cc:107] Waiting for socket to connect
0809 13:05:08.536149 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 13:05:08.536264 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:05:08.537169 (+ 905us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:05:08.537173 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:05:08.537215 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:05:08.538020 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:05:08.538040 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.539925 (+ 1885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.539930 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:05:08.542802 (+ 2872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:05:08.542824 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.544338 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.544345 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:05:08.544577 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:05:08.544634 (+ 57us) client_negotiation.cc:769] Sending connection context
0809 13:05:08.545673 (+ 1039us) client_negotiation.cc:240] Negotiation successful
0809 13:05:08.545788 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2307,"mutex_wait_us":67,"spinlock_wait_cycles":1408,"thread_start_us":1635,"threads_started":1}
I20260809 13:05:08.547020 15995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:05:08.536604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42932 (local address 127.28.155.195:39663)
0809 13:05:08.538617 (+ 2013us) server_negotiation.cc:206] Beginning negotiation
0809 13:05:08.538628 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 13:05:08.538663 (+ 35us) server_negotiation.cc:407] Connection header received
0809 13:05:08.538752 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:05:08.538760 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:05:08.538984 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:05:08.539172 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:05:08.539776 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.541331 (+ 1555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.543491 (+ 2160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.544628 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.544832 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:05:08.545006 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0809 13:05:08.546308 (+ 1302us) server_negotiation.cc:299] Negotiation successful
0809 13:05:08.546772 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1831,"thread_start_us":1644,"threads_started":1}
I20260809 13:05:08.547237 15993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:05:08.533038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:34801 (local address 127.0.0.1:37402)
0809 13:05:08.535621 (+ 2583us) negotiation.cc:107] Waiting for socket to connect
0809 13:05:08.535660 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 13:05:08.535974 (+ 314us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:05:08.537148 (+ 1174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:05:08.537157 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:05:08.537208 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:05:08.538505 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:05:08.538515 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.540459 (+ 1944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.540467 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:05:08.542825 (+ 2358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:05:08.542835 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.546263 (+ 3428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.546269 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:05:08.546576 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:05:08.546622 (+ 46us) client_negotiation.cc:769] Sending connection context
0809 13:05:08.546721 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 13:05:08.546867 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2337,"mutex_wait_us":44,"spinlock_wait_cycles":2304,"thread_start_us":2677,"threads_started":1}
I20260809 13:05:08.546203 15996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:05:08.537077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:39663 (local address 127.0.0.1:42932)
0809 13:05:08.537884 (+ 807us) negotiation.cc:107] Waiting for socket to connect
0809 13:05:08.537917 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 13:05:08.538034 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:05:08.539191 (+ 1157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:05:08.539196 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:05:08.539224 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:05:08.539584 (+ 360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:05:08.539595 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.541473 (+ 1878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.541479 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:05:08.543334 (+ 1855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:05:08.543349 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.545165 (+ 1816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.545174 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:05:08.545341 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:05:08.545374 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 13:05:08.545473 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 13:05:08.545696 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":698,"mutex_wait_us":27,"thread_start_us":523,"threads_started":1}
I20260809 13:05:08.549147 15992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:05:08.533483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37402 (local address 127.28.155.193:34801)
0809 13:05:08.534998 (+ 1515us) server_negotiation.cc:206] Beginning negotiation
0809 13:05:08.535010 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 13:05:08.535810 (+ 800us) server_negotiation.cc:407] Connection header received
0809 13:05:08.536268 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:05:08.536277 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:05:08.536574 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:05:08.536802 (+ 228us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:05:08.538684 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.540280 (+ 1596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.544535 (+ 4255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.546033 (+ 1498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.546263 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:05:08.546442 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0809 13:05:08.548612 (+ 2170us) server_negotiation.cc:299] Negotiation successful
0809 13:05:08.548787 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1295,"thread_start_us":1097,"threads_started":1}
I20260809 13:05:08.550499 15652 tablet_service.cc:1467] Processing CreateTablet for tablet 146c423e941d4818b2340764b3b4a93a (DEFAULT_TABLE table=test-table [id=6e28af24bf4a420b8f8024bfb25efdf7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:05:08.550518 15861 tablet_service.cc:1467] Processing CreateTablet for tablet 146c423e941d4818b2340764b3b4a93a (DEFAULT_TABLE table=test-table [id=6e28af24bf4a420b8f8024bfb25efdf7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:05:08.552165 15861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 146c423e941d4818b2340764b3b4a93a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:05:08.552436 15652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 146c423e941d4818b2340764b3b4a93a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:05:08.552822 15444 tablet_service.cc:1467] Processing CreateTablet for tablet 146c423e941d4818b2340764b3b4a93a (DEFAULT_TABLE table=test-table [id=6e28af24bf4a420b8f8024bfb25efdf7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:05:08.554268 15444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 146c423e941d4818b2340764b3b4a93a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:05:08.564018 15998 tablet_bootstrap.cc:492] T 146c423e941d4818b2340764b3b4a93a P 5c9fb5c1c89f4073b56eb2f4433d626a: Bootstrap starting.
I20260809 13:05:08.567217 15999 tablet_bootstrap.cc:492] T 146c423e941d4818b2340764b3b4a93a P 1b548aa7641c42c1b74b1d93a9acca07: Bootstrap starting.
I20260809 13:05:08.569015 15998 tablet_bootstrap.cc:654] T 146c423e941d4818b2340764b3b4a93a P 5c9fb5c1c89f4073b56eb2f4433d626a: Neither blocks nor log segments found. Creating new log.
I20260809 13:05:08.569643 16000 tablet_bootstrap.cc:492] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e: Bootstrap starting.
I20260809 13:05:08.570562 15998 log.cc:824] T 146c423e941d4818b2340764b3b4a93a P 5c9fb5c1c89f4073b56eb2f4433d626a: Log is configured to *not* fsync() on all Append() calls
I20260809 13:05:08.571125 15999 tablet_bootstrap.cc:654] T 146c423e941d4818b2340764b3b4a93a P 1b548aa7641c42c1b74b1d93a9acca07: Neither blocks nor log segments found. Creating new log.
I20260809 13:05:08.572381 15999 log.cc:824] T 146c423e941d4818b2340764b3b4a93a P 1b548aa7641c42c1b74b1d93a9acca07: Log is configured to *not* fsync() on all Append() calls
I20260809 13:05:08.573508 16000 tablet_bootstrap.cc:654] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e: Neither blocks nor log segments found. Creating new log.
I20260809 13:05:08.574496 15998 tablet_bootstrap.cc:492] T 146c423e941d4818b2340764b3b4a93a P 5c9fb5c1c89f4073b56eb2f4433d626a: No bootstrap required, opened a new log
I20260809 13:05:08.574885 15998 ts_tablet_manager.cc:1397] T 146c423e941d4818b2340764b3b4a93a P 5c9fb5c1c89f4073b56eb2f4433d626a: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260809 13:05:08.574856 16000 log.cc:824] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e: Log is configured to *not* fsync() on all Append() calls
I20260809 13:05:08.578166 15999 tablet_bootstrap.cc:492] T 146c423e941d4818b2340764b3b4a93a P 1b548aa7641c42c1b74b1d93a9acca07: No bootstrap required, opened a new log
I20260809 13:05:08.578310 16000 tablet_bootstrap.cc:492] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e: No bootstrap required, opened a new log
I20260809 13:05:08.578514 15999 ts_tablet_manager.cc:1397] T 146c423e941d4818b2340764b3b4a93a P 1b548aa7641c42c1b74b1d93a9acca07: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.005s
I20260809 13:05:08.578586 16000 ts_tablet_manager.cc:1397] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260809 13:05:08.586333 15998 raft_consensus.cc:348] T 146c423e941d4818b2340764b3b4a93a P 5c9fb5c1c89f4073b56eb2f4433d626a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7157922db3e14f30b581564d0280289e" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34801 } } peers { permanent_uuid: "1b548aa7641c42c1b74b1d93a9acca07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 39663 } } peers { permanent_uuid: "5c9fb5c1c89f4073b56eb2f4433d626a" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33649 } }
I20260809 13:05:08.586843 15998 raft_consensus.cc:374] T 146c423e941d4818b2340764b3b4a93a P 5c9fb5c1c89f4073b56eb2f4433d626a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:05:08.587002 15998 raft_consensus.cc:729] T 146c423e941d4818b2340764b3b4a93a P 5c9fb5c1c89f4073b56eb2f4433d626a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c9fb5c1c89f4073b56eb2f4433d626a, State: Initialized, Role: FOLLOWER
I20260809 13:05:08.587658 15999 raft_consensus.cc:348] T 146c423e941d4818b2340764b3b4a93a P 1b548aa7641c42c1b74b1d93a9acca07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7157922db3e14f30b581564d0280289e" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34801 } } peers { permanent_uuid: "1b548aa7641c42c1b74b1d93a9acca07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 39663 } } peers { permanent_uuid: "5c9fb5c1c89f4073b56eb2f4433d626a" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33649 } }
I20260809 13:05:08.587833 15998 consensus_queue.cc:260] T 146c423e941d4818b2340764b3b4a93a P 5c9fb5c1c89f4073b56eb2f4433d626a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7157922db3e14f30b581564d0280289e" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34801 } } peers { permanent_uuid: "1b548aa7641c42c1b74b1d93a9acca07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 39663 } } peers { permanent_uuid: "5c9fb5c1c89f4073b56eb2f4433d626a" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33649 } }
I20260809 13:05:08.588045 15999 raft_consensus.cc:374] T 146c423e941d4818b2340764b3b4a93a P 1b548aa7641c42c1b74b1d93a9acca07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:05:08.588145 15999 raft_consensus.cc:729] T 146c423e941d4818b2340764b3b4a93a P 1b548aa7641c42c1b74b1d93a9acca07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b548aa7641c42c1b74b1d93a9acca07, State: Initialized, Role: FOLLOWER
I20260809 13:05:08.589099 15744 heartbeater.cc:503] Master 127.28.155.254:37569 was elected leader, sending a full tablet report...
I20260809 13:05:08.589361 16000 raft_consensus.cc:348] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7157922db3e14f30b581564d0280289e" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34801 } } peers { permanent_uuid: "1b548aa7641c42c1b74b1d93a9acca07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 39663 } } peers { permanent_uuid: "5c9fb5c1c89f4073b56eb2f4433d626a" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33649 } }
I20260809 13:05:08.589800 16000 raft_consensus.cc:374] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:05:08.589932 16000 raft_consensus.cc:729] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7157922db3e14f30b581564d0280289e, State: Initialized, Role: FOLLOWER
I20260809 13:05:08.590014 15998 ts_tablet_manager.cc:1428] T 146c423e941d4818b2340764b3b4a93a P 5c9fb5c1c89f4073b56eb2f4433d626a: Time spent starting tablet: real 0.015s user 0.003s sys 0.010s
I20260809 13:05:08.590372 15999 consensus_queue.cc:260] T 146c423e941d4818b2340764b3b4a93a P 1b548aa7641c42c1b74b1d93a9acca07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7157922db3e14f30b581564d0280289e" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34801 } } peers { permanent_uuid: "1b548aa7641c42c1b74b1d93a9acca07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 39663 } } peers { permanent_uuid: "5c9fb5c1c89f4073b56eb2f4433d626a" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33649 } }
I20260809 13:05:08.590520 16000 consensus_queue.cc:260] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7157922db3e14f30b581564d0280289e" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34801 } } peers { permanent_uuid: "1b548aa7641c42c1b74b1d93a9acca07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 39663 } } peers { permanent_uuid: "5c9fb5c1c89f4073b56eb2f4433d626a" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33649 } }
I20260809 13:05:08.596151 16000 ts_tablet_manager.cc:1428] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e: Time spent starting tablet: real 0.017s user 0.010s sys 0.007s
I20260809 13:05:08.597352 15964 heartbeater.cc:503] Master 127.28.155.254:37569 was elected leader, sending a full tablet report...
I20260809 13:05:08.597878 15999 ts_tablet_manager.cc:1428] T 146c423e941d4818b2340764b3b4a93a P 1b548aa7641c42c1b74b1d93a9acca07: Time spent starting tablet: real 0.019s user 0.006s sys 0.012s
I20260809 13:05:08.636956 16007 raft_consensus.cc:482] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:05:08.637346 16007 raft_consensus.cc:504] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7157922db3e14f30b581564d0280289e" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34801 } } peers { permanent_uuid: "1b548aa7641c42c1b74b1d93a9acca07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 39663 } } peers { permanent_uuid: "5c9fb5c1c89f4073b56eb2f4433d626a" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33649 } }
I20260809 13:05:08.639134 16007 leader_election.cc:288] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b548aa7641c42c1b74b1d93a9acca07 (127.28.155.195:39663), 5c9fb5c1c89f4073b56eb2f4433d626a (127.28.155.194:33649)
I20260809 13:05:08.646646 15994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:05:08.639798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:42317 (local address 127.28.155.194:33649)
0809 13:05:08.640027 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0809 13:05:08.640035 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:05:08.640833 (+ 798us) server_negotiation.cc:407] Connection header received
0809 13:05:08.641100 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:05:08.641105 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:05:08.641197 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:05:08.641288 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:05:08.642137 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.642911 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.644798 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.645587 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.645775 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:05:08.645860 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 13:05:08.646219 (+ 359us) server_negotiation.cc:299] Negotiation successful
0809 13:05:08.646352 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260809 13:05:08.646651 15995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:05:08.639710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:36457 (local address 127.28.155.195:39663)
0809 13:05:08.639957 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0809 13:05:08.639965 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:05:08.640760 (+ 795us) server_negotiation.cc:407] Connection header received
0809 13:05:08.640979 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:05:08.640985 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:05:08.641085 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:05:08.641215 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:05:08.642059 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.642814 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.644774 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.645587 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.645798 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:05:08.645891 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 13:05:08.646240 (+ 349us) server_negotiation.cc:299] Negotiation successful
0809 13:05:08.646373 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 13:05:08.646838 16010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:05:08.639672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:39663 (local address 127.28.155.193:36457)
0809 13:05:08.640611 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0809 13:05:08.640638 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 13:05:08.640814 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:05:08.641239 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:05:08.641244 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:05:08.641276 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:05:08.641899 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:05:08.641914 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.642967 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.642973 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:05:08.644618 (+ 1645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:05:08.644632 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.645869 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.645875 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:05:08.646083 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:05:08.646107 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 13:05:08.646212 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 13:05:08.646349 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":725,"mutex_wait_us":62,"thread_start_us":533,"threads_started":1}
I20260809 13:05:08.646908 16009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:05:08.639689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:33649 (local address 127.28.155.193:42317)
0809 13:05:08.640732 (+ 1043us) negotiation.cc:107] Waiting for socket to connect
0809 13:05:08.640747 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 13:05:08.640861 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:05:08.641290 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:05:08.641293 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:05:08.641314 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:05:08.641844 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:05:08.641863 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.643067 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.643073 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:05:08.644638 (+ 1565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:05:08.644652 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.645824 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.645830 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:05:08.646002 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:05:08.646081 (+ 79us) client_negotiation.cc:769] Sending connection context
0809 13:05:08.646187 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 13:05:08.646331 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":903,"mutex_wait_us":85,"spinlock_wait_cycles":24832,"thread_start_us":451,"threads_started":1}
I20260809 13:05:08.648249 15679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "146c423e941d4818b2340764b3b4a93a" candidate_uuid: "7157922db3e14f30b581564d0280289e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9fb5c1c89f4073b56eb2f4433d626a" is_pre_election: true
I20260809 13:05:08.648249 15891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "146c423e941d4818b2340764b3b4a93a" candidate_uuid: "7157922db3e14f30b581564d0280289e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b548aa7641c42c1b74b1d93a9acca07" is_pre_election: true
I20260809 13:05:08.648931 15891 raft_consensus.cc:2454] T 146c423e941d4818b2340764b3b4a93a P 1b548aa7641c42c1b74b1d93a9acca07 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7157922db3e14f30b581564d0280289e in term 0.
I20260809 13:05:08.648919 15679 raft_consensus.cc:2454] T 146c423e941d4818b2340764b3b4a93a P 5c9fb5c1c89f4073b56eb2f4433d626a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7157922db3e14f30b581564d0280289e in term 0.
I20260809 13:05:08.649770 15377 leader_election.cc:302] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b548aa7641c42c1b74b1d93a9acca07, 7157922db3e14f30b581564d0280289e; no voters:
I20260809 13:05:08.650242 16007 raft_consensus.cc:2781] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:05:08.650408 16007 raft_consensus.cc:482] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:05:08.650533 16007 raft_consensus.cc:3037] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:05:08.653000 16007 raft_consensus.cc:504] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7157922db3e14f30b581564d0280289e" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34801 } } peers { permanent_uuid: "1b548aa7641c42c1b74b1d93a9acca07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 39663 } } peers { permanent_uuid: "5c9fb5c1c89f4073b56eb2f4433d626a" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33649 } }
I20260809 13:05:08.653700 16007 leader_election.cc:288] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e [CANDIDATE]: Term 1 election: Requested vote from peers 1b548aa7641c42c1b74b1d93a9acca07 (127.28.155.195:39663), 5c9fb5c1c89f4073b56eb2f4433d626a (127.28.155.194:33649)
I20260809 13:05:08.654203 15891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "146c423e941d4818b2340764b3b4a93a" candidate_uuid: "7157922db3e14f30b581564d0280289e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b548aa7641c42c1b74b1d93a9acca07"
I20260809 13:05:08.654284 15679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "146c423e941d4818b2340764b3b4a93a" candidate_uuid: "7157922db3e14f30b581564d0280289e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9fb5c1c89f4073b56eb2f4433d626a"
I20260809 13:05:08.654426 15891 raft_consensus.cc:3037] T 146c423e941d4818b2340764b3b4a93a P 1b548aa7641c42c1b74b1d93a9acca07 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:05:08.654546 15679 raft_consensus.cc:3037] T 146c423e941d4818b2340764b3b4a93a P 5c9fb5c1c89f4073b56eb2f4433d626a [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:05:08.656865 15891 raft_consensus.cc:2454] T 146c423e941d4818b2340764b3b4a93a P 1b548aa7641c42c1b74b1d93a9acca07 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7157922db3e14f30b581564d0280289e in term 1.
I20260809 13:05:08.657073 15679 raft_consensus.cc:2454] T 146c423e941d4818b2340764b3b4a93a P 5c9fb5c1c89f4073b56eb2f4433d626a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7157922db3e14f30b581564d0280289e in term 1.
I20260809 13:05:08.657383 15377 leader_election.cc:302] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b548aa7641c42c1b74b1d93a9acca07, 7157922db3e14f30b581564d0280289e; no voters:
I20260809 13:05:08.657696 16007 raft_consensus.cc:2781] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:05:08.658142 16007 raft_consensus.cc:686] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e [term 1 LEADER]: Becoming Leader. State: Replica: 7157922db3e14f30b581564d0280289e, State: Running, Role: LEADER
I20260809 13:05:08.658707 16007 consensus_queue.cc:237] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7157922db3e14f30b581564d0280289e" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34801 } } peers { permanent_uuid: "1b548aa7641c42c1b74b1d93a9acca07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 39663 } } peers { permanent_uuid: "5c9fb5c1c89f4073b56eb2f4433d626a" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33649 } }
I20260809 13:05:08.663949 15219 catalog_manager.cc:5495] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7157922db3e14f30b581564d0280289e (127.28.155.193). New cstate: current_term: 1 leader_uuid: "7157922db3e14f30b581564d0280289e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7157922db3e14f30b581564d0280289e" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b548aa7641c42c1b74b1d93a9acca07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 39663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c9fb5c1c89f4073b56eb2f4433d626a" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33649 } health_report { overall_health: UNKNOWN } } }
I20260809 13:05:08.703671 15992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:05:08.697850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37414 (local address 127.28.155.193:34801)
0809 13:05:08.698073 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0809 13:05:08.698081 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:05:08.698103 (+ 22us) server_negotiation.cc:407] Connection header received
0809 13:05:08.698363 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:05:08.698367 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:05:08.698461 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:05:08.698617 (+ 156us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:05:08.699033 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.699847 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.701424 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.701849 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.701985 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:05:08.702517 (+ 532us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:05:08.703076 (+ 559us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:05:08.703236 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 13:05:08.703295 (+ 59us) server_negotiation.cc:299] Negotiation successful
0809 13:05:08.703392 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260809 13:05:08.704221 15967 tablet.cc:2369] T 146c423e941d4818b2340764b3b4a93a P 1b548aa7641c42c1b74b1d93a9acca07: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 13:05:08.705567 15540 tablet.cc:2369] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:05:08.712630 15679 raft_consensus.cc:1261] T 146c423e941d4818b2340764b3b4a93a P 5c9fb5c1c89f4073b56eb2f4433d626a [term 1 FOLLOWER]: Refusing update from remote peer 7157922db3e14f30b581564d0280289e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:05:08.712630 15891 raft_consensus.cc:1261] T 146c423e941d4818b2340764b3b4a93a P 1b548aa7641c42c1b74b1d93a9acca07 [term 1 FOLLOWER]: Refusing update from remote peer 7157922db3e14f30b581564d0280289e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:05:08.713651 16011 consensus_queue.cc:1035] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c9fb5c1c89f4073b56eb2f4433d626a" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:05:08.714049 16007 consensus_queue.cc:1035] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b548aa7641c42c1b74b1d93a9acca07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 39663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:05:08.740003 15219 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55992:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:05:08.740316 15219 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55992:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:05:08.744145 15219 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bbd7e113323e49a39e63c9ad02ff9f72: Sending DeleteTablet for 3 replicas of tablet 146c423e941d4818b2340764b3b4a93a
I20260809 13:05:08.745709 15652 tablet_service.cc:1514] Processing DeleteTablet for tablet 146c423e941d4818b2340764b3b4a93a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:05:08 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:51330
I20260809 13:05:08.745697 15861 tablet_service.cc:1514] Processing DeleteTablet for tablet 146c423e941d4818b2340764b3b4a93a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:05:08 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:42932
I20260809 13:05:08.746480 15444 tablet_service.cc:1514] Processing DeleteTablet for tablet 146c423e941d4818b2340764b3b4a93a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:05:08 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:37402
I20260809 13:05:08.747191 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 15350
I20260809 13:05:08.760885 16026 tablet_replica.cc:330] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e: stopping tablet replica
I20260809 13:05:08.764106 16026 raft_consensus.cc:2229] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e [term 1 LEADER]: Raft consensus shutting down.
I20260809 13:05:08.764581 16025 tablet_replica.cc:330] T 146c423e941d4818b2340764b3b4a93a P 5c9fb5c1c89f4073b56eb2f4433d626a: stopping tablet replica
I20260809 13:05:08.764981 16026 raft_consensus.cc:2258] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:05:08.765127 16025 raft_consensus.cc:2229] T 146c423e941d4818b2340764b3b4a93a P 5c9fb5c1c89f4073b56eb2f4433d626a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:05:08.766009 16025 raft_consensus.cc:2258] T 146c423e941d4818b2340764b3b4a93a P 5c9fb5c1c89f4073b56eb2f4433d626a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:05:08.767607 16024 tablet_replica.cc:330] T 146c423e941d4818b2340764b3b4a93a P 1b548aa7641c42c1b74b1d93a9acca07: stopping tablet replica
I20260809 13:05:08.768087 16024 raft_consensus.cc:2229] T 146c423e941d4818b2340764b3b4a93a P 1b548aa7641c42c1b74b1d93a9acca07 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:05:08.768705 16024 raft_consensus.cc:2258] T 146c423e941d4818b2340764b3b4a93a P 1b548aa7641c42c1b74b1d93a9acca07 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:05:08.769078 16025 ts_tablet_manager.cc:1905] T 146c423e941d4818b2340764b3b4a93a P 5c9fb5c1c89f4073b56eb2f4433d626a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:05:08.771204 16026 ts_tablet_manager.cc:1905] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:05:08.771684 16024 ts_tablet_manager.cc:1905] T 146c423e941d4818b2340764b3b4a93a P 1b548aa7641c42c1b74b1d93a9acca07: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:05:08.776520 16025 ts_tablet_manager.cc:1918] T 146c423e941d4818b2340764b3b4a93a P 5c9fb5c1c89f4073b56eb2f4433d626a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:05:08.776760 16025 log.cc:1196] T 146c423e941d4818b2340764b3b4a93a P 5c9fb5c1c89f4073b56eb2f4433d626a: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-1/wal/wals/146c423e941d4818b2340764b3b4a93a
I20260809 13:05:08.777451 16025 ts_tablet_manager.cc:1939] T 146c423e941d4818b2340764b3b4a93a P 5c9fb5c1c89f4073b56eb2f4433d626a: Deleting consensus metadata
I20260809 13:05:08.779825 15200 catalog_manager.cc:4841] TS 5c9fb5c1c89f4073b56eb2f4433d626a (127.28.155.194:33649): tablet 146c423e941d4818b2340764b3b4a93a (table test-table [id=6e28af24bf4a420b8f8024bfb25efdf7]) successfully deleted
I20260809 13:05:08.780165 16026 ts_tablet_manager.cc:1918] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:05:08.780555 16026 log.cc:1196] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-0/wal/wals/146c423e941d4818b2340764b3b4a93a
Aug 09 13:05:08 dist-test-slave-jq4t krb5kdc[14461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.193@KRBTEST.COM
I20260809 13:05:08.781214 16026 ts_tablet_manager.cc:1939] T 146c423e941d4818b2340764b3b4a93a P 7157922db3e14f30b581564d0280289e: Deleting consensus metadata
I20260809 13:05:08.783471 15198 catalog_manager.cc:4841] TS 7157922db3e14f30b581564d0280289e (127.28.155.193:34801): tablet 146c423e941d4818b2340764b3b4a93a (table test-table [id=6e28af24bf4a420b8f8024bfb25efdf7]) successfully deleted
I20260809 13:05:08.785197 16024 ts_tablet_manager.cc:1918] T 146c423e941d4818b2340764b3b4a93a P 1b548aa7641c42c1b74b1d93a9acca07: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:05:08.785419 16024 log.cc:1196] T 146c423e941d4818b2340764b3b4a93a P 1b548aa7641c42c1b74b1d93a9acca07: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786280548611909-29295-0/minicluster-data/ts-2/wal/wals/146c423e941d4818b2340764b3b4a93a
I20260809 13:05:08.785912 16024 ts_tablet_manager.cc:1939] T 146c423e941d4818b2340764b3b4a93a P 1b548aa7641c42c1b74b1d93a9acca07: Deleting consensus metadata
I20260809 13:05:08.787472 15198 catalog_manager.cc:4841] TS 1b548aa7641c42c1b74b1d93a9acca07 (127.28.155.195:39663): tablet 146c423e941d4818b2340764b3b4a93a (table test-table [id=6e28af24bf4a420b8f8024bfb25efdf7]) successfully deleted
I20260809 13:05:08.794812 15992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:05:08.748779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37424 (local address 127.28.155.193:34801)
0809 13:05:08.748970 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 13:05:08.748977 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:05:08.759224 (+ 10247us) server_negotiation.cc:407] Connection header received
0809 13:05:08.759771 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:05:08.759782 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:05:08.759891 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:05:08.759998 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:05:08.765568 (+ 5570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.766777 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.769456 (+ 2679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.770159 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.770283 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:05:08.787665 (+ 17382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:05:08.787682 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:05:08.787702 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:05:08.787746 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:05:08.791460 (+ 3714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:05:08.792422 (+ 962us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:05:08.792431 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:05:08.792439 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:05:08.792689 (+ 250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:05:08.793130 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:05:08.793135 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:05:08.793138 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:05:08.793522 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:05:08.793853 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0809 13:05:08.794187 (+ 334us) server_negotiation.cc:299] Negotiation successful
0809 13:05:08.794447 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 13:05:08.795640 15532 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:05:08.898449 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 15350
I20260809 13:05:08.929034 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 15550
Aug 09 13:05:08 dist-test-slave-jq4t krb5kdc[14461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.194@KRBTEST.COM
I20260809 13:05:08.944298 15994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:05:08.929833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51332 (local address 127.28.155.194:33649)
0809 13:05:08.930007 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 13:05:08.930012 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:05:08.930031 (+ 19us) server_negotiation.cc:407] Connection header received
0809 13:05:08.930183 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:05:08.930187 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:05:08.930254 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:05:08.930345 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:05:08.931729 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.932549 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.933857 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:08.934243 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:08.934346 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:05:08.938540 (+ 4194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:05:08.938556 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:05:08.938574 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:05:08.938609 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:05:08.941734 (+ 3125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:05:08.942459 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:05:08.942467 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:05:08.942469 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:05:08.942596 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:05:08.942904 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:05:08.942907 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:05:08.942908 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:05:08.943274 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:05:08.943509 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0809 13:05:08.943752 (+ 243us) server_negotiation.cc:299] Negotiation successful
0809 13:05:08.943920 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 13:05:08.945086 15736 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:05:09.037138 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 15550
I20260809 13:05:09.064842 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 15754
Aug 09 13:05:09 dist-test-slave-jq4t krb5kdc[14461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.195@KRBTEST.COM
I20260809 13:05:09.082515 15995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:05:09.065782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42938 (local address 127.28.155.195:39663)
0809 13:05:09.065983 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 13:05:09.065990 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:05:09.066012 (+ 22us) server_negotiation.cc:407] Connection header received
0809 13:05:09.066265 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:05:09.066270 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:05:09.066340 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:05:09.066462 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:05:09.068075 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:09.068931 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:09.070342 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:09.070740 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:09.070900 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:05:09.075932 (+ 5032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:05:09.075952 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:05:09.075981 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:05:09.076031 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:05:09.079282 (+ 3251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:05:09.080271 (+ 989us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:05:09.080280 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:05:09.080283 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:05:09.080423 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:05:09.080838 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:05:09.080842 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:05:09.080846 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:05:09.081370 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:05:09.081604 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0809 13:05:09.081923 (+ 319us) server_negotiation.cc:299] Negotiation successful
0809 13:05:09.082170 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 13:05:09.083436 15954 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:05:09.175706 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 15754
I20260809 13:05:09.201756 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 15174
I20260809 13:05:09.203109 15263 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:05:09.319197 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 15174
I20260809 13:05:09.353185 29295 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 13:05:09.700531 29295 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 13:05:09.700872 29295 mini_ranger.cc:66] Stopping Ranger...
I20260809 13:05:10.057343 29295 mini_ranger.cc:68] Stopped Ranger
2026-08-09 13:05:10.057 UTC [14507] LOG: received smart shutdown request
2026-08-09 13:05:10.061 UTC [14507] LOG: background worker "logical replication launcher" (PID 14522) exited with exit code 1
2026-08-09 13:05:10.062 UTC [14513] LOG: shutting down
2026-08-09 13:05:10.247 UTC [14507] LOG: database system is shut down
2026-08-09T13:05:10Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (53391 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:05:10 dist-test-slave-jq4t krb5kdc[16053](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:05:10 dist-test-slave-jq4t krb5kdc[16053](info): set up 2 sockets
Aug 09 13:05:10 dist-test-slave-jq4t krb5kdc[16053](info): commencing operation
krb5kdc: starting...
W20260809 13:05:11.730808 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.296s user 0.000s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:05:11 dist-test-slave-jq4t krb5kdc[16053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280711, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:05:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:05:11Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.28.155.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.28.155.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.28.155.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/rangeradmin_127.28.155.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.28.155.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/rangeradmin_127.28.155.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.28.155.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.28.155.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.28.155.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/rangerlookup_127.28.155.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.28.155.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/rangerlookup_127.28.155.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.28.155.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.28.155.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.28.155.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/HTTP_127.28.155.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.28.155.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/HTTP_127.28.155.212@KRBTEST.COM.keytab.
I20260809 13:05:12.167594 29295 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskqeHpK4/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/postgres -l logfile start
2026-08-09 13:05:14.694 UTC [16099] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 13:05:14.694 UTC [16099] LOG: listening on IPv4 address "127.28.155.212", port 42845
2026-08-09 13:05:14.697 UTC [16099] LOG: listening on Unix socket "/tmp/.s.PGSQL.42845"
2026-08-09 13:05:14.722 UTC [16102] LOG: database system was shut down at 2026-08-09 13:05:13 UTC
2026-08-09 13:05:14.727 UTC [16099] LOG: database system is ready to accept connections
I20260809 13:05:15.937418 29295 mini_postgres.cc:96] Postgres bound to 42845
2026-08-09 13:05:15.963 UTC [16114] FATAL: database "slave" does not exist
127.28.155.212:42845 - accepting connections
I20260809 13:05:15.964043 29295 mini_ranger.cc:161] Starting Ranger...
I20260809 13:05:15.999341 29295 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 13:05:16.517402 29295 mini_ranger.cc:87] Created ranger Postgres database
I20260809 13:05:16.517547 29295 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ranger-admin
2026-08-09 13:05:16,829 [I] DB FLAVOR :POSTGRES
2026-08-09 13:05:16,829 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 13:05:16,829 [I] Checking connection..
2026-08-09 13:05:16,830 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:42845/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 13:05:17,094 [I] Checking connection passed.
2026-08-09 13:05:17,094 [I] --------- Verifying version history table ---------
2026-08-09 13:05:17,095 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:42845/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 13:05:17,369 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 13:05:17,369 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:42845/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 13:05:17,647 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 13:05:17,648 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 13:05:17,648 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:42845/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 13:05:17.905 UTC [16205] WARNING: there is no transaction in progress
2026-08-09 13:05:17,916 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 13:05:17,917 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:42845/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 13:05:18,180 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 13:05:18,181 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 13:05:18,181 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:42845/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 13:05:18,447 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:42845/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 13:05:18,696 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:42845/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-jq4t.c.gcp-upstream.internal','N') ;"
2026-08-09 13:05:18,960 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:42845/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 13:05:19,219 [I] Table x_portal_user does not exist in database ranger
2026-08-09 13:05:19,219 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:42845/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 13:05:19,476 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 13:05:19,477 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:42845/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 13:05:19,738 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:42845/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 13:05:19,987 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 13:05:19,987 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:42845/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 13:05:20.993 UTC [16371] WARNING: there is no transaction in progress
2026-08-09 13:05:21.009 UTC [16371] WARNING: there is no transaction in progress
2026-08-09 13:05:21.026 UTC [16371] WARNING: there is no transaction in progress
2026-08-09 13:05:21.042 UTC [16371] WARNING: there is no transaction in progress
2026-08-09 13:05:21.059 UTC [16371] WARNING: there is no transaction in progress
2026-08-09 13:05:21.077 UTC [16371] WARNING: there is no transaction in progress
2026-08-09 13:05:21.135 UTC [16371] WARNING: there is no transaction in progress
2026-08-09 13:05:21.142 UTC [16371] WARNING: there is no transaction in progress
2026-08-09 13:05:21.158 UTC [16371] WARNING: there is no transaction in progress
2026-08-09 13:05:21.170 UTC [16371] WARNING: there is no transaction in progress
2026-08-09 13:05:21.181 UTC [16371] WARNING: there is no transaction in progress
2026-08-09 13:05:21.196 UTC [16371] WARNING: there is no transaction in progress
2026-08-09 13:05:21.206 UTC [16371] WARNING: there is no transaction in progress
2026-08-09 13:05:21.213 UTC [16371] WARNING: there is no transaction in progress
2026-08-09 13:05:21.221 UTC [16371] WARNING: there is no transaction in progress
2026-08-09 13:05:21.227 UTC [16371] WARNING: there is no transaction in progress
2026-08-09 13:05:21,900 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 13:05:21,900 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:42845/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 13:05:22,147 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 13:05:22,147 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:42845/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 13:05:22,395 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 13:05:22,396 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:42845/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 13:05:22,684 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 13:05:22,684 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:42845/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 13:05:22,949 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:42845/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 13:05:23,203 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:42845/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-jq4t.c.gcp-upstream.internal';"
2026-08-09 13:05:23,452 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 13:05:23,452 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:42845/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 13:05:23,725 [I] DB_PATCHES have already been applied
I20260809 13:05:23.731405 29295 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ranger-admin:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskqeHpK4/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 13:05:23.731539 29295 mini_ranger.cc:193] Using host: 127.28.155.212
I20260809 13:05:23.753294 29295 mini_ranger.cc:227] Ranger admin URL: http://127.28.155.212:42549
Aug 09, 2026 1:05:24 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 1:05:24 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 1:05:24 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 1:05:24 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 1:05:24 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 1:05:24 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 1:05:24 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 13:05:25.153676 29295 mini_ranger.cc:160] Time spent starting Ranger: real 9.190s user 0.000s sys 0.066s
Aug 09, 2026 1:05:46 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 1:05:46 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 09, 2026 1:05:46 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 1:05:46 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 1:05:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 1:05:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 1:05:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 1:05:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 1:05:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 1:05:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 1:05:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 1:05:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 1:05:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 1:05:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 1:05:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 1:05:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 1:05:46 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 1:05:47 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 13:05:48.120433 29295 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.28.155.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.28.155.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.28.155.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/rangerkms_127.28.155.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.28.155.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/rangerkms_127.28.155.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.28.155.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.28.155.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.28.155.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/HTTP_127.28.155.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.28.155.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/HTTP_127.28.155.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 13:05:48 dist-test-slave-jq4t krb5kdc[16053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280748, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 13:05:48.365127 29295 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 13:05:48.395334 29295 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 13:05:49.273018 29295 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 13:05:49.273128 29295 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ranger-kms
I20260809 13:05:49.273161 29295 mini_ranger_kms.cc:227] Using postgres at 127.28.155.212:42845
2026-08-09 13:05:49,652 [I] DB FLAVOR :POSTGRES
2026-08-09 13:05:49,653 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 13:05:49,653 [I] Checking connection
2026-08-09 13:05:49,653 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:42845/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 13:05:49,896 [I] connection success
2026-08-09 13:05:49,896 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 13:05:49,896 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 13:05:49,897 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:42845/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 13:05:50,161 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 13:05:50,162 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 13:05:50,162 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 13:05:50,162 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.155.212:42845/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 13:05:50,426 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 13:05:50.962103 29295 mini_ranger_kms.cc:310] Created kms service
I20260809 13:05:51.165869 29295 mini_ranger_kms.cc:326] Created kudu user
I20260809 13:05:51.215297 29295 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 13:05:51 dist-test-slave-jq4t krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280748, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.28.155.212@KRBTEST.COM
I20260809 13:05:51.638742 29295 mini_ranger_kms.cc:384] Added ranger policy
I20260809 13:05:51.639110 29295 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ranger-kms:/tmp/dist-test-taskqeHpK4/build/asan/bin/postgresql.jar:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskqeHpK4/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 13:05:51.639153 29295 mini_ranger_kms.cc:240] Using host: 127.28.155.212
I20260809 13:05:51.668392 29295 mini_ranger_kms.cc:276] Ranger KMS PID: 16640
I20260809 13:05:51.668596 29295 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.28.155.212:41035
Aug 09, 2026 1:05:52 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 1:05:52 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 1:05:52 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 1:05:52 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 1:05:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 1:05:53 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 13:05:53 dist-test-slave-jq4t krb5kdc[16053](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786280753, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.28.155.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:05:54.537096 29295 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.172s user 0.080s sys 0.342s
I20260809 13:05:54.537359 29295 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 13:05:54.537535 29295 mini_ranger_kms.cc:401] 127.28.155.212:41035/kms/v1/keys
Aug 09 13:05:54 dist-test-slave-jq4t krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280753, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.28.155.212@KRBTEST.COM for HTTP/127.28.155.212@KRBTEST.COM
Aug 09 13:05:54 dist-test-slave-jq4t krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280753, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.28.155.212@KRBTEST.COM for HTTP/127.28.155.212@KRBTEST.COM
Aug 09 13:05:57 dist-test-slave-jq4t krb5kdc[16053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280757, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
I20260809 13:05:57.416062 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:46491
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:43851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:46491
--ranger_config_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.155.212:41035/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:05:57.779824 16721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:05:57.780170 16721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:05:57.780264 16721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:05:57.787763 16721 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:05:57.787892 16721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:05:57.787945 16721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:05:57.788005 16721 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:05:57.788054 16721 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:05:57.798709 16721 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:43851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/wal
--ranger_kms_url=127.28.155.212:41035/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:46491
--ranger_config_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:46491
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:05:57.800204 16721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:05:57.802470 16721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:05:57.816192 16730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:05:57.816174 16727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:05:57.816377 16726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:05:57.817231 16721 server_base.cc:1034] running on GCE node
I20260809 13:05:57.818074 16721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:05:57.819619 16721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:05:57.820834 16721 hybrid_clock.cc:648] HybridClock initialized: now 1786280757820767 us; error 58 us; skew 500 ppm
I20260809 13:05:57.821238 16721 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:05:57 dist-test-slave-jq4t krb5kdc[16053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280757, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:05:57.827546 16721 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:05:57.829200 16721 webserver.cc:460] Webserver started at http://127.28.155.254:35191/ using document root <none> and password file <none>
I20260809 13:05:57.829890 16721 fs_manager.cc:359] Metadata directory not provided
I20260809 13:05:57.830025 16721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:05:57.830381 16721 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 13:05:57 dist-test-slave-jq4t krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280757, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for HTTP/127.28.155.212@KRBTEST.COM
I20260809 13:05:57.889081 16721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "391a73bae89c444cba478f7291353143"
format_stamp: "Formatted at 2026-08-09 13:05:57 on dist-test-slave-jq4t"
server_key: "318de5d5d9a542516d6af879332d39c6"
server_key_iv: "f15039bfad3819ab7f41418731cb678e"
server_key_version: "kuduclusterkey@0"
I20260809 13:05:57.890025 16721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "391a73bae89c444cba478f7291353143"
format_stamp: "Formatted at 2026-08-09 13:05:57 on dist-test-slave-jq4t"
server_key: "318de5d5d9a542516d6af879332d39c6"
server_key_iv: "f15039bfad3819ab7f41418731cb678e"
server_key_version: "kuduclusterkey@0"
I20260809 13:05:57.895776 16721 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 13:05:57.913800 16743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:05:57.915354 16721 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 13:05:57.915572 16721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "391a73bae89c444cba478f7291353143"
format_stamp: "Formatted at 2026-08-09 13:05:57 on dist-test-slave-jq4t"
server_key: "318de5d5d9a542516d6af879332d39c6"
server_key_iv: "f15039bfad3819ab7f41418731cb678e"
server_key_version: "kuduclusterkey@0"
I20260809 13:05:57.915831 16721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:05:57.953733 16721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:05:57.957755 16721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:05:57.958112 16721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:05:57.978318 16721 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:46491
I20260809 13:05:57.978338 16822 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:46491 every 8 connection(s)
I20260809 13:05:57.979928 16721 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:05:57.980343 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 16721
I20260809 13:05:57.980614 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:05:57.981559 29295 external_mini_cluster.cc:1428] Setting key 1ba7cffff38f687b4740d253190713ec
I20260809 13:05:57.984964 16823 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 13:05:57 dist-test-slave-jq4t krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280757, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:05:57.998932 16823 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143: Bootstrap starting.
I20260809 13:05:58.002524 16823 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143: Neither blocks nor log segments found. Creating new log.
I20260809 13:05:58.003661 16823 log.cc:824] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143: Log is configured to *not* fsync() on all Append() calls
I20260809 13:05:58.006278 16828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:05:57.983866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46148 (local address 127.28.155.254:46491)
0809 13:05:57.984735 (+ 869us) server_negotiation.cc:206] Beginning negotiation
0809 13:05:57.984747 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 13:05:57.984790 (+ 43us) server_negotiation.cc:407] Connection header received
0809 13:05:57.986515 (+ 1725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:05:57.986540 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:05:57.986936 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:05:57.987261 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:05:57.989101 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:57.990544 (+ 1443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:57.992629 (+ 2085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:57.993351 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:57.993519 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:05:57.998447 (+ 4928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:05:57.998456 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:05:57.998472 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:05:57.998517 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:05:58.001764 (+ 3247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:05:58.002577 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:05:58.002585 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:05:58.002591 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:05:58.002821 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:05:58.003255 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:05:58.003260 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:05:58.003263 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:05:58.003876 (+ 613us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:05:58.004224 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0809 13:05:58.004805 (+ 581us) server_negotiation.cc:299] Negotiation successful
0809 13:05:58.005245 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":647,"thread_start_us":420,"threads_started":1}
I20260809 13:05:58.007010 16823 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143: No bootstrap required, opened a new log
I20260809 13:05:58.015761 16823 raft_consensus.cc:348] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391a73bae89c444cba478f7291353143" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46491 } }
I20260809 13:05:58.016178 16823 raft_consensus.cc:374] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:05:58.016328 16823 raft_consensus.cc:729] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 391a73bae89c444cba478f7291353143, State: Initialized, Role: FOLLOWER
I20260809 13:05:58.017038 16823 consensus_queue.cc:260] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391a73bae89c444cba478f7291353143" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46491 } }
I20260809 13:05:58.017297 16823 raft_consensus.cc:388] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:05:58.017458 16823 raft_consensus.cc:482] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:05:58.017670 16823 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:05:58.020234 16823 raft_consensus.cc:504] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391a73bae89c444cba478f7291353143" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46491 } }
I20260809 13:05:58.020864 16823 leader_election.cc:302] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 391a73bae89c444cba478f7291353143; no voters:
I20260809 13:05:58.021485 16823 leader_election.cc:288] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:05:58.021737 16830 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:05:58.022595 16830 raft_consensus.cc:686] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [term 1 LEADER]: Becoming Leader. State: Replica: 391a73bae89c444cba478f7291353143, State: Running, Role: LEADER
I20260809 13:05:58.023217 16830 consensus_queue.cc:237] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391a73bae89c444cba478f7291353143" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46491 } }
I20260809 13:05:58.023933 16823 sys_catalog.cc:564] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:05:58.026568 16831 sys_catalog.cc:455] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "391a73bae89c444cba478f7291353143" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391a73bae89c444cba478f7291353143" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46491 } } }
I20260809 13:05:58.026644 16832 sys_catalog.cc:455] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 391a73bae89c444cba478f7291353143. Latest consensus state: current_term: 1 leader_uuid: "391a73bae89c444cba478f7291353143" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391a73bae89c444cba478f7291353143" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46491 } } }
I20260809 13:05:58.027009 16831 sys_catalog.cc:458] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [sys.catalog]: This master's current role is: LEADER
I20260809 13:05:58.027058 16832 sys_catalog.cc:458] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [sys.catalog]: This master's current role is: LEADER
I20260809 13:05:58.033272 16841 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:05:58.033978 16823 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 13:05:58.049312 16841 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:05:58.071969 16841 catalog_manager.cc:1347] Generated new cluster ID: 630c8d55b6084de095e77d74ae816f7b
I20260809 13:05:58.072118 16841 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:05:58.083304 16841 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:05:58.084932 16841 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:05:58.092693 16841 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143: Generated new TSK 0
I20260809 13:05:58.093575 16841 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
I20260809 13:05:58.905162 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.155.212:41035/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:0
--local_ip_for_outbound_sockets=127.28.155.193
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:46491
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:43851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 13:05:59 dist-test-slave-jq4t krb5kdc[16053](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786280759, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 13:05:59.355432 16889 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:05:59.355787 16889 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:05:59.355952 16889 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:05:59.363500 16889 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:05:59.363655 16889 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:05:59.363839 16889 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:05:59.375855 16889 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:43851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.28.155.212:41035/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:46491
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:05:59.377758 16889 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:05:59.379522 16889 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:05:59.405508 16904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:05:59.409799 16906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:05:59.415064 16889 server_base.cc:1034] running on GCE node
W20260809 13:05:59.415810 16910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:05:59.416859 16889 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:05:59.420665 16889 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:05:59.421919 16889 hybrid_clock.cc:648] HybridClock initialized: now 1786280759421855 us; error 71 us; skew 500 ppm
I20260809 13:05:59.422338 16889 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:05:59 dist-test-slave-jq4t krb5kdc[16053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280759, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:05:59.426186 16889 init.cc:377] Logged in from keytab as kudu/127.28.155.193@KRBTEST.COM (short username kudu)
I20260809 13:05:59.428890 16889 webserver.cc:460] Webserver started at http://127.28.155.193:45391/ using document root <none> and password file <none>
I20260809 13:05:59.429802 16889 fs_manager.cc:359] Metadata directory not provided
I20260809 13:05:59.429976 16889 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:05:59.430365 16889 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 13:05:59 dist-test-slave-jq4t krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280759, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for HTTP/127.28.155.212@KRBTEST.COM
I20260809 13:05:59.450421 16889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/data/instance:
uuid: "f9d18b60a2984d93a5239545f331a684"
format_stamp: "Formatted at 2026-08-09 13:05:59 on dist-test-slave-jq4t"
server_key: "79886598262159c9d6c5452db29413a8"
server_key_iv: "f96f048fa7e0875fee9683d378dc7859"
server_key_version: "kuduclusterkey@0"
I20260809 13:05:59.452020 16889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance:
uuid: "f9d18b60a2984d93a5239545f331a684"
format_stamp: "Formatted at 2026-08-09 13:05:59 on dist-test-slave-jq4t"
server_key: "79886598262159c9d6c5452db29413a8"
server_key_iv: "f96f048fa7e0875fee9683d378dc7859"
server_key_version: "kuduclusterkey@0"
I20260809 13:05:59.477463 16889 fs_manager.cc:691] Time spent creating directory manager: real 0.025s user 0.008s sys 0.014s
I20260809 13:05:59.498725 16922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:05:59.504380 16889 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.001s sys 0.001s
I20260809 13:05:59.504684 16889 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "f9d18b60a2984d93a5239545f331a684"
format_stamp: "Formatted at 2026-08-09 13:05:59 on dist-test-slave-jq4t"
server_key: "79886598262159c9d6c5452db29413a8"
server_key_iv: "f96f048fa7e0875fee9683d378dc7859"
server_key_version: "kuduclusterkey@0"
I20260809 13:05:59.504951 16889 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:05:59.529963 16889 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:05:59.535386 16889 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:05:59.535758 16889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:05:59.537106 16889 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:05:59.539079 16889 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:05:59.539201 16889 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:05:59.539325 16889 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:05:59.539394 16889 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:05:59.600318 16889 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:33681
I20260809 13:05:59.600338 17088 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:33681 every 8 connection(s)
I20260809 13:05:59.602164 16889 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:05:59.603319 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 16889
I20260809 13:05:59.603879 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance
I20260809 13:05:59.605082 29295 external_mini_cluster.cc:1428] Setting key 53a24fb20c0b73e3fcef6f0798be3982
Aug 09 13:05:59 dist-test-slave-jq4t krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280759, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.28.155.194@KRBTEST.COM; defaulting to no policy
I20260809 13:05:59.661891 17092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:05:59.618410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:50491 (local address 127.28.155.254:46491)
0809 13:05:59.629502 (+ 11092us) server_negotiation.cc:206] Beginning negotiation
0809 13:05:59.629513 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 13:05:59.639883 (+ 10370us) server_negotiation.cc:407] Connection header received
0809 13:05:59.639974 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:05:59.639982 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:05:59.640100 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:05:59.640211 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:05:59.642755 (+ 2544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:59.644056 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:59.646848 (+ 2792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:05:59.647665 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:05:59.647786 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:05:59.653018 (+ 5232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:05:59.653028 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:05:59.653035 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:05:59.653088 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:05:59.657475 (+ 4387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:05:59.658689 (+ 1214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:05:59.658698 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:05:59.658703 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:05:59.658892 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:05:59.659552 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:05:59.659557 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:05:59.659560 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:05:59.660002 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:05:59.660128 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 13:05:59.661253 (+ 1125us) server_negotiation.cc:299] Negotiation successful
0809 13:05:59.661496 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10883,"thread_start_us":10729,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.194@KRBTEST.COM" created.
I20260809 13:05:59.663269 17091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:05:59.617593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:46491 (local address 127.28.155.193:50491)
0809 13:05:59.636410 (+ 18817us) negotiation.cc:107] Waiting for socket to connect
0809 13:05:59.636525 (+ 115us) client_negotiation.cc:174] Beginning negotiation
0809 13:05:59.639416 (+ 2891us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:05:59.640777 (+ 1361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:05:59.640793 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:05:59.641540 (+ 747us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:05:59.642517 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:05:59.642546 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:05:59.644285 (+ 1739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:05:59.644294 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:05:59.646664 (+ 2370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:05:59.646682 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:05:59.648166 (+ 1484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:05:59.648175 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:05:59.648550 (+ 375us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:05:59.649495 (+ 945us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:05:59.649532 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:05:59.652709 (+ 3177us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:05:59.657738 (+ 5029us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:05:59.657751 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:05:59.657774 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:05:59.658510 (+ 736us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:05:59.659076 (+ 566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:05:59.659080 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:05:59.659084 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:05:59.659377 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:05:59.660221 (+ 844us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:05:59.660227 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:05:59.660722 (+ 495us) client_negotiation.cc:769] Sending connection context
0809 13:05:59.661127 (+ 405us) client_negotiation.cc:240] Negotiation successful
0809 13:05:59.661718 (+ 591us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18453,"thread_start_us":18141,"threads_started":1}
I20260809 13:05:59.665342 17089 heartbeater.cc:347] Connected to a master server at 127.28.155.254:46491
I20260809 13:05:59.665700 17089 heartbeater.cc:464] Registering TS with master...
I20260809 13:05:59.666644 17089 heartbeater.cc:511] Master 127.28.155.254:46491 requested a full tablet report, sending...
I20260809 13:05:59.669363 16770 ts_manager.cc:194] Registered new tserver with Master: f9d18b60a2984d93a5239545f331a684 (127.28.155.193:33681)
I20260809 13:05:59.671523 16770 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.193@KRBTEST.COM'} at 127.28.155.193:50491
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
I20260809 13:05:59.709146 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.155.212:41035/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:0
--local_ip_for_outbound_sockets=127.28.155.194
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:46491
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:43851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 13:05:59 dist-test-slave-jq4t krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280759, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for HTTP/127.28.155.212@KRBTEST.COM
Aug 09 13:06:00 dist-test-slave-jq4t krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280759, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for HTTP/127.28.155.212@KRBTEST.COM
W20260809 13:06:00.209828 17096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:06:00.210292 17096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:06:00.210470 17096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:06:00.222967 17096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:06:00.223137 17096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:06:00.223331 17096 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:06:00.239434 17096 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:43851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.28.155.212:41035/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:46491
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:06:00.241335 17096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:06:00.243274 17096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:06:00.263666 17108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:00.265198 17110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:00.273877 17115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:06:00.275959 17096 server_base.cc:1034] running on GCE node
I20260809 13:06:00.276937 17096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:06:00.282320 17096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:06:00.283622 17096 hybrid_clock.cc:648] HybridClock initialized: now 1786280760283555 us; error 63 us; skew 500 ppm
I20260809 13:06:00.284054 17096 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:06:00 dist-test-slave-jq4t krb5kdc[16053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280760, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:06:00.288825 17096 init.cc:377] Logged in from keytab as kudu/127.28.155.194@KRBTEST.COM (short username kudu)
I20260809 13:06:00.300309 17096 webserver.cc:460] Webserver started at http://127.28.155.194:35755/ using document root <none> and password file <none>
I20260809 13:06:00.301259 17096 fs_manager.cc:359] Metadata directory not provided
I20260809 13:06:00.301437 17096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:06:00.301822 17096 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 13:06:00 dist-test-slave-jq4t krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280760, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for HTTP/127.28.155.212@KRBTEST.COM
I20260809 13:06:00.326036 17096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/data/instance:
uuid: "f71770e4eb1c4606ac2848c7e15a2a6f"
format_stamp: "Formatted at 2026-08-09 13:06:00 on dist-test-slave-jq4t"
server_key: "c20d73b3202d3ef49e364ee50eb739c6"
server_key_iv: "87ba23771e755b982abfb85dc4833f38"
server_key_version: "kuduclusterkey@0"
I20260809 13:06:00.327294 17096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance:
uuid: "f71770e4eb1c4606ac2848c7e15a2a6f"
format_stamp: "Formatted at 2026-08-09 13:06:00 on dist-test-slave-jq4t"
server_key: "c20d73b3202d3ef49e364ee50eb739c6"
server_key_iv: "87ba23771e755b982abfb85dc4833f38"
server_key_version: "kuduclusterkey@0"
I20260809 13:06:00.335958 17096 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.008s sys 0.000s
I20260809 13:06:00.359416 17130 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:00.361340 17096 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260809 13:06:00.361572 17096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "f71770e4eb1c4606ac2848c7e15a2a6f"
format_stamp: "Formatted at 2026-08-09 13:06:00 on dist-test-slave-jq4t"
server_key: "c20d73b3202d3ef49e364ee50eb739c6"
server_key_iv: "87ba23771e755b982abfb85dc4833f38"
server_key_version: "kuduclusterkey@0"
I20260809 13:06:00.361838 17096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:06:00.400411 17096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:06:00.405359 17096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:06:00.405721 17096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:06:00.406914 17096 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:06:00.408694 17096 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:06:00.408811 17096 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:00.408946 17096 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:06:00.409029 17096 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:00.449668 17096 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:33593
I20260809 13:06:00.449705 17317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:33593 every 8 connection(s)
I20260809 13:06:00.451119 17096 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:06:00.457119 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 17096
I20260809 13:06:00.457314 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance
I20260809 13:06:00.457931 29295 external_mini_cluster.cc:1428] Setting key e82759990a0714deb41c64cf249d13ec
Aug 09 13:06:00 dist-test-slave-jq4t krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280760, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:06:00.474052 17321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:00.454069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:54641 (local address 127.28.155.254:46491)
0809 13:06:00.454648 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:00.454654 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:00.456019 (+ 1365us) server_negotiation.cc:407] Connection header received
0809 13:06:00.457887 (+ 1868us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:00.457893 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:00.458054 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:00.458194 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:00.460446 (+ 2252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:00.461369 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:00.462997 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:00.463418 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:00.463564 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:00.467686 (+ 4122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:00.467691 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:00.467695 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:00.467729 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:00.470655 (+ 2926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:00.471454 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:00.471460 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:00.471468 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:00.471598 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:00.472098 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:00.472104 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:00.472107 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:00.472447 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:00.472644 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:00.473387 (+ 743us) server_negotiation.cc:299] Negotiation successful
0809 13:06:00.473637 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":285,"threads_started":1}
I20260809 13:06:00.475085 17323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:00.454638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:46491 (local address 127.28.155.194:54641)
0809 13:06:00.455554 (+ 916us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:00.455617 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:00.457587 (+ 1970us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:00.458456 (+ 869us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:00.458465 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:00.459095 (+ 630us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:06:00.459963 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:00.459992 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:00.461554 (+ 1562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:00.461564 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:00.462820 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:00.462833 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:00.463677 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:00.463687 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:00.463974 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:00.464777 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:06:00.464800 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:06:00.467426 (+ 2626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:06:00.470844 (+ 3418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:00.470854 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:00.470871 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:00.471313 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:00.471720 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:00.471725 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:00.471730 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:00.471969 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:00.472624 (+ 655us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:06:00.472634 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:06:00.473004 (+ 370us) client_negotiation.cc:769] Sending connection context
0809 13:06:00.473296 (+ 292us) client_negotiation.cc:240] Negotiation successful
0809 13:06:00.473861 (+ 565us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"thread_start_us":368,"threads_started":1}
I20260809 13:06:00.477013 17319 heartbeater.cc:347] Connected to a master server at 127.28.155.254:46491
I20260809 13:06:00.477372 17319 heartbeater.cc:464] Registering TS with master...
I20260809 13:06:00.478248 17319 heartbeater.cc:511] Master 127.28.155.254:46491 requested a full tablet report, sending...
I20260809 13:06:00.480038 16770 ts_manager.cc:194] Registered new tserver with Master: f71770e4eb1c4606ac2848c7e15a2a6f (127.28.155.194:33593)
I20260809 13:06:00.481169 16770 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.194@KRBTEST.COM'} at 127.28.155.194:54641
WARNING: no policy specified for kudu/127.28.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
I20260809 13:06:00.536978 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.155.212:41035/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:0
--local_ip_for_outbound_sockets=127.28.155.195
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:46491
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:43851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 13:06:00.675433 17089 heartbeater.cc:503] Master 127.28.155.254:46491 was elected leader, sending a full tablet report...
W20260809 13:06:00.905908 17332 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:06:00.906291 17332 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:06:00.906461 17332 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:06:00.914260 17332 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:06:00.914384 17332 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:06:00.914567 17332 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:06:00.924924 17332 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:43851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.28.155.212:41035/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:46491
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:06:00.926429 17332 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:06:00.927824 17332 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:06:00.941473 17339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:00.941563 17340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:00.941610 17342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:06:00.942492 17332 server_base.cc:1034] running on GCE node
I20260809 13:06:00.943122 17332 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:06:00.944084 17332 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:06:00.945283 17332 hybrid_clock.cc:648] HybridClock initialized: now 1786280760945224 us; error 53 us; skew 500 ppm
I20260809 13:06:00.945609 17332 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:06:00 dist-test-slave-jq4t krb5kdc[16053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280760, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:06:00.948902 17332 init.cc:377] Logged in from keytab as kudu/127.28.155.195@KRBTEST.COM (short username kudu)
I20260809 13:06:00.950465 17332 webserver.cc:460] Webserver started at http://127.28.155.195:38355/ using document root <none> and password file <none>
I20260809 13:06:00.951215 17332 fs_manager.cc:359] Metadata directory not provided
I20260809 13:06:00.951373 17332 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:06:00.951705 17332 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 13:06:00 dist-test-slave-jq4t krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280760, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for HTTP/127.28.155.212@KRBTEST.COM
I20260809 13:06:00.968371 17332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/data/instance:
uuid: "c3635ba6aed547139fe56e672a5c75cf"
format_stamp: "Formatted at 2026-08-09 13:06:00 on dist-test-slave-jq4t"
server_key: "f65862640cb562081dda867bea36d5d9"
server_key_iv: "09b6487258a99d6c927a98db1a5a8796"
server_key_version: "kuduclusterkey@0"
I20260809 13:06:00.969604 17332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance:
uuid: "c3635ba6aed547139fe56e672a5c75cf"
format_stamp: "Formatted at 2026-08-09 13:06:00 on dist-test-slave-jq4t"
server_key: "f65862640cb562081dda867bea36d5d9"
server_key_iv: "09b6487258a99d6c927a98db1a5a8796"
server_key_version: "kuduclusterkey@0"
I20260809 13:06:00.976738 17332 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260809 13:06:00.994496 17353 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:00.996285 17332 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 13:06:00.996577 17332 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "c3635ba6aed547139fe56e672a5c75cf"
format_stamp: "Formatted at 2026-08-09 13:06:00 on dist-test-slave-jq4t"
server_key: "f65862640cb562081dda867bea36d5d9"
server_key_iv: "09b6487258a99d6c927a98db1a5a8796"
server_key_version: "kuduclusterkey@0"
I20260809 13:06:00.996855 17332 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:06:01.031386 17332 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:06:01.035734 17332 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:06:01.036087 17332 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:06:01.037258 17332 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:06:01.038722 17332 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:06:01.038797 17332 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:01.038981 17332 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:06:01.039039 17332 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:01.074576 17332 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:44725
I20260809 13:06:01.074613 17523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:44725 every 8 connection(s)
I20260809 13:06:01.076031 17332 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:06:01.085207 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 17332
I20260809 13:06:01.085390 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance
I20260809 13:06:01.085883 29295 external_mini_cluster.cc:1428] Setting key dc72484e269f482237f0ac51c01cfff3
Aug 09 13:06:01 dist-test-slave-jq4t krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280760, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:06:01.097810 17526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:01.078875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:52753 (local address 127.28.155.254:46491)
0809 13:06:01.079376 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:01.079381 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:01.080420 (+ 1039us) server_negotiation.cc:407] Connection header received
0809 13:06:01.082308 (+ 1888us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:01.082313 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:01.082424 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:01.082557 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:01.084001 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:01.084958 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:01.086911 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:01.087548 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:01.087652 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:01.091593 (+ 3941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:01.091597 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:01.091601 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:01.091650 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:01.094341 (+ 2691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:01.095240 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:01.095246 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:01.095250 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:01.095390 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:01.095844 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:01.095852 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:01.095856 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:01.096165 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:01.096336 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:01.097176 (+ 840us) server_negotiation.cc:299] Negotiation successful
0809 13:06:01.097424 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":240,"threads_started":1}
I20260809 13:06:01.098768 17527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:01.079479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:46491 (local address 127.28.155.195:52753)
0809 13:06:01.080235 (+ 756us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:01.080283 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:01.082021 (+ 1738us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:01.082800 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:01.082809 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:01.083236 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:06:01.083811 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:01.083828 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:01.085137 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:01.085143 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:01.086714 (+ 1571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:01.086730 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:01.087802 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:01.087811 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:01.088106 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:01.088919 (+ 813us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:06:01.088967 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:06:01.091343 (+ 2376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:06:01.094522 (+ 3179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:01.094541 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:01.094563 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:01.095108 (+ 545us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:01.095515 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:01.095520 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:01.095524 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:01.095722 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:01.096306 (+ 584us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:06:01.096315 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:06:01.096758 (+ 443us) client_negotiation.cc:769] Sending connection context
0809 13:06:01.097050 (+ 292us) client_negotiation.cc:240] Negotiation successful
0809 13:06:01.097622 (+ 572us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":320,"threads_started":1}
I20260809 13:06:01.100250 17524 heartbeater.cc:347] Connected to a master server at 127.28.155.254:46491
I20260809 13:06:01.100726 17524 heartbeater.cc:464] Registering TS with master...
I20260809 13:06:01.101723 17524 heartbeater.cc:511] Master 127.28.155.254:46491 requested a full tablet report, sending...
I20260809 13:06:01.103399 16770 ts_manager.cc:194] Registered new tserver with Master: c3635ba6aed547139fe56e672a5c75cf (127.28.155.195:44725)
I20260809 13:06:01.104295 16770 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.195@KRBTEST.COM'} at 127.28.155.195:52753
I20260809 13:06:01.115025 29295 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 13:06:01.116763 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 16889
Aug 09 13:06:01 dist-test-slave-jq4t krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280757, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.193@KRBTEST.COM
I20260809 13:06:01.135286 17531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:01.117673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58926 (local address 127.28.155.193:33681)
0809 13:06:01.118331 (+ 658us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:01.118338 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:01.118364 (+ 26us) server_negotiation.cc:407] Connection header received
0809 13:06:01.118430 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:01.118436 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:01.118678 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:01.118873 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:01.120660 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:01.121725 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:01.123448 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:01.124133 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:01.124239 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:01.128983 (+ 4744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:01.128998 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:01.129015 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:01.129055 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:01.132148 (+ 3093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:01.133015 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:01.133023 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:01.133025 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:01.133186 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:01.133610 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:01.133614 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:01.133616 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:01.134017 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:01.134269 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:01.134680 (+ 411us) server_negotiation.cc:299] Negotiation successful
0809 13:06:01.134902 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":328,"threads_started":1}
I20260809 13:06:01.136735 17083 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:06:01.221061 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 16889
I20260809 13:06:01.246022 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 17096
Aug 09 13:06:01 dist-test-slave-jq4t krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280757, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.194@KRBTEST.COM
I20260809 13:06:01.263224 17535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:01.247167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48202 (local address 127.28.155.194:33593)
0809 13:06:01.247728 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:01.247736 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:01.247762 (+ 26us) server_negotiation.cc:407] Connection header received
0809 13:06:01.247826 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:01.247832 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:01.248073 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:01.248207 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:01.249675 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:01.250676 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:01.252064 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:01.252770 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:01.252868 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:01.257502 (+ 4634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:01.257514 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:01.257529 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:01.257571 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:01.260408 (+ 2837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:01.261350 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:01.261357 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:01.261359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:01.261511 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:01.261862 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:01.261865 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:01.261867 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:01.262218 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:01.262460 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:01.262719 (+ 259us) server_negotiation.cc:299] Negotiation successful
0809 13:06:01.262930 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416,"thread_start_us":290,"threads_started":1}
I20260809 13:06:01.264645 17311 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:06:01.348445 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 17096
I20260809 13:06:01.375936 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 17332
Aug 09 13:06:01 dist-test-slave-jq4t krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280757, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.195@KRBTEST.COM
I20260809 13:06:01.396742 17537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:01.377127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35810 (local address 127.28.155.195:44725)
0809 13:06:01.377849 (+ 722us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:01.377856 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:01.377887 (+ 31us) server_negotiation.cc:407] Connection header received
0809 13:06:01.377968 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:01.377974 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:01.378204 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:01.378340 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:01.380261 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:01.382509 (+ 2248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:01.384714 (+ 2205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:01.385788 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:01.385959 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:01.390620 (+ 4661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:01.390632 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:01.390647 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:01.390689 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:01.393616 (+ 2927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:01.394336 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:01.394346 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:01.394354 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:01.394490 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:01.394921 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:01.394926 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:01.394929 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:01.395302 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:01.395674 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:01.395984 (+ 310us) server_negotiation.cc:299] Negotiation successful
0809 13:06:01.396291 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":385,"threads_started":1}
I20260809 13:06:01.398154 17517 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:06:01.483290 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 17332
I20260809 13:06:01.506943 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 16721
I20260809 13:06:01.508430 16815 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:06:01.618402 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 16721
I20260809 13:06:01.650681 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:46491
--webserver_interface=127.28.155.254
--webserver_port=35191
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:43851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:46491
--ranger_config_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.155.212:41035/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.28.155.212:41035/kms with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:06:02.006124 17543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:06:02.006466 17543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:06:02.006644 17543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:06:02.014379 17543 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:06:02.014509 17543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:06:02.014621 17543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:06:02.014729 17543 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:06:02.014834 17543 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:06:02.025740 17543 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:43851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.28.155.212:41035/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:46491
--ranger_config_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:46491
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=35191
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:06:02.027251 17543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:06:02.028839 17543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:06:02.041880 17553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:02.041844 17550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:02.041944 17557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:06:02.042851 17543 server_base.cc:1034] running on GCE node
I20260809 13:06:02.043774 17543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:06:02.045428 17543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:06:02.046687 17543 hybrid_clock.cc:648] HybridClock initialized: now 1786280762046649 us; error 60 us; skew 500 ppm
I20260809 13:06:02.047088 17543 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:06:02 dist-test-slave-jq4t krb5kdc[16053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280762, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:06:02.050704 17543 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:06:02.052315 17543 webserver.cc:460] Webserver started at http://127.28.155.254:35191/ using document root <none> and password file <none>
I20260809 13:06:02.053061 17543 fs_manager.cc:359] Metadata directory not provided
I20260809 13:06:02.053179 17543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 13:06:02 dist-test-slave-jq4t krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280762, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for HTTP/127.28.155.212@KRBTEST.COM
I20260809 13:06:02.096750 17543 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 13:06:02.099926 17568 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:02.101374 17543 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:06:02.101599 17543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "391a73bae89c444cba478f7291353143"
format_stamp: "Formatted at 2026-08-09 13:05:57 on dist-test-slave-jq4t"
server_key: "318de5d5d9a542516d6af879332d39c6"
server_key_iv: "f15039bfad3819ab7f41418731cb678e"
server_key_version: "kuduclusterkey@0"
I20260809 13:06:02.102614 17543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:06:02.134593 17543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:06:02.138808 17543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:06:02.139142 17543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:06:02.158733 17543 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:46491
I20260809 13:06:02.158753 17641 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:46491 every 8 connection(s)
I20260809 13:06:02.160549 17543 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:06:02.162106 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 17543
I20260809 13:06:02.163290 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.155.212:41035/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:33681
--local_ip_for_outbound_sockets=127.28.155.193
--tserver_master_addrs=127.28.155.254:46491
--webserver_port=45391
--webserver_interface=127.28.155.193
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:43851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.28.155.212:41035/kms with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 13:06:02.171062 17644 sys_catalog.cc:263] Verifying existing consensus state
I20260809 13:06:02.176661 17644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143: Bootstrap starting.
I20260809 13:06:02.196902 17644 log.cc:824] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143: Log is configured to *not* fsync() on all Append() calls
I20260809 13:06:02.206811 17644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 13:06:02.207444 17644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143: Bootstrap complete.
I20260809 13:06:02.217195 17644 raft_consensus.cc:348] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391a73bae89c444cba478f7291353143" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46491 } }
I20260809 13:06:02.218241 17644 raft_consensus.cc:729] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 391a73bae89c444cba478f7291353143, State: Initialized, Role: FOLLOWER
I20260809 13:06:02.218870 17644 consensus_queue.cc:260] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391a73bae89c444cba478f7291353143" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46491 } }
I20260809 13:06:02.219147 17644 raft_consensus.cc:388] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:06:02.219287 17644 raft_consensus.cc:482] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:06:02.219488 17644 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [term 1 FOLLOWER]: Advancing to term 2
I20260809 13:06:02.223512 17644 raft_consensus.cc:504] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391a73bae89c444cba478f7291353143" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46491 } }
I20260809 13:06:02.224052 17644 leader_election.cc:302] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 391a73bae89c444cba478f7291353143; no voters:
I20260809 13:06:02.224812 17644 leader_election.cc:288] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 13:06:02.224953 17650 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 13:06:02.226308 17650 raft_consensus.cc:686] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [term 2 LEADER]: Becoming Leader. State: Replica: 391a73bae89c444cba478f7291353143, State: Running, Role: LEADER
I20260809 13:06:02.226980 17650 consensus_queue.cc:237] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391a73bae89c444cba478f7291353143" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46491 } }
I20260809 13:06:02.227305 17644 sys_catalog.cc:564] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:06:02.229662 17652 sys_catalog.cc:455] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 391a73bae89c444cba478f7291353143. Latest consensus state: current_term: 2 leader_uuid: "391a73bae89c444cba478f7291353143" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391a73bae89c444cba478f7291353143" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46491 } } }
I20260809 13:06:02.230079 17652 sys_catalog.cc:458] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [sys.catalog]: This master's current role is: LEADER
I20260809 13:06:02.230649 17651 sys_catalog.cc:455] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "391a73bae89c444cba478f7291353143" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391a73bae89c444cba478f7291353143" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46491 } } }
I20260809 13:06:02.230958 17651 sys_catalog.cc:458] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143 [sys.catalog]: This master's current role is: LEADER
I20260809 13:06:02.236855 17656 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:06:02.245863 17656 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:06:02.248255 17656 catalog_manager.cc:1259] Loaded cluster ID: 630c8d55b6084de095e77d74ae816f7b
I20260809 13:06:02.248529 17656 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:06:02.254074 17656 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:06:02.255266 17644 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 13:06:02.255836 17656 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143: Loaded TSK: 0
I20260809 13:06:02.257678 17656 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 13:06:02.646070 17647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:06:02.646502 17647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:06:02.646687 17647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:06:02.658689 17647 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:06:02.658860 17647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:06:02.659067 17647 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:06:02.675711 17647 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:43851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.28.155.212:41035/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:33681
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=45391
--tserver_master_addrs=127.28.155.254:46491
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:06:02.677716 17647 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:06:02.679668 17647 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:06:02.748445 17695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:02.749620 17693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:02.753993 17697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:06:02.754511 17647 server_base.cc:1034] running on GCE node
I20260809 13:06:02.755442 17647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:06:02.756963 17647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:06:02.768700 17647 hybrid_clock.cc:648] HybridClock initialized: now 1786280762768588 us; error 78 us; skew 500 ppm
I20260809 13:06:02.769218 17647 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:06:02 dist-test-slave-jq4t krb5kdc[16053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280762, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:06:02.774147 17647 init.cc:377] Logged in from keytab as kudu/127.28.155.193@KRBTEST.COM (short username kudu)
I20260809 13:06:02.825611 17647 webserver.cc:460] Webserver started at http://127.28.155.193:45391/ using document root <none> and password file <none>
I20260809 13:06:02.826978 17647 fs_manager.cc:359] Metadata directory not provided
I20260809 13:06:02.827201 17647 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 13:06:02 dist-test-slave-jq4t krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280762, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for HTTP/127.28.155.212@KRBTEST.COM
I20260809 13:06:02.908218 17647 fs_manager.cc:709] Time spent opening directory manager: real 0.012s user 0.005s sys 0.001s
I20260809 13:06:02.921280 17708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:02.929530 17647 fs_manager.cc:725] Time spent opening block manager: real 0.019s user 0.001s sys 0.004s
I20260809 13:06:02.929814 17647 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "f9d18b60a2984d93a5239545f331a684"
format_stamp: "Formatted at 2026-08-09 13:05:59 on dist-test-slave-jq4t"
server_key: "79886598262159c9d6c5452db29413a8"
server_key_iv: "f96f048fa7e0875fee9683d378dc7859"
server_key_version: "kuduclusterkey@0"
I20260809 13:06:02.931500 17647 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:06:02.963565 17647 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:06:02.968443 17647 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:06:02.968853 17647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:06:02.989624 17647 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:06:02.991979 17647 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:06:02.992156 17647 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:02.992295 17647 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:06:02.992373 17647 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:03.094674 17647 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:33681
I20260809 13:06:03.096791 17647 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:06:03.101207 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 17647
I20260809 13:06:03.102162 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.155.212:41035/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:33593
--local_ip_for_outbound_sockets=127.28.155.194
--tserver_master_addrs=127.28.155.254:46491
--webserver_port=35755
--webserver_interface=127.28.155.194
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:43851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.28.155.212:41035/kms with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 13:06:03.116762 17873 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:33681 every 8 connection(s)
Aug 09 13:06:03 dist-test-slave-jq4t krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280762, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:06:03.195268 17879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:03.145036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:53313 (local address 127.28.155.254:46491)
0809 13:06:03.165164 (+ 20128us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:03.165192 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:03.165259 (+ 67us) server_negotiation.cc:407] Connection header received
0809 13:06:03.165893 (+ 634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:03.165921 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:03.166555 (+ 634us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:03.167116 (+ 561us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:03.169669 (+ 2553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:03.172441 (+ 2772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:03.175606 (+ 3165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:03.176935 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:03.177152 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:03.183341 (+ 6189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:03.183357 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:03.183377 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:03.183439 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:03.188292 (+ 4853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:03.189608 (+ 1316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:03.189621 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:03.189631 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:03.189922 (+ 291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:03.190567 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:03.190574 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:03.190579 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:03.191547 (+ 968us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:03.191783 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:03.193038 (+ 1255us) server_negotiation.cc:299] Negotiation successful
0809 13:06:03.193567 (+ 529us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19805,"thread_start_us":19521,"threads_started":1}
I20260809 13:06:03.198027 17877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:03.143303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:46491 (local address 127.28.155.193:53313)
0809 13:06:03.149217 (+ 5914us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:03.149306 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:03.152019 (+ 2713us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:03.167445 (+ 15426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:03.167463 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:03.168295 (+ 832us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:06:03.169317 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:03.169354 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:03.172816 (+ 3462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:03.172825 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:03.175325 (+ 2500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:03.175350 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:03.177723 (+ 2373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:03.177733 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:03.178072 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:03.179322 (+ 1250us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:06:03.179369 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:06:03.182913 (+ 3544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:06:03.188588 (+ 5675us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:03.188601 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:03.188620 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:03.189390 (+ 770us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:03.190114 (+ 724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:03.190122 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:03.190128 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:03.190401 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:03.191908 (+ 1507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:06:03.191920 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:06:03.192386 (+ 466us) client_negotiation.cc:769] Sending connection context
0809 13:06:03.195939 (+ 3553us) client_negotiation.cc:240] Negotiation successful
0809 13:06:03.196631 (+ 692us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5503,"thread_start_us":5206,"threads_started":1}
I20260809 13:06:03.202049 17874 heartbeater.cc:347] Connected to a master server at 127.28.155.254:46491
I20260809 13:06:03.202370 17874 heartbeater.cc:464] Registering TS with master...
I20260809 13:06:03.203119 17874 heartbeater.cc:511] Master 127.28.155.254:46491 requested a full tablet report, sending...
W20260809 13:06:03.206775 17874 heartbeater.cc:644] Failed to heartbeat to 127.28.155.254:46491 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 13:06:03.207098 17874 heartbeater.cc:464] Registering TS with master...
I20260809 13:06:03.207466 17874 heartbeater.cc:511] Master 127.28.155.254:46491 requested a full tablet report, sending...
I20260809 13:06:03.209014 17874 heartbeater.cc:464] Registering TS with master...
I20260809 13:06:03.209393 17874 heartbeater.cc:511] Master 127.28.155.254:46491 requested a full tablet report, sending...
W20260809 13:06:03.210939 17874 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 13:06:03.369566 17898 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
W20260809 13:06:03.585213 17875 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:06:03.585659 17875 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:06:03.585835 17875 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:06:03.597769 17875 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:06:03.597946 17875 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:06:03.598133 17875 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:06:03.611435 17875 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:43851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.28.155.212:41035/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:33593
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=35755
--tserver_master_addrs=127.28.155.254:46491
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:06:03.613135 17875 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:06:03.614871 17875 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:06:03.652278 17906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:03.661394 17909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:03.662006 17916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:06:03.664523 17875 server_base.cc:1034] running on GCE node
I20260809 13:06:03.665423 17875 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:06:03.666814 17875 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:06:03.668094 17875 hybrid_clock.cc:648] HybridClock initialized: now 1786280763668029 us; error 47 us; skew 500 ppm
I20260809 13:06:03.668586 17875 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:06:03 dist-test-slave-jq4t krb5kdc[16053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280763, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:06:03.673405 17875 init.cc:377] Logged in from keytab as kudu/127.28.155.194@KRBTEST.COM (short username kudu)
I20260809 13:06:03.685587 17875 webserver.cc:460] Webserver started at http://127.28.155.194:35755/ using document root <none> and password file <none>
I20260809 13:06:03.686769 17875 fs_manager.cc:359] Metadata directory not provided
I20260809 13:06:03.686980 17875 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 13:06:03 dist-test-slave-jq4t krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280763, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for HTTP/127.28.155.212@KRBTEST.COM
I20260809 13:06:03.716374 17875 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.005s sys 0.000s
I20260809 13:06:03.720745 17928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:03.722705 17875 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 13:06:03.722922 17875 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "f71770e4eb1c4606ac2848c7e15a2a6f"
format_stamp: "Formatted at 2026-08-09 13:06:00 on dist-test-slave-jq4t"
server_key: "c20d73b3202d3ef49e364ee50eb739c6"
server_key_iv: "87ba23771e755b982abfb85dc4833f38"
server_key_version: "kuduclusterkey@0"
I20260809 13:06:03.724517 17875 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 09 13:06:03 dist-test-slave-jq4t krb5kdc[16053](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786280763, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:06:03.762622 17875 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:06:03.768579 17875 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:06:03.768908 17875 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:06:03.776993 17875 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:06:03.781458 17875 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:06:03.781610 17875 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:03.781734 17875 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:06:03.781813 17875 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:03.856046 17875 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:33593
I20260809 13:06:03.856142 18104 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:33593 every 8 connection(s)
I20260809 13:06:03.858035 17875 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:06:03.866532 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 17875
I20260809 13:06:03.867568 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.155.212:41035/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:44725
--local_ip_for_outbound_sockets=127.28.155.195
--tserver_master_addrs=127.28.155.254:46491
--webserver_port=38355
--webserver_interface=127.28.155.195
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:43851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.28.155.212:41035/kms with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 13:06:03 dist-test-slave-jq4t krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280763, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:06:03.898484 18111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:03.861129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:60863 (local address 127.28.155.254:46491)
0809 13:06:03.876614 (+ 15485us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:03.876624 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:03.878067 (+ 1443us) server_negotiation.cc:407] Connection header received
0809 13:06:03.880284 (+ 2217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:03.880291 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:03.880381 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:03.882347 (+ 1966us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:03.882546 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:03.883728 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:03.885871 (+ 2143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:03.886339 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:03.886518 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:03.890885 (+ 4367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:03.890891 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:03.890894 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:03.890931 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:03.894424 (+ 3493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:03.895480 (+ 1056us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:03.895486 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:03.895489 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:03.895672 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:03.896550 (+ 878us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:03.896559 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:03.896562 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:03.896862 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:03.897046 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:03.897827 (+ 781us) server_negotiation.cc:299] Negotiation successful
0809 13:06:03.898084 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15304,"thread_start_us":15485,"threads_started":1}
I20260809 13:06:03.899803 18112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:03.861671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:46491 (local address 127.28.155.194:60863)
0809 13:06:03.877837 (+ 16166us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:03.877888 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:03.879773 (+ 1885us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:03.880787 (+ 1014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:03.880796 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:03.881309 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:06:03.882151 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:03.882177 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:03.883931 (+ 1754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:03.883937 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:03.885718 (+ 1781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:03.885732 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:03.886623 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:03.886633 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:03.886878 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:03.887671 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:06:03.887696 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:06:03.890579 (+ 2883us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:06:03.894640 (+ 4061us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:03.894651 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:03.894672 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:03.895319 (+ 647us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:03.896146 (+ 827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:03.896152 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:03.896156 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:03.896377 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:03.897031 (+ 654us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:06:03.897039 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:06:03.897414 (+ 375us) client_negotiation.cc:769] Sending connection context
0809 13:06:03.897717 (+ 303us) client_negotiation.cc:240] Negotiation successful
0809 13:06:03.898343 (+ 626us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13797,"thread_start_us":15211,"threads_started":1}
I20260809 13:06:03.901562 18105 heartbeater.cc:347] Connected to a master server at 127.28.155.254:46491
I20260809 13:06:03.901928 18105 heartbeater.cc:464] Registering TS with master...
I20260809 13:06:03.902740 18105 heartbeater.cc:511] Master 127.28.155.254:46491 requested a full tablet report, sending...
I20260809 13:06:03.904780 17590 ts_manager.cc:194] Registered new tserver with Master: f71770e4eb1c4606ac2848c7e15a2a6f (127.28.155.194:33593)
I20260809 13:06:03.906992 17590 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.194@KRBTEST.COM'} at 127.28.155.194:60863
I20260809 13:06:04.211119 17874 heartbeater.cc:464] Registering TS with master...
I20260809 13:06:04.211822 17874 heartbeater.cc:511] Master 127.28.155.254:46491 requested a full tablet report, sending...
I20260809 13:06:04.213464 17590 ts_manager.cc:194] Registered new tserver with Master: f9d18b60a2984d93a5239545f331a684 (127.28.155.193:33681)
I20260809 13:06:04.214772 17590 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.193@KRBTEST.COM'} at 127.28.155.193:53313
Aug 09 13:06:04 dist-test-slave-jq4t krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280763, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for HTTP/127.28.155.212@KRBTEST.COM
W20260809 13:06:04.356240 18113 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:06:04.356727 18113 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:06:04.356902 18113 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:06:04.368239 18113 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:06:04.368402 18113 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:06:04.368602 18113 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:06:04.383322 18113 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:43851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.28.155.212:41035/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:44725
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=38355
--tserver_master_addrs=127.28.155.254:46491
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:06:04.385175 18113 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:06:04.386654 18113 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:06:04.403520 18124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:04.415315 18126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:04.415896 18123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:06:04.415974 18113 server_base.cc:1034] running on GCE node
I20260809 13:06:04.416997 18113 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:06:04.419641 18113 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:06:04.420868 18113 hybrid_clock.cc:648] HybridClock initialized: now 1786280764420802 us; error 68 us; skew 500 ppm
I20260809 13:06:04.421263 18113 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:06:04 dist-test-slave-jq4t krb5kdc[16053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280764, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:06:04.424834 18113 init.cc:377] Logged in from keytab as kudu/127.28.155.195@KRBTEST.COM (short username kudu)
I20260809 13:06:04.426792 18113 webserver.cc:460] Webserver started at http://127.28.155.195:38355/ using document root <none> and password file <none>
I20260809 13:06:04.427623 18113 fs_manager.cc:359] Metadata directory not provided
I20260809 13:06:04.427809 18113 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 13:06:04 dist-test-slave-jq4t krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280764, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for HTTP/127.28.155.212@KRBTEST.COM
I20260809 13:06:04.457345 18113 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260809 13:06:04.460577 18137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:04.462172 18113 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 13:06:04.462391 18113 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "c3635ba6aed547139fe56e672a5c75cf"
format_stamp: "Formatted at 2026-08-09 13:06:00 on dist-test-slave-jq4t"
server_key: "f65862640cb562081dda867bea36d5d9"
server_key_iv: "09b6487258a99d6c927a98db1a5a8796"
server_key_version: "kuduclusterkey@0"
I20260809 13:06:04.463475 18113 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:06:04.499414 18113 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:06:04.504007 18113 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:06:04.504355 18113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:06:04.505584 18113 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:06:04.507463 18113 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:06:04.507580 18113 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:04.507732 18113 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:06:04.507833 18113 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 13:06:04 dist-test-slave-jq4t krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280763, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for HTTP/127.28.155.212@KRBTEST.COM
I20260809 13:06:04.629067 18113 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:44725
I20260809 13:06:04.629158 18309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:44725 every 8 connection(s)
I20260809 13:06:04.631289 18113 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:06:04.635380 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 18113
I20260809 13:06:04.665060 18316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:04.637352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46162 (local address 127.28.155.254:46491)
0809 13:06:04.638172 (+ 820us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:04.638178 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:04.638197 (+ 19us) server_negotiation.cc:407] Connection header received
0809 13:06:04.638269 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:04.638276 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:04.638391 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:04.638552 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:04.642820 (+ 4268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:04.648623 (+ 5803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:04.651949 (+ 3326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:04.652691 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:04.652817 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:04.656852 (+ 4035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:04.656859 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:04.656863 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:04.656918 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:04.660660 (+ 3742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:04.661685 (+ 1025us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:04.661691 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:04.661695 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:04.661855 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:04.662366 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:04.662372 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:04.662375 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:04.662772 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:04.663034 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:04.664347 (+ 1313us) server_negotiation.cc:299] Negotiation successful
0809 13:06:04.664647 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":707,"thread_start_us":4690,"threads_started":1}
Aug 09 13:06:04 dist-test-slave-jq4t krb5kdc[16053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280764, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:06:04.687986 18315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:04.637663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:45881 (local address 127.28.155.254:46491)
0809 13:06:04.642311 (+ 4648us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:04.642317 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:04.648527 (+ 6210us) server_negotiation.cc:407] Connection header received
0809 13:06:04.650439 (+ 1912us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:04.650445 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:04.650558 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:04.650718 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:04.663857 (+ 13139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:04.665188 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:04.668668 (+ 3480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:04.669324 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:04.669445 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:04.675902 (+ 6457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:04.675910 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:04.675915 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:04.675972 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:04.679678 (+ 3706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:04.684343 (+ 4665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:04.684350 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:04.684354 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:04.684890 (+ 536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:04.685546 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:04.685552 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:04.685556 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:04.685973 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:04.686110 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:04.687258 (+ 1148us) server_negotiation.cc:299] Negotiation successful
0809 13:06:04.687565 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4534,"thread_start_us":283,"threads_started":1}
I20260809 13:06:04.690474 18317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:04.638029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:46491 (local address 127.28.155.195:45881)
0809 13:06:04.645965 (+ 7936us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:04.646038 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:04.649980 (+ 3942us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:04.661807 (+ 11827us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:04.661823 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:04.662579 (+ 756us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:06:04.663585 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:04.663616 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:04.665446 (+ 1830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:04.665452 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:04.668465 (+ 3013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:04.668503 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:04.669894 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:04.669905 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:04.670232 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:04.672737 (+ 2505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:06:04.672777 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:06:04.675584 (+ 2807us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:06:04.679846 (+ 4262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:04.679856 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:04.679876 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:04.680563 (+ 687us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:04.685018 (+ 4455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:04.685024 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:04.685028 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:04.685375 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:04.686227 (+ 852us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:06:04.686236 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:06:04.686756 (+ 520us) client_negotiation.cc:769] Sending connection context
0809 13:06:04.688337 (+ 1581us) client_negotiation.cc:240] Negotiation successful
0809 13:06:04.689047 (+ 710us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6930,"thread_start_us":6911,"threads_started":1}
I20260809 13:06:04.693281 18311 heartbeater.cc:347] Connected to a master server at 127.28.155.254:46491
I20260809 13:06:04.693687 18311 heartbeater.cc:464] Registering TS with master...
I20260809 13:06:04.694702 18311 heartbeater.cc:511] Master 127.28.155.254:46491 requested a full tablet report, sending...
I20260809 13:06:04.697568 17590 ts_manager.cc:194] Registered new tserver with Master: c3635ba6aed547139fe56e672a5c75cf (127.28.155.195:44725)
I20260809 13:06:04.698817 17590 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.195@KRBTEST.COM'} at 127.28.155.195:45881
I20260809 13:06:04.709707 29295 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 13:06:04.742667 18315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:04.714945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46172 (local address 127.28.155.254:46491)
0809 13:06:04.715202 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:04.715212 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:04.721141 (+ 5929us) server_negotiation.cc:407] Connection header received
0809 13:06:04.721390 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:04.721395 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:04.721505 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:04.721637 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:04.725636 (+ 3999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:04.726780 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:04.729264 (+ 2484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:04.729965 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:04.730063 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:04.734238 (+ 4175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:04.734246 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:04.734251 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:04.734303 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:04.738284 (+ 3981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:04.739492 (+ 1208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:04.739499 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:04.739503 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:04.739680 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:04.740495 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:04.740501 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:04.740504 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:04.740966 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:04.741308 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:04.742038 (+ 730us) server_negotiation.cc:299] Negotiation successful
0809 13:06:04.742297 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260809 13:06:04.749691 17590 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46172:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 13:06:04.762470 17590 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:06:04.869977 18339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:04.792559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:33681 (local address 127.0.0.1:58938)
0809 13:06:04.848255 (+ 55696us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:04.848329 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:04.848702 (+ 373us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:04.860528 (+ 11826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:04.860536 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:04.860575 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:06:04.861007 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:04.861025 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:04.863662 (+ 2637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:04.863670 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:04.866063 (+ 2393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:04.866078 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:04.868902 (+ 2824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:04.868911 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:04.869129 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:04.869199 (+ 70us) client_negotiation.cc:769] Sending connection context
0809 13:06:04.869323 (+ 124us) client_negotiation.cc:240] Negotiation successful
0809 13:06:04.869544 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55218,"mutex_wait_us":1,"thread_start_us":64896,"threads_started":1}
I20260809 13:06:04.870782 18336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:04.792774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58938 (local address 127.28.155.193:33681)
0809 13:06:04.859588 (+ 66814us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:04.859598 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:04.859631 (+ 33us) server_negotiation.cc:407] Connection header received
0809 13:06:04.859736 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:04.859743 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:04.859957 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:04.860168 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:06:04.861262 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:04.863468 (+ 2206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:04.866274 (+ 2806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:04.868256 (+ 1982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:04.868538 (+ 282us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:04.868726 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:04.870240 (+ 1514us) server_negotiation.cc:299] Negotiation successful
0809 13:06:04.870424 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66633,"thread_start_us":66446,"threads_started":1}
I20260809 13:06:04.874887 18333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:04.802911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:33593 (local address 127.0.0.1:48212)
0809 13:06:04.853708 (+ 50797us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:04.853727 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:04.857851 (+ 4124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:04.860191 (+ 2340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:04.860200 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:04.860233 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:06:04.860721 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:04.860735 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:04.866943 (+ 6208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:04.866948 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:04.869024 (+ 2076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:04.869037 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:04.874045 (+ 5008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:04.874053 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:04.874250 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:04.874289 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 13:06:04.874388 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 13:06:04.874540 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50673,"thread_start_us":46770,"threads_started":1}
I20260809 13:06:04.875737 18341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:04.803509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48212 (local address 127.28.155.194:33593)
0809 13:06:04.849451 (+ 45942us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:04.849461 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:04.853835 (+ 4374us) server_negotiation.cc:407] Connection header received
0809 13:06:04.859465 (+ 5630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:04.859473 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:04.859711 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:04.859903 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:06:04.860953 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:04.866745 (+ 5792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:04.870392 (+ 3647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:04.873437 (+ 3045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:04.873669 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:04.873861 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:04.875187 (+ 1326us) server_negotiation.cc:299] Negotiation successful
0809 13:06:04.875373 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45768,"thread_start_us":45953,"threads_started":1}
I20260809 13:06:04.876178 17780 tablet_service.cc:1467] Processing CreateTablet for tablet 6e97240110a9456c998ea0fae907d619 (DEFAULT_TABLE table=test-table [id=89eea3d420f84ebe84c2b4709c2f4157]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:06:04.878130 17780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e97240110a9456c998ea0fae907d619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:06:04.880133 18337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:04.794702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:44725 (local address 127.0.0.1:35824)
0809 13:06:04.852316 (+ 57614us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:04.852337 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:04.852499 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:04.862615 (+ 10116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:04.862620 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:04.862648 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:06:04.863023 (+ 375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:04.863035 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:04.865167 (+ 2132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:04.865173 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:04.874451 (+ 9278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:04.874467 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:04.877690 (+ 3223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:04.877698 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:04.877886 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:04.879489 (+ 1603us) client_negotiation.cc:769] Sending connection context
0809 13:06:04.879580 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 13:06:04.879738 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57483,"mutex_wait_us":3226,"thread_start_us":57886,"threads_started":1}
I20260809 13:06:04.879860 18007 tablet_service.cc:1467] Processing CreateTablet for tablet 6e97240110a9456c998ea0fae907d619 (DEFAULT_TABLE table=test-table [id=89eea3d420f84ebe84c2b4709c2f4157]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:06:04.881376 18338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:04.795097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35824 (local address 127.28.155.195:44725)
0809 13:06:04.854385 (+ 59288us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:04.854394 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:04.854426 (+ 32us) server_negotiation.cc:407] Connection header received
0809 13:06:04.854539 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:04.854547 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:04.858311 (+ 3764us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:04.858597 (+ 286us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:06:04.863242 (+ 4645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:04.864983 (+ 1741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:04.874675 (+ 9692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:04.876900 (+ 2225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:04.877304 (+ 404us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:04.877514 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:04.880798 (+ 3284us) server_negotiation.cc:299] Negotiation successful
0809 13:06:04.880995 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59097,"thread_start_us":58963,"threads_started":1}
I20260809 13:06:04.881371 18007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e97240110a9456c998ea0fae907d619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:06:04.885391 18202 tablet_service.cc:1467] Processing CreateTablet for tablet 6e97240110a9456c998ea0fae907d619 (DEFAULT_TABLE table=test-table [id=89eea3d420f84ebe84c2b4709c2f4157]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:06:04.887151 18202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e97240110a9456c998ea0fae907d619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:06:04.896201 18351 tablet_bootstrap.cc:492] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f: Bootstrap starting.
I20260809 13:06:04.898564 18353 tablet_bootstrap.cc:492] T 6e97240110a9456c998ea0fae907d619 P f9d18b60a2984d93a5239545f331a684: Bootstrap starting.
I20260809 13:06:04.900156 18351 tablet_bootstrap.cc:654] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f: Neither blocks nor log segments found. Creating new log.
I20260809 13:06:04.901585 18351 log.cc:824] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f: Log is configured to *not* fsync() on all Append() calls
I20260809 13:06:04.902339 18353 tablet_bootstrap.cc:654] T 6e97240110a9456c998ea0fae907d619 P f9d18b60a2984d93a5239545f331a684: Neither blocks nor log segments found. Creating new log.
I20260809 13:06:04.903474 18353 log.cc:824] T 6e97240110a9456c998ea0fae907d619 P f9d18b60a2984d93a5239545f331a684: Log is configured to *not* fsync() on all Append() calls
I20260809 13:06:04.904031 18356 tablet_bootstrap.cc:492] T 6e97240110a9456c998ea0fae907d619 P c3635ba6aed547139fe56e672a5c75cf: Bootstrap starting.
I20260809 13:06:04.905509 18351 tablet_bootstrap.cc:492] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f: No bootstrap required, opened a new log
I20260809 13:06:04.905818 18351 ts_tablet_manager.cc:1397] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.003s
I20260809 13:06:04.907825 18356 tablet_bootstrap.cc:654] T 6e97240110a9456c998ea0fae907d619 P c3635ba6aed547139fe56e672a5c75cf: Neither blocks nor log segments found. Creating new log.
I20260809 13:06:04.907902 18353 tablet_bootstrap.cc:492] T 6e97240110a9456c998ea0fae907d619 P f9d18b60a2984d93a5239545f331a684: No bootstrap required, opened a new log
I20260809 13:06:04.908177 18353 ts_tablet_manager.cc:1397] T 6e97240110a9456c998ea0fae907d619 P f9d18b60a2984d93a5239545f331a684: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260809 13:06:04.909029 18356 log.cc:824] T 6e97240110a9456c998ea0fae907d619 P c3635ba6aed547139fe56e672a5c75cf: Log is configured to *not* fsync() on all Append() calls
I20260809 13:06:04.912307 18356 tablet_bootstrap.cc:492] T 6e97240110a9456c998ea0fae907d619 P c3635ba6aed547139fe56e672a5c75cf: No bootstrap required, opened a new log
I20260809 13:06:04.912631 18356 ts_tablet_manager.cc:1397] T 6e97240110a9456c998ea0fae907d619 P c3635ba6aed547139fe56e672a5c75cf: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260809 13:06:04.913347 18105 heartbeater.cc:503] Master 127.28.155.254:46491 was elected leader, sending a full tablet report...
I20260809 13:06:04.917137 18351 raft_consensus.cc:348] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d18b60a2984d93a5239545f331a684" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33681 } } peers { permanent_uuid: "c3635ba6aed547139fe56e672a5c75cf" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44725 } } peers { permanent_uuid: "f71770e4eb1c4606ac2848c7e15a2a6f" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33593 } }
I20260809 13:06:04.917615 18351 raft_consensus.cc:374] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:06:04.917711 18351 raft_consensus.cc:729] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f71770e4eb1c4606ac2848c7e15a2a6f, State: Initialized, Role: FOLLOWER
I20260809 13:06:04.918357 18351 consensus_queue.cc:260] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d18b60a2984d93a5239545f331a684" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33681 } } peers { permanent_uuid: "c3635ba6aed547139fe56e672a5c75cf" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44725 } } peers { permanent_uuid: "f71770e4eb1c4606ac2848c7e15a2a6f" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33593 } }
I20260809 13:06:04.919528 18353 raft_consensus.cc:348] T 6e97240110a9456c998ea0fae907d619 P f9d18b60a2984d93a5239545f331a684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d18b60a2984d93a5239545f331a684" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33681 } } peers { permanent_uuid: "c3635ba6aed547139fe56e672a5c75cf" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44725 } } peers { permanent_uuid: "f71770e4eb1c4606ac2848c7e15a2a6f" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33593 } }
I20260809 13:06:04.919966 18353 raft_consensus.cc:374] T 6e97240110a9456c998ea0fae907d619 P f9d18b60a2984d93a5239545f331a684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:06:04.920069 18353 raft_consensus.cc:729] T 6e97240110a9456c998ea0fae907d619 P f9d18b60a2984d93a5239545f331a684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9d18b60a2984d93a5239545f331a684, State: Initialized, Role: FOLLOWER
I20260809 13:06:04.920306 18351 ts_tablet_manager.cc:1428] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20260809 13:06:04.920783 18353 consensus_queue.cc:260] T 6e97240110a9456c998ea0fae907d619 P f9d18b60a2984d93a5239545f331a684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d18b60a2984d93a5239545f331a684" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33681 } } peers { permanent_uuid: "c3635ba6aed547139fe56e672a5c75cf" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44725 } } peers { permanent_uuid: "f71770e4eb1c4606ac2848c7e15a2a6f" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33593 } }
I20260809 13:06:04.921893 17874 heartbeater.cc:503] Master 127.28.155.254:46491 was elected leader, sending a full tablet report...
I20260809 13:06:04.922501 18353 ts_tablet_manager.cc:1428] T 6e97240110a9456c998ea0fae907d619 P f9d18b60a2984d93a5239545f331a684: Time spent starting tablet: real 0.014s user 0.008s sys 0.007s
I20260809 13:06:04.924880 18356 raft_consensus.cc:348] T 6e97240110a9456c998ea0fae907d619 P c3635ba6aed547139fe56e672a5c75cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d18b60a2984d93a5239545f331a684" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33681 } } peers { permanent_uuid: "c3635ba6aed547139fe56e672a5c75cf" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44725 } } peers { permanent_uuid: "f71770e4eb1c4606ac2848c7e15a2a6f" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33593 } }
I20260809 13:06:04.925328 18356 raft_consensus.cc:374] T 6e97240110a9456c998ea0fae907d619 P c3635ba6aed547139fe56e672a5c75cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:06:04.925443 18356 raft_consensus.cc:729] T 6e97240110a9456c998ea0fae907d619 P c3635ba6aed547139fe56e672a5c75cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3635ba6aed547139fe56e672a5c75cf, State: Initialized, Role: FOLLOWER
I20260809 13:06:04.926055 18356 consensus_queue.cc:260] T 6e97240110a9456c998ea0fae907d619 P c3635ba6aed547139fe56e672a5c75cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d18b60a2984d93a5239545f331a684" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33681 } } peers { permanent_uuid: "c3635ba6aed547139fe56e672a5c75cf" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44725 } } peers { permanent_uuid: "f71770e4eb1c4606ac2848c7e15a2a6f" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33593 } }
I20260809 13:06:04.927280 18311 heartbeater.cc:503] Master 127.28.155.254:46491 was elected leader, sending a full tablet report...
I20260809 13:06:04.927933 18356 ts_tablet_manager.cc:1428] T 6e97240110a9456c998ea0fae907d619 P c3635ba6aed547139fe56e672a5c75cf: Time spent starting tablet: real 0.015s user 0.013s sys 0.000s
I20260809 13:06:04.938818 18359 raft_consensus.cc:482] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:06:04.939083 18359 raft_consensus.cc:504] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d18b60a2984d93a5239545f331a684" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33681 } } peers { permanent_uuid: "c3635ba6aed547139fe56e672a5c75cf" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44725 } } peers { permanent_uuid: "f71770e4eb1c4606ac2848c7e15a2a6f" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33593 } }
I20260809 13:06:04.941576 18359 leader_election.cc:288] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9d18b60a2984d93a5239545f331a684 (127.28.155.193:33681), c3635ba6aed547139fe56e672a5c75cf (127.28.155.195:44725)
I20260809 13:06:04.950320 18338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:04.941359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:57743 (local address 127.28.155.195:44725)
0809 13:06:04.941747 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:04.941755 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:04.942662 (+ 907us) server_negotiation.cc:407] Connection header received
0809 13:06:04.942873 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:04.942877 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:04.942957 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:04.943061 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:06:04.943726 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:04.944616 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:04.947785 (+ 3169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:04.949072 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:04.949236 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:04.949312 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:04.949907 (+ 595us) server_negotiation.cc:299] Negotiation successful
0809 13:06:04.950044 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206}
I20260809 13:06:04.950614 18336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:04.941281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:57235 (local address 127.28.155.193:33681)
0809 13:06:04.941530 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:04.941540 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:04.942490 (+ 950us) server_negotiation.cc:407] Connection header received
0809 13:06:04.942675 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:04.942681 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:04.942763 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:04.942858 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:06:04.943546 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:04.944611 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:04.947791 (+ 3180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:04.949072 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:04.949237 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:04.949312 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:04.949907 (+ 595us) server_negotiation.cc:299] Negotiation successful
0809 13:06:04.950096 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 13:06:04.950713 18363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:04.941076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:33681 (local address 127.28.155.194:57235)
0809 13:06:04.942370 (+ 1294us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:04.942389 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:04.942518 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:04.942892 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:04.942896 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:04.942920 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:06:04.943379 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:04.943393 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:04.944756 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:04.944762 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:04.947598 (+ 2836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:04.947615 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:04.949345 (+ 1730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:04.949357 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:04.949648 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:04.949756 (+ 108us) client_negotiation.cc:769] Sending connection context
0809 13:06:04.949859 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 13:06:04.950053 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1179,"mutex_wait_us":315,"thread_start_us":908,"threads_started":1}
I20260809 13:06:04.950868 18364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:04.941322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:44725 (local address 127.28.155.194:57743)
0809 13:06:04.942556 (+ 1234us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:04.942588 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:04.942722 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:04.943095 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:04.943098 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:04.943121 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:06:04.943540 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:04.943552 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:04.944757 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:04.944762 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:04.947597 (+ 2835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:04.947615 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:04.949375 (+ 1760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:04.949380 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:04.949653 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:04.949757 (+ 104us) client_negotiation.cc:769] Sending connection context
0809 13:06:04.949859 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 13:06:04.950103 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1091,"mutex_wait_us":394,"thread_start_us":763,"threads_started":1}
I20260809 13:06:04.951897 17810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e97240110a9456c998ea0fae907d619" candidate_uuid: "f71770e4eb1c4606ac2848c7e15a2a6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9d18b60a2984d93a5239545f331a684" is_pre_election: true
I20260809 13:06:04.952246 18241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e97240110a9456c998ea0fae907d619" candidate_uuid: "f71770e4eb1c4606ac2848c7e15a2a6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3635ba6aed547139fe56e672a5c75cf" is_pre_election: true
I20260809 13:06:04.952466 17810 raft_consensus.cc:2454] T 6e97240110a9456c998ea0fae907d619 P f9d18b60a2984d93a5239545f331a684 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f71770e4eb1c4606ac2848c7e15a2a6f in term 0.
I20260809 13:06:04.952811 18241 raft_consensus.cc:2454] T 6e97240110a9456c998ea0fae907d619 P c3635ba6aed547139fe56e672a5c75cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f71770e4eb1c4606ac2848c7e15a2a6f in term 0.
I20260809 13:06:04.953387 17931 leader_election.cc:302] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f71770e4eb1c4606ac2848c7e15a2a6f, f9d18b60a2984d93a5239545f331a684; no voters:
I20260809 13:06:04.953826 18359 raft_consensus.cc:2781] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:06:04.953989 18359 raft_consensus.cc:482] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:06:04.954107 18359 raft_consensus.cc:3037] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:06:04.956432 18359 raft_consensus.cc:504] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d18b60a2984d93a5239545f331a684" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33681 } } peers { permanent_uuid: "c3635ba6aed547139fe56e672a5c75cf" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44725 } } peers { permanent_uuid: "f71770e4eb1c4606ac2848c7e15a2a6f" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33593 } }
I20260809 13:06:04.957166 18359 leader_election.cc:288] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f [CANDIDATE]: Term 1 election: Requested vote from peers f9d18b60a2984d93a5239545f331a684 (127.28.155.193:33681), c3635ba6aed547139fe56e672a5c75cf (127.28.155.195:44725)
I20260809 13:06:04.957674 18241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e97240110a9456c998ea0fae907d619" candidate_uuid: "f71770e4eb1c4606ac2848c7e15a2a6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3635ba6aed547139fe56e672a5c75cf"
I20260809 13:06:04.957681 17810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e97240110a9456c998ea0fae907d619" candidate_uuid: "f71770e4eb1c4606ac2848c7e15a2a6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9d18b60a2984d93a5239545f331a684"
I20260809 13:06:04.957888 18241 raft_consensus.cc:3037] T 6e97240110a9456c998ea0fae907d619 P c3635ba6aed547139fe56e672a5c75cf [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:06:04.957901 17810 raft_consensus.cc:3037] T 6e97240110a9456c998ea0fae907d619 P f9d18b60a2984d93a5239545f331a684 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:06:04.960278 18241 raft_consensus.cc:2454] T 6e97240110a9456c998ea0fae907d619 P c3635ba6aed547139fe56e672a5c75cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f71770e4eb1c4606ac2848c7e15a2a6f in term 1.
I20260809 13:06:04.960388 17810 raft_consensus.cc:2454] T 6e97240110a9456c998ea0fae907d619 P f9d18b60a2984d93a5239545f331a684 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f71770e4eb1c4606ac2848c7e15a2a6f in term 1.
I20260809 13:06:04.961009 17931 leader_election.cc:302] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f71770e4eb1c4606ac2848c7e15a2a6f, f9d18b60a2984d93a5239545f331a684; no voters:
I20260809 13:06:04.961373 18359 raft_consensus.cc:2781] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:06:04.961864 18359 raft_consensus.cc:686] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f [term 1 LEADER]: Becoming Leader. State: Replica: f71770e4eb1c4606ac2848c7e15a2a6f, State: Running, Role: LEADER
I20260809 13:06:04.962402 18359 consensus_queue.cc:237] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d18b60a2984d93a5239545f331a684" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33681 } } peers { permanent_uuid: "c3635ba6aed547139fe56e672a5c75cf" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44725 } } peers { permanent_uuid: "f71770e4eb1c4606ac2848c7e15a2a6f" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33593 } }
I20260809 13:06:04.967609 17589 catalog_manager.cc:5495] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f reported cstate change: term changed from 0 to 1, leader changed from <none> to f71770e4eb1c4606ac2848c7e15a2a6f (127.28.155.194). New cstate: current_term: 1 leader_uuid: "f71770e4eb1c4606ac2848c7e15a2a6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9d18b60a2984d93a5239545f331a684" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3635ba6aed547139fe56e672a5c75cf" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f71770e4eb1c4606ac2848c7e15a2a6f" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 33593 } health_report { overall_health: HEALTHY } } }
I20260809 13:06:05.003225 18341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:04.997897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48228 (local address 127.28.155.194:33593)
0809 13:06:04.998101 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:04.998105 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:04.998124 (+ 19us) server_negotiation.cc:407] Connection header received
0809 13:06:04.998303 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:04.998307 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:04.998404 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:04.998555 (+ 151us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:06:04.998904 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:04.999686 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:05.001156 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:05.001571 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:05.001668 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:05.002146 (+ 478us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:06:05.002726 (+ 580us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:06:05.002839 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:05.002941 (+ 102us) server_negotiation.cc:299] Negotiation successful
0809 13:06:05.003016 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 13:06:05.012676 18241 raft_consensus.cc:1261] T 6e97240110a9456c998ea0fae907d619 P c3635ba6aed547139fe56e672a5c75cf [term 1 FOLLOWER]: Refusing update from remote peer f71770e4eb1c4606ac2848c7e15a2a6f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:06:05.012708 17810 raft_consensus.cc:1261] T 6e97240110a9456c998ea0fae907d619 P f9d18b60a2984d93a5239545f331a684 [term 1 FOLLOWER]: Refusing update from remote peer f71770e4eb1c4606ac2848c7e15a2a6f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:06:05.013760 18359 consensus_queue.cc:1035] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9d18b60a2984d93a5239545f331a684" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:06:05.014087 18367 consensus_queue.cc:1035] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3635ba6aed547139fe56e672a5c75cf" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:06:05.031752 18373 mvcc.cc:205] Tried to move back new op lower bound from 7316606013479223296 to 7316606013290074112. Current Snapshot: MvccSnapshot[applied={T|T < 7316606013479223296}]
I20260809 13:06:05.044150 17590 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46172:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:06:05.044445 17590 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46172:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:06:05.048352 17590 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 391a73bae89c444cba478f7291353143: Sending DeleteTablet for 3 replicas of tablet 6e97240110a9456c998ea0fae907d619
I20260809 13:06:05.049638 17780 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e97240110a9456c998ea0fae907d619 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:06:05 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:58938
I20260809 13:06:05.049876 18007 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e97240110a9456c998ea0fae907d619 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:06:05 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:48212
I20260809 13:06:05.050002 18202 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e97240110a9456c998ea0fae907d619 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:06:05 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:35824
I20260809 13:06:05.058656 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 17647
I20260809 13:06:05.069479 18385 tablet_replica.cc:330] T 6e97240110a9456c998ea0fae907d619 P f9d18b60a2984d93a5239545f331a684: stopping tablet replica
I20260809 13:06:05.070200 18385 raft_consensus.cc:2229] T 6e97240110a9456c998ea0fae907d619 P f9d18b60a2984d93a5239545f331a684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:06:05.070955 18385 raft_consensus.cc:2258] T 6e97240110a9456c998ea0fae907d619 P f9d18b60a2984d93a5239545f331a684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:06:05.072052 18386 tablet_replica.cc:330] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f: stopping tablet replica
I20260809 13:06:05.072355 18387 tablet_replica.cc:330] T 6e97240110a9456c998ea0fae907d619 P c3635ba6aed547139fe56e672a5c75cf: stopping tablet replica
I20260809 13:06:05.072573 18386 raft_consensus.cc:2229] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f [term 1 LEADER]: Raft consensus shutting down.
I20260809 13:06:05.072817 18387 raft_consensus.cc:2229] T 6e97240110a9456c998ea0fae907d619 P c3635ba6aed547139fe56e672a5c75cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:06:05.073313 18386 raft_consensus.cc:2258] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:06:05.073362 18387 raft_consensus.cc:2258] T 6e97240110a9456c998ea0fae907d619 P c3635ba6aed547139fe56e672a5c75cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:06:05.075526 18386 ts_tablet_manager.cc:1905] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:06:05.075618 18387 ts_tablet_manager.cc:1905] T 6e97240110a9456c998ea0fae907d619 P c3635ba6aed547139fe56e672a5c75cf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:06:05.080343 18385 ts_tablet_manager.cc:1905] T 6e97240110a9456c998ea0fae907d619 P f9d18b60a2984d93a5239545f331a684: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:06:05.082515 18336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:05.060018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58950 (local address 127.28.155.193:33681)
0809 13:06:05.060284 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:05.060295 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:05.060331 (+ 36us) server_negotiation.cc:407] Connection header received
0809 13:06:05.060558 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:05.060568 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:05.060682 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:05.060819 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:05.063493 (+ 2674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:05.065152 (+ 1659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:05.067118 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:05.068066 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:05.068241 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:05.074453 (+ 6212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:05.074468 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:05.074490 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:05.074541 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:05.078783 (+ 4242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:05.079816 (+ 1033us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:05.079825 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:05.079828 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:05.080029 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:05.080671 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:05.080678 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:05.080682 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:05.081148 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:05.081485 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:05.081839 (+ 354us) server_negotiation.cc:299] Negotiation successful
0809 13:06:05.082106 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 13:06:05.083308 17869 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:06:05.083357 18386 ts_tablet_manager.cc:1918] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:06:05.083478 18387 ts_tablet_manager.cc:1918] T 6e97240110a9456c998ea0fae907d619 P c3635ba6aed547139fe56e672a5c75cf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:06:05.083582 18386 log.cc:1196] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-1/wal/wals/6e97240110a9456c998ea0fae907d619
I20260809 13:06:05.083681 18387 log.cc:1196] T 6e97240110a9456c998ea0fae907d619 P c3635ba6aed547139fe56e672a5c75cf: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786280548611909-29295-0/minicluster-data/ts-2/wal/wals/6e97240110a9456c998ea0fae907d619
I20260809 13:06:05.084173 18386 ts_tablet_manager.cc:1939] T 6e97240110a9456c998ea0fae907d619 P f71770e4eb1c4606ac2848c7e15a2a6f: Deleting consensus metadata
I20260809 13:06:05.084316 18387 ts_tablet_manager.cc:1939] T 6e97240110a9456c998ea0fae907d619 P c3635ba6aed547139fe56e672a5c75cf: Deleting consensus metadata
I20260809 13:06:05.086297 17575 catalog_manager.cc:4841] TS f71770e4eb1c4606ac2848c7e15a2a6f (127.28.155.194:33593): tablet 6e97240110a9456c998ea0fae907d619 (table test-table [id=89eea3d420f84ebe84c2b4709c2f4157]) successfully deleted
I20260809 13:06:05.086575 17572 catalog_manager.cc:4841] TS c3635ba6aed547139fe56e672a5c75cf (127.28.155.195:44725): tablet 6e97240110a9456c998ea0fae907d619 (table test-table [id=89eea3d420f84ebe84c2b4709c2f4157]) successfully deleted
I20260809 13:06:05.180130 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 17647
W20260809 13:06:05.200160 17573 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.155.193:33681 (error 108)
I20260809 13:06:05.201081 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 17875
I20260809 13:06:05.202315 18337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:05.201683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:33681 (local address 127.0.0.1:58956)
0809 13:06:05.201966 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:05.202106 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:33681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154}
W20260809 13:06:05.202745 17573 catalog_manager.cc:4584] TS f9d18b60a2984d93a5239545f331a684 (127.28.155.193:33681): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6e97240110a9456c998ea0fae907d619: Network error: Client connection negotiation failed: client connection to 127.28.155.193:33681: connect: Connection refused (error 111)
I20260809 13:06:05.218614 18341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:05.201900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48232 (local address 127.28.155.194:33593)
0809 13:06:05.202126 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:05.202133 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:05.202241 (+ 108us) server_negotiation.cc:407] Connection header received
0809 13:06:05.202458 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:05.202465 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:05.202557 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:05.202677 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:05.204769 (+ 2092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:05.205664 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:05.207632 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:05.208195 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:05.208306 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:05.211945 (+ 3639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:05.211960 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:05.211977 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:05.212019 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:05.215417 (+ 3398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:05.216203 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:05.216211 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:05.216213 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:05.216386 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:05.216854 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:05.216859 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:05.216862 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:05.217286 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:05.217629 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:05.217968 (+ 339us) server_negotiation.cc:299] Negotiation successful
0809 13:06:05.218234 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260809 13:06:05.219343 18099 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:06:05.256822 18337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:05.256167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:33681 (local address 127.0.0.1:58964)
0809 13:06:05.256448 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:05.256606 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:33681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260809 13:06:05.258036 18337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:05.257625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:33681 (local address 127.0.0.1:58966)
0809 13:06:05.257786 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:05.257890 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:33681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 13:06:05.318775 18337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:05.318159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:33681 (local address 127.0.0.1:50064)
0809 13:06:05.318416 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:05.318535 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:33681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260809 13:06:05.319938 18337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:05.319524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:33681 (local address 127.0.0.1:50074)
0809 13:06:05.319705 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:05.319795 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:33681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260809 13:06:05.336464 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 17875
I20260809 13:06:05.363595 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 18113
I20260809 13:06:05.377877 18338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:05.364536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50666 (local address 127.28.155.195:44725)
0809 13:06:05.364709 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:05.364713 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:05.364732 (+ 19us) server_negotiation.cc:407] Connection header received
0809 13:06:05.364840 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:05.364844 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:05.364921 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:05.365030 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:05.366425 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:05.367344 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:05.368875 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:05.369295 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:05.369392 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:05.372287 (+ 2895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:05.372301 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:05.372317 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:05.372347 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:05.375196 (+ 2849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:05.375886 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:05.375893 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:05.375895 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:05.376048 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:05.376399 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:05.376403 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:05.376405 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:05.376902 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:05.377150 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:05.377436 (+ 286us) server_negotiation.cc:299] Negotiation successful
0809 13:06:05.377608 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 13:06:05.378640 18305 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:06:05.400632 18337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:05.400034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:33681 (local address 127.0.0.1:50076)
0809 13:06:05.400272 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:05.400380 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:33681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260809 13:06:05.401808 18337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:05.401411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:33681 (local address 127.0.0.1:50086)
0809 13:06:05.401613 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:05.401688 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:33681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
I20260809 13:06:05.490417 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 18113
I20260809 13:06:05.515368 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 17543
I20260809 13:06:05.516844 17634 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:06:05.639968 18337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:05.639133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:33681 (local address 127.0.0.1:50096)
0809 13:06:05.639402 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:05.639571 (+ 169us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:33681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260809 13:06:05.640080 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 17543
I20260809 13:06:05.674319 29295 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 13:06:06.020691 29295 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 13:06:06.020949 29295 mini_ranger.cc:66] Stopping Ranger...
I20260809 13:06:06.377372 29295 mini_ranger.cc:68] Stopped Ranger
2026-08-09 13:06:06.377 UTC [16099] LOG: received smart shutdown request
2026-08-09 13:06:06.381 UTC [16099] LOG: background worker "logical replication launcher" (PID 16109) exited with exit code 1
2026-08-09 13:06:06.381 UTC [16103] LOG: shutting down
2026-08-09 13:06:06.571 UTC [16099] LOG: database system is shut down
2026-08-09T13:06:06Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (56319 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:06:06 dist-test-slave-jq4t krb5kdc[18413](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:06:06 dist-test-slave-jq4t krb5kdc[18413](info): set up 2 sockets
Aug 09 13:06:06 dist-test-slave-jq4t krb5kdc[18413](info): commencing operation
krb5kdc: starting...
W20260809 13:06:08.047361 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.293s user 0.003s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:06:08 dist-test-slave-jq4t krb5kdc[18413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280768, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:06:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:06:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
I20260809 13:06:08.362651 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:39845
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:44113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:39845,127.28.155.253:38789,127.28.155.252:41101
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:06:08.721064 18431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:06:08.721393 18431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:06:08.721496 18431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:06:08.729210 18431 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:06:08.729339 18431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:06:08.729430 18431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:06:08.729545 18431 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:06:08.729609 18431 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:06:08.739975 18431 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:44113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:39845,127.28.155.253:38789,127.28.155.252:41101
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:39845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:06:08.741605 18431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:06:08.743023 18431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:06:08.756208 18438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:08.756227 18439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:08.756896 18442 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:06:08.757128 18431 server_base.cc:1034] running on GCE node
I20260809 13:06:08.758067 18431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:06:08.759601 18431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:06:08.760881 18431 hybrid_clock.cc:648] HybridClock initialized: now 1786280768760817 us; error 70 us; skew 500 ppm
I20260809 13:06:08.761308 18431 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:06:08 dist-test-slave-jq4t krb5kdc[18413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280768, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:06:08.767781 18431 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:06:08.769622 18431 webserver.cc:460] Webserver started at http://127.28.155.254:41599/ using document root <none> and password file <none>
I20260809 13:06:08.770460 18431 fs_manager.cc:359] Metadata directory not provided
I20260809 13:06:08.770629 18431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:06:08.771005 18431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:06:08.774509 18431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "9c85edb9bd89406ab873f6077f3f931d"
format_stamp: "Formatted at 2026-08-09 13:06:08 on dist-test-slave-jq4t"
server_key: "d43564311ae46b96de352d73204d591a"
server_key_iv: "a29bd3721072da42a87174f05937d4f7"
server_key_version: "encryptionkey@0"
I20260809 13:06:08.775416 18431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "9c85edb9bd89406ab873f6077f3f931d"
format_stamp: "Formatted at 2026-08-09 13:06:08 on dist-test-slave-jq4t"
server_key: "d43564311ae46b96de352d73204d591a"
server_key_iv: "a29bd3721072da42a87174f05937d4f7"
server_key_version: "encryptionkey@0"
I20260809 13:06:08.781033 18431 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 13:06:08.784615 18451 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:08.786043 18431 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:06:08.786257 18431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "9c85edb9bd89406ab873f6077f3f931d"
format_stamp: "Formatted at 2026-08-09 13:06:08 on dist-test-slave-jq4t"
server_key: "d43564311ae46b96de352d73204d591a"
server_key_iv: "a29bd3721072da42a87174f05937d4f7"
server_key_version: "encryptionkey@0"
I20260809 13:06:08.786480 18431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:06:08.799167 18431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:06:08.803812 18431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:06:08.804121 18431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:06:08.826545 18431 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:39845
I20260809 13:06:08.826566 18533 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:39845 every 8 connection(s)
I20260809 13:06:08.828013 18431 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:06:08.832103 18534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:06:08.834051 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 18431
I20260809 13:06:08.834309 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:06:08.835008 29295 external_mini_cluster.cc:1428] Setting key fe1f4e1b30ce41bcf41f07590a677330
I20260809 13:06:08.839054 18534 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.254" port: 39845 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 13:06:08 dist-test-slave-jq4t krb5kdc[18413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280768, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:06:08.867043 18536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:08.842215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:39845 (local address 127.0.0.1:56116)
0809 13:06:08.843132 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:08.843181 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:08.846668 (+ 3487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:08.848216 (+ 1548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:08.848222 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:08.848876 (+ 654us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:06:08.849260 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:08.849278 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:08.851741 (+ 2463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:08.851745 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:08.852971 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:08.852988 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:08.854373 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:08.854378 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:08.854571 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:08.855305 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:06:08.855340 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:06:08.857833 (+ 2493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:06:08.862597 (+ 4764us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:08.862612 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:08.862628 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:08.863058 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:08.863635 (+ 577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:08.863638 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:08.863640 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:08.863810 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:08.865023 (+ 1213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:06:08.865030 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:06:08.865239 (+ 209us) client_negotiation.cc:769] Sending connection context
0809 13:06:08.865479 (+ 240us) client_negotiation.cc:240] Negotiation successful
0809 13:06:08.865922 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":621,"thread_start_us":399,"threads_started":1}
I20260809 13:06:08.867105 18537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:08.843646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56116 (local address 127.28.155.254:39845)
0809 13:06:08.847290 (+ 3644us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:08.847301 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:08.847348 (+ 47us) server_negotiation.cc:407] Connection header received
0809 13:06:08.847555 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:08.847563 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:08.847926 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:08.848195 (+ 269us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:08.849479 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:08.851556 (+ 2077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:08.853134 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:08.854146 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:08.854341 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:08.858105 (+ 3764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:08.858118 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:08.858136 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:08.858188 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:08.862373 (+ 4185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:08.863236 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:08.863250 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:08.863256 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:08.863509 (+ 253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:08.863946 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:08.863954 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:08.863961 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:08.864853 (+ 892us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:08.865096 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:08.865710 (+ 614us) server_negotiation.cc:299] Negotiation successful
0809 13:06:08.866145 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":86,"server-negotiator.queue_time_us":3420,"thread_start_us":3235,"threads_started":1}
WARNING: no policy specified for kudu/127.28.155.253@KRBTEST.COM; defaulting to no policy
I20260809 13:06:08.870374 18534 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.253" port: 38789 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.253@KRBTEST.COM" created.
I20260809 13:06:08.871618 18536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:08.871189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:38789 (local address 127.0.0.1:60284)
0809 13:06:08.871374 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:08.871497 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:38789: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260809 13:06:08.871938 18453 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.155.253:38789: connect: Connection refused (error 111)
I20260809 13:06:08.873718 18536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:08.873329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:38789 (local address 127.0.0.1:60294)
0809 13:06:08.873510 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:08.873590 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:38789: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260809 13:06:08.873924 18534 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.253:38789: Network error: Client connection negotiation failed: client connection to 127.28.155.253:38789: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.253.keytab.
Entry for principal kudu/127.28.155.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.253.keytab.
I20260809 13:06:08.908469 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.253:38789
--webserver_interface=127.28.155.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.253.keytab
--principal=kudu/127.28.155.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:44113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:39845,127.28.155.253:38789,127.28.155.252:41101
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 13:06:08.923372 18534 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.253" port: 38789 } attempt: 1
I20260809 13:06:08.924924 18536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:08.924299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:38789 (local address 127.0.0.1:60298)
0809 13:06:08.924576 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:08.924721 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:38789: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260809 13:06:08.926134 18536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:08.925666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:38789 (local address 127.0.0.1:60300)
0809 13:06:08.925852 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:08.925945 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:38789: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260809 13:06:08.926337 18534 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.253:38789: Network error: Client connection negotiation failed: client connection to 127.28.155.253:38789: connect: Connection refused (error 111)
I20260809 13:06:08.994656 18534 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.253" port: 38789 } attempt: 2
I20260809 13:06:08.996232 18536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:08.995501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:38789 (local address 127.0.0.1:60316)
0809 13:06:08.995847 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:08.996002 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:38789: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260809 13:06:08.997617 18536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:08.997097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:38789 (local address 127.0.0.1:60332)
0809 13:06:08.997296 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:08.997432 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:38789: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260809 13:06:08.997848 18534 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.253:38789: Network error: Client connection negotiation failed: client connection to 127.28.155.253:38789: connect: Connection refused (error 111)
I20260809 13:06:09.089174 18534 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.253" port: 38789 } attempt: 3
I20260809 13:06:09.090628 18536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.090071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:38789 (local address 127.0.0.1:60336)
0809 13:06:09.090322 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:09.090453 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:38789: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260809 13:06:09.091882 18536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.091445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:38789 (local address 127.0.0.1:60344)
0809 13:06:09.091602 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:09.091707 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:38789: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 13:06:09.092136 18534 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.253:38789: Network error: Client connection negotiation failed: client connection to 127.28.155.253:38789: connect: Connection refused (error 111)
I20260809 13:06:09.235446 18534 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.253" port: 38789 } attempt: 4
I20260809 13:06:09.236944 18536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.236221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:38789 (local address 127.0.0.1:60360)
0809 13:06:09.236637 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:09.236756 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:38789: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209}
I20260809 13:06:09.238134 18536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.237681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:38789 (local address 127.0.0.1:60376)
0809 13:06:09.237848 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:09.237963 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:38789: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260809 13:06:09.238355 18534 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.253:38789: Network error: Client connection negotiation failed: client connection to 127.28.155.253:38789: connect: Connection refused (error 111)
W20260809 13:06:09.273679 18542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:06:09.274019 18542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:06:09.274199 18542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:06:09.281665 18542 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:06:09.281792 18542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:06:09.281885 18542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:06:09.281980 18542 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:06:09.282100 18542 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:06:09.293071 18542 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:44113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:39845,127.28.155.253:38789,127.28.155.252:41101
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.253.keytab
--principal=kudu/127.28.155.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.253:38789
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.28.155.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:06:09.294569 18542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:06:09.295997 18542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:06:09.309114 18551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:09.309147 18553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:09.309691 18557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:06:09.310796 18542 server_base.cc:1034] running on GCE node
I20260809 13:06:09.311699 18542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:06:09.313339 18542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:06:09.314584 18542 hybrid_clock.cc:648] HybridClock initialized: now 1786280769314543 us; error 40 us; skew 500 ppm
I20260809 13:06:09.314955 18542 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:06:09 dist-test-slave-jq4t krb5kdc[18413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280769, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:06:09.318295 18542 init.cc:377] Logged in from keytab as kudu/127.28.155.253@KRBTEST.COM (short username kudu)
I20260809 13:06:09.319885 18542 webserver.cc:460] Webserver started at http://127.28.155.253:45315/ using document root <none> and password file <none>
I20260809 13:06:09.320714 18542 fs_manager.cc:359] Metadata directory not provided
I20260809 13:06:09.320870 18542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:06:09.321219 18542 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:06:09.324553 18542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-1/data/instance:
uuid: "8bf98f37e4e940d3bcfb1d913b84475c"
format_stamp: "Formatted at 2026-08-09 13:06:09 on dist-test-slave-jq4t"
server_key: "73ba43c0e82ec77ee60f27613dd48d19"
server_key_iv: "2762465c401225558b77c1bf1f020c26"
server_key_version: "encryptionkey@0"
I20260809 13:06:09.325515 18542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-1/wal/instance:
uuid: "8bf98f37e4e940d3bcfb1d913b84475c"
format_stamp: "Formatted at 2026-08-09 13:06:09 on dist-test-slave-jq4t"
server_key: "73ba43c0e82ec77ee60f27613dd48d19"
server_key_iv: "2762465c401225558b77c1bf1f020c26"
server_key_version: "encryptionkey@0"
I20260809 13:06:09.331203 18542 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 13:06:09.334972 18565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:09.336345 18542 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 13:06:09.336587 18542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-1/wal
uuid: "8bf98f37e4e940d3bcfb1d913b84475c"
format_stamp: "Formatted at 2026-08-09 13:06:09 on dist-test-slave-jq4t"
server_key: "73ba43c0e82ec77ee60f27613dd48d19"
server_key_iv: "2762465c401225558b77c1bf1f020c26"
server_key_version: "encryptionkey@0"
I20260809 13:06:09.336817 18542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:06:09.362326 18542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:06:09.366830 18542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:06:09.367167 18542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:06:09.391830 18542 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.253:38789
I20260809 13:06:09.391872 18640 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.253:38789 every 8 connection(s)
I20260809 13:06:09.393415 18542 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-1/data/info.pb
I20260809 13:06:09.397384 18641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:06:09.403048 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 18542
I20260809 13:06:09.403273 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-1/wal/instance
I20260809 13:06:09.403784 29295 external_mini_cluster.cc:1428] Setting key 599069eac204ed54cc250d4b17fea733
I20260809 13:06:09.404717 18641 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.254" port: 39845 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 13:06:09 dist-test-slave-jq4t krb5kdc[18413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280769, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.253@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:06:09.430488 18643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.407625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56120 (local address 127.28.155.254:39845)
0809 13:06:09.408265 (+ 640us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:09.408272 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:09.409412 (+ 1140us) server_negotiation.cc:407] Connection header received
0809 13:06:09.412454 (+ 3042us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:09.412459 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:09.412596 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:09.412700 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:09.415003 (+ 2303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:09.415838 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:09.417702 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:09.418472 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:09.418626 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:09.422555 (+ 3929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:09.422564 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:09.422572 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:09.422627 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:09.426763 (+ 4136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:09.427639 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:09.427648 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:09.427654 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:09.427816 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:09.428257 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:09.428265 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:09.428270 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:09.428755 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:09.428939 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:09.429681 (+ 742us) server_negotiation.cc:299] Negotiation successful
0809 13:06:09.429956 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":326,"threads_started":1}
I20260809 13:06:09.431298 18645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.408208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:39845 (local address 127.0.0.1:56120)
0809 13:06:09.409206 (+ 998us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:09.409267 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:09.412107 (+ 2840us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:09.412999 (+ 892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:09.413014 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:09.413871 (+ 857us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:06:09.414743 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:09.414774 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:09.416030 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:09.416039 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:09.417538 (+ 1499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:09.417550 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:09.418697 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:09.418702 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:09.418912 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:09.419704 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:06:09.419728 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:06:09.422280 (+ 2552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:06:09.426957 (+ 4677us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:09.426965 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:09.426980 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:09.427478 (+ 498us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:09.427929 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:09.427933 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:09.427935 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:09.428133 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:09.428886 (+ 753us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:06:09.428892 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:06:09.429283 (+ 391us) client_negotiation.cc:769] Sending connection context
0809 13:06:09.429518 (+ 235us) client_negotiation.cc:240] Negotiation successful
0809 13:06:09.429929 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":665,"thread_start_us":399,"threads_started":1}
I20260809 13:06:09.433262 18641 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.253" port: 38789 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.28.155.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.252@KRBTEST.COM" created.
Aug 09 13:06:09 dist-test-slave-jq4t krb5kdc[18413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280769, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.253@KRBTEST.COM for kudu/127.28.155.253@KRBTEST.COM
I20260809 13:06:09.450834 18645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.434189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:38789 (local address 127.0.0.1:60388)
0809 13:06:09.434426 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:09.434451 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:09.434567 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:09.435606 (+ 1039us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:09.435614 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:09.436075 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:06:09.436231 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:09.436240 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:09.437697 (+ 1457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:09.437701 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:09.438823 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:09.438843 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:09.440134 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:09.440143 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:09.440322 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:09.441064 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:06:09.441082 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:06:09.443243 (+ 2161us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:06:09.448038 (+ 4795us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:09.448042 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:09.448045 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:09.448453 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:09.448970 (+ 517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:09.448973 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:09.448976 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:09.449132 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:09.450060 (+ 928us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:06:09.450063 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:06:09.450193 (+ 130us) client_negotiation.cc:769] Sending connection context
0809 13:06:09.450310 (+ 117us) client_negotiation.cc:240] Negotiation successful
0809 13:06:09.450543 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73}
I20260809 13:06:09.451390 18648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.434450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60388 (local address 127.28.155.253:38789)
0809 13:06:09.435174 (+ 724us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:09.435181 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:09.435206 (+ 25us) server_negotiation.cc:407] Connection header received
0809 13:06:09.435247 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:09.435253 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:09.435424 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:09.435543 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:09.436379 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:09.437558 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:09.438990 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:09.439919 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:09.440077 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:09.443484 (+ 3407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:09.443501 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:09.443523 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:09.443567 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:09.447853 (+ 4286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:09.448678 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:09.448690 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:09.448696 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:09.448852 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:09.449279 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:09.449287 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:09.449293 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:09.449909 (+ 616us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:09.450161 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:09.450567 (+ 406us) server_negotiation.cc:299] Negotiation successful
0809 13:06:09.450905 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":417,"threads_started":1}
I20260809 13:06:09.454073 18641 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } has no permanent_uuid. Determining permanent_uuid...
I20260809 13:06:09.455502 18645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.454862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:41101 (local address 127.0.0.1:58330)
0809 13:06:09.455078 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:09.455264 (+ 186us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:41101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260809 13:06:09.455826 18568 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.155.252:41101: connect: Connection refused (error 111)
I20260809 13:06:09.457679 18645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.457207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:41101 (local address 127.0.0.1:58336)
0809 13:06:09.457428 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:09.457533 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:41101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260809 13:06:09.457940 18641 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.252:41101: Network error: Client connection negotiation failed: client connection to 127.28.155.252:41101: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.252.keytab.
Entry for principal kudu/127.28.155.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.252.keytab.
I20260809 13:06:09.476708 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.252:41101
--webserver_interface=127.28.155.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.252.keytab
--principal=kudu/127.28.155.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:44113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:39845,127.28.155.253:38789,127.28.155.252:41101
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 13:06:09.507344 18641 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } attempt: 1
I20260809 13:06:09.508821 18645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.508186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:41101 (local address 127.0.0.1:58350)
0809 13:06:09.508452 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:09.508612 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:41101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260809 13:06:09.509966 18645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.509587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:41101 (local address 127.0.0.1:58356)
0809 13:06:09.509761 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:09.509841 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:41101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260809 13:06:09.510281 18641 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.252:41101: Network error: Client connection negotiation failed: client connection to 127.28.155.252:41101: connect: Connection refused (error 111)
I20260809 13:06:09.537663 18534 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.253" port: 38789 } attempt: 5
Aug 09 13:06:09 dist-test-slave-jq4t krb5kdc[18413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280768, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for kudu/127.28.155.253@KRBTEST.COM
I20260809 13:06:09.554060 18648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.538742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60390 (local address 127.28.155.253:38789)
0809 13:06:09.538934 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:09.538939 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:09.538961 (+ 22us) server_negotiation.cc:407] Connection header received
0809 13:06:09.539187 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:09.539191 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:09.539285 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:09.539390 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:09.540583 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:09.541654 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:09.543382 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:09.543854 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:09.543966 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:09.548105 (+ 4139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:09.548110 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:09.548114 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:09.548149 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:09.551289 (+ 3140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:09.552124 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:09.552128 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:09.552130 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:09.552257 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:09.552708 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:09.552712 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:09.552714 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:09.553012 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:09.553125 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:09.553640 (+ 515us) server_negotiation.cc:299] Negotiation successful
0809 13:06:09.553818 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 13:06:09.554207 18536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.538586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:38789 (local address 127.0.0.1:60390)
0809 13:06:09.538845 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:09.538871 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:09.539026 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:09.539462 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:09.539467 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:09.540024 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:06:09.540326 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:09.540341 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:09.541804 (+ 1463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:09.541810 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:09.543196 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:09.543214 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:09.544026 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:09.544034 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:09.544232 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:09.545022 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:06:09.545047 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:06:09.547883 (+ 2836us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:06:09.551475 (+ 3592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:09.551481 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:09.551485 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:09.552002 (+ 517us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:09.552372 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:09.552376 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:09.552380 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:09.552590 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:09.553134 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:06:09.553139 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:06:09.553309 (+ 170us) client_negotiation.cc:769] Sending connection context
0809 13:06:09.553512 (+ 203us) client_negotiation.cc:240] Negotiation successful
0809 13:06:09.553843 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88}
I20260809 13:06:09.555322 18534 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } has no permanent_uuid. Determining permanent_uuid...
I20260809 13:06:09.556630 18536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.556179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:41101 (local address 127.0.0.1:58366)
0809 13:06:09.556354 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:09.556429 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:41101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260809 13:06:09.557703 18536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.557379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:41101 (local address 127.0.0.1:58376)
0809 13:06:09.557522 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:09.557604 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:41101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260809 13:06:09.557972 18534 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.252:41101: Network error: Client connection negotiation failed: client connection to 127.28.155.252:41101: connect: Connection refused (error 111)
I20260809 13:06:09.578542 18641 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } attempt: 2
I20260809 13:06:09.579813 18645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.579346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:41101 (local address 127.0.0.1:58390)
0809 13:06:09.579549 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:09.579646 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:41101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260809 13:06:09.581004 18645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.580684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:41101 (local address 127.0.0.1:58394)
0809 13:06:09.580821 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:09.580890 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:41101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 13:06:09.581282 18641 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.252:41101: Network error: Client connection negotiation failed: client connection to 127.28.155.252:41101: connect: Connection refused (error 111)
I20260809 13:06:09.609264 18534 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } attempt: 1
I20260809 13:06:09.610594 18536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.610092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:41101 (local address 127.0.0.1:58404)
0809 13:06:09.610316 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:09.610411 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:41101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260809 13:06:09.611931 18536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.611545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:41101 (local address 127.0.0.1:58408)
0809 13:06:09.611719 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:09.611803 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:41101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
W20260809 13:06:09.612388 18534 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.252:41101: Network error: Client connection negotiation failed: client connection to 127.28.155.252:41101: connect: Connection refused (error 111)
I20260809 13:06:09.672652 18641 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } attempt: 3
I20260809 13:06:09.674064 18645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.673565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:41101 (local address 127.0.0.1:58412)
0809 13:06:09.673785 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:09.673888 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:41101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260809 13:06:09.675395 18645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.674861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:41101 (local address 127.0.0.1:58428)
0809 13:06:09.675163 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:09.675251 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:41101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202}
W20260809 13:06:09.675705 18641 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.252:41101: Network error: Client connection negotiation failed: client connection to 127.28.155.252:41101: connect: Connection refused (error 111)
I20260809 13:06:09.680645 18534 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } attempt: 2
I20260809 13:06:09.681813 18536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.681320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:41101 (local address 127.0.0.1:58432)
0809 13:06:09.681552 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:09.681635 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:41101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260809 13:06:09.682946 18536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.682565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:41101 (local address 127.0.0.1:58434)
0809 13:06:09.682703 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:09.682807 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:41101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260809 13:06:09.683223 18534 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.252:41101: Network error: Client connection negotiation failed: client connection to 127.28.155.252:41101: connect: Connection refused (error 111)
I20260809 13:06:09.789484 18534 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } attempt: 3
I20260809 13:06:09.790895 18536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.790340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:41101 (local address 127.0.0.1:58448)
0809 13:06:09.790604 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:09.790700 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:41101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260809 13:06:09.792021 18536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.791655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:41101 (local address 127.0.0.1:58450)
0809 13:06:09.791852 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:09.791924 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:41101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
W20260809 13:06:09.792323 18534 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.252:41101: Network error: Client connection negotiation failed: client connection to 127.28.155.252:41101: connect: Connection refused (error 111)
I20260809 13:06:09.819000 18641 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } attempt: 4
I20260809 13:06:09.820379 18645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.819842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:41101 (local address 127.0.0.1:58452)
0809 13:06:09.820115 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:09.820210 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:41101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260809 13:06:09.821462 18645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.821116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:41101 (local address 127.0.0.1:58458)
0809 13:06:09.821278 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:09.821351 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:41101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260809 13:06:09.821745 18641 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.252:41101: Network error: Client connection negotiation failed: client connection to 127.28.155.252:41101: connect: Connection refused (error 111)
W20260809 13:06:09.849874 18653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:06:09.850337 18653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:06:09.850528 18653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:06:09.858323 18653 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:06:09.858460 18653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:06:09.858510 18653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:06:09.858572 18653 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:06:09.858618 18653 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:06:09.869108 18653 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:44113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:39845,127.28.155.253:38789,127.28.155.252:41101
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.252.keytab
--principal=kudu/127.28.155.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.252:41101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.28.155.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:06:09.870604 18653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:06:09.871956 18653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:06:09.884450 18665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:09.884537 18668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:09.884718 18672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:06:09.885305 18653 server_base.cc:1034] running on GCE node
I20260809 13:06:09.886178 18653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:06:09.887778 18653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:06:09.889024 18653 hybrid_clock.cc:648] HybridClock initialized: now 1786280769888980 us; error 63 us; skew 500 ppm
I20260809 13:06:09.889451 18653 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:06:09 dist-test-slave-jq4t krb5kdc[18413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280769, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:06:09.892820 18653 init.cc:377] Logged in from keytab as kudu/127.28.155.252@KRBTEST.COM (short username kudu)
I20260809 13:06:09.894387 18653 webserver.cc:460] Webserver started at http://127.28.155.252:40701/ using document root <none> and password file <none>
I20260809 13:06:09.895049 18653 fs_manager.cc:359] Metadata directory not provided
I20260809 13:06:09.895149 18653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:06:09.895406 18653 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:06:09.898681 18653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-2/data/instance:
uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c"
format_stamp: "Formatted at 2026-08-09 13:06:09 on dist-test-slave-jq4t"
server_key: "e10bfa86103588b410d2c458cb124b2e"
server_key_iv: "2956b998bd01d07e1abddec5ff4521f2"
server_key_version: "encryptionkey@0"
I20260809 13:06:09.899461 18653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-2/wal/instance:
uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c"
format_stamp: "Formatted at 2026-08-09 13:06:09 on dist-test-slave-jq4t"
server_key: "e10bfa86103588b410d2c458cb124b2e"
server_key_iv: "2956b998bd01d07e1abddec5ff4521f2"
server_key_version: "encryptionkey@0"
I20260809 13:06:09.905023 18653 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260809 13:06:09.908782 18682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:09.910198 18653 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:06:09.910341 18653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-2/wal
uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c"
format_stamp: "Formatted at 2026-08-09 13:06:09 on dist-test-slave-jq4t"
server_key: "e10bfa86103588b410d2c458cb124b2e"
server_key_iv: "2956b998bd01d07e1abddec5ff4521f2"
server_key_version: "encryptionkey@0"
I20260809 13:06:09.910509 18653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:06:09.924942 18653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:06:09.929267 18653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:06:09.929513 18653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:06:09.948882 18653 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.252:41101
I20260809 13:06:09.948927 18758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.252:41101 every 8 connection(s)
I20260809 13:06:09.950328 18653 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-2/data/info.pb
I20260809 13:06:09.954100 18760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:06:09.958544 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 18653
I20260809 13:06:09.958770 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786280548611909-29295-0/minicluster-data/master-2/wal/instance
I20260809 13:06:09.959244 29295 external_mini_cluster.cc:1428] Setting key cb21d0ac3a1fa29e3af8ee72e1386104
I20260809 13:06:09.961406 18760 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.254" port: 39845 } has no permanent_uuid. Determining permanent_uuid...
I20260809 13:06:09.969568 18534 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } attempt: 4
Aug 09 13:06:09 dist-test-slave-jq4t krb5kdc[18413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280769, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.252@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
Aug 09 13:06:09 dist-test-slave-jq4t krb5kdc[18413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280768, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.252@KRBTEST.COM
Aug 09 13:06:09 dist-test-slave-jq4t krb5kdc[18413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280768, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for kudu/127.28.155.252@KRBTEST.COM
I20260809 13:06:09.985467 18771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.964279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:39845 (local address 127.0.0.1:56128)
0809 13:06:09.965288 (+ 1009us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:09.965340 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:09.965544 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:09.965978 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:09.965983 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:09.966565 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:06:09.967063 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:09.967083 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:09.968608 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:09.968615 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:09.970247 (+ 1632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:09.970262 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:09.971635 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:09.971642 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:09.971820 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:09.972712 (+ 892us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:06:09.972750 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:06:09.975673 (+ 2923us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:06:09.980177 (+ 4504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:09.980187 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:09.980201 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:09.981025 (+ 824us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:09.981539 (+ 514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:09.981545 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:09.981549 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:09.981870 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:09.982502 (+ 632us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:06:09.982511 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:06:09.982938 (+ 427us) client_negotiation.cc:769] Sending connection context
0809 13:06:09.983314 (+ 376us) client_negotiation.cc:240] Negotiation successful
0809 13:06:09.983797 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":737,"spinlock_wait_cycles":17152,"thread_start_us":575,"threads_started":1}
I20260809 13:06:09.986521 18764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.961190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58468 (local address 127.28.155.252:41101)
0809 13:06:09.962051 (+ 861us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:09.962064 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:09.962109 (+ 45us) server_negotiation.cc:407] Connection header received
0809 13:06:09.964020 (+ 1911us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:09.964052 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:09.964675 (+ 623us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:09.965170 (+ 495us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:09.966976 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:09.968916 (+ 1940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:09.970535 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:09.971417 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:09.971687 (+ 270us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:09.977084 (+ 5397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:09.977098 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:09.977116 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:09.977162 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:09.981665 (+ 4503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:09.982954 (+ 1289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:09.982964 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:09.982971 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:09.983155 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:09.983671 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:09.983675 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:09.983678 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:09.984143 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:09.984464 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:09.985806 (+ 1342us) server_negotiation.cc:299] Negotiation successful
0809 13:06:09.986095 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":619,"thread_start_us":418,"threads_started":1}
I20260809 13:06:09.987079 18774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.970444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58476 (local address 127.28.155.252:41101)
0809 13:06:09.971241 (+ 797us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:09.971248 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:09.971272 (+ 24us) server_negotiation.cc:407] Connection header received
0809 13:06:09.971319 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:09.971323 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:09.971390 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:09.971496 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:09.972448 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:09.973869 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:09.975527 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:09.976197 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:09.976336 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:09.980162 (+ 3826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:09.980167 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:09.980171 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:09.980201 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:09.983662 (+ 3461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:09.984336 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:09.984342 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:09.984345 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:09.984555 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:09.984949 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:09.984954 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:09.984957 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:09.985238 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:09.985387 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:09.986397 (+ 1010us) server_negotiation.cc:299] Negotiation successful
0809 13:06:09.986667 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":594,"server-negotiator.queue_time_us":652,"thread_start_us":413,"threads_started":1}
I20260809 13:06:09.987195 18536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.970176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:41101 (local address 127.0.0.1:58476)
0809 13:06:09.970442 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:09.970461 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:09.970550 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:09.971556 (+ 1006us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:09.971561 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:09.972049 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:06:09.972269 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:09.972282 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:09.974032 (+ 1750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:09.974040 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:09.975378 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:09.975392 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:09.976386 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:09.976394 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:09.976609 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:09.977304 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:06:09.977321 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:06:09.979915 (+ 2594us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:06:09.983795 (+ 3880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:09.983800 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:09.983804 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:09.984198 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:09.984678 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:09.984683 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:09.984686 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:09.984826 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:09.985384 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:06:09.985389 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:06:09.985533 (+ 144us) client_negotiation.cc:769] Sending connection context
0809 13:06:09.986131 (+ 598us) client_negotiation.cc:240] Negotiation successful
0809 13:06:09.986501 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":88}
I20260809 13:06:09.987920 18766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.964282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56128 (local address 127.28.155.254:39845)
0809 13:06:09.964954 (+ 672us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:09.964960 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:09.965583 (+ 623us) server_negotiation.cc:407] Connection header received
0809 13:06:09.965669 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:09.965675 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:09.965781 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:09.965915 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:09.967298 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:09.968392 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:09.970429 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:09.971173 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:09.971313 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:09.975874 (+ 4561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:09.975879 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:09.975882 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:09.975913 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:09.979999 (+ 4086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:09.981197 (+ 1198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:09.981205 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:09.981208 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:09.981366 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:09.981994 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:09.982000 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:09.982003 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:09.982344 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:09.982534 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:09.986050 (+ 3516us) server_negotiation.cc:299] Negotiation successful
0809 13:06:09.986306 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":526,"thread_start_us":325,"threads_started":1}
I20260809 13:06:09.989130 18760 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.253" port: 38789 } has no permanent_uuid. Determining permanent_uuid...
I20260809 13:06:09.994680 18534 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c85edb9bd89406ab873f6077f3f931d: Bootstrap starting.
Aug 09 13:06:09 dist-test-slave-jq4t krb5kdc[18413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280769, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.252@KRBTEST.COM for kudu/127.28.155.253@KRBTEST.COM
I20260809 13:06:09.999449 18534 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c85edb9bd89406ab873f6077f3f931d: Neither blocks nor log segments found. Creating new log.
Aug 09 13:06:10 dist-test-slave-jq4t krb5kdc[18413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280768, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:06:10.001121 18534 log.cc:824] T 00000000000000000000000000000000 P 9c85edb9bd89406ab873f6077f3f931d: Log is configured to *not* fsync() on all Append() calls
I20260809 13:06:10.005759 18771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.989911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:38789 (local address 127.0.0.1:60394)
0809 13:06:09.991150 (+ 1239us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:09.991164 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:09.991292 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:09.991703 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:09.991710 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:09.992064 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:06:09.992220 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:09.992227 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:09.993650 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:09.993655 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:09.994989 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:09.995007 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:09.995803 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:09.995810 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:09.996033 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:09.996742 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:06:09.996760 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:06:09.999047 (+ 2287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:06:10.002971 (+ 3924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:10.002977 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:10.002981 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:10.003434 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:10.003896 (+ 462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:10.003901 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:10.003910 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:10.004082 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:10.004702 (+ 620us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:06:10.004707 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:06:10.004885 (+ 178us) client_negotiation.cc:769] Sending connection context
0809 13:06:10.005047 (+ 162us) client_negotiation.cc:240] Negotiation successful
0809 13:06:10.005370 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1147}
I20260809 13:06:10.005781 18648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.990395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60394 (local address 127.28.155.253:38789)
0809 13:06:09.990621 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:09.990626 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:09.991255 (+ 629us) server_negotiation.cc:407] Connection header received
0809 13:06:09.991405 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:09.991411 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:09.991489 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:09.991599 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:09.992376 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:09.993482 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:09.995165 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:09.995647 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:09.995793 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:09.999262 (+ 3469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:09.999268 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:09.999272 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:09.999309 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:10.002799 (+ 3490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:10.003585 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:10.003593 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:10.003597 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:10.003766 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:10.004211 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:10.004218 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:10.004221 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:10.004581 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:10.004743 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:10.005146 (+ 403us) server_negotiation.cc:299] Negotiation successful
0809 13:06:10.005386 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260809 13:06:10.005862 18534 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c85edb9bd89406ab873f6077f3f931d: No bootstrap required, opened a new log
I20260809 13:06:10.007062 18760 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } has no permanent_uuid. Determining permanent_uuid...
I20260809 13:06:10.010202 18766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:09.990404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56138 (local address 127.28.155.254:39845)
0809 13:06:09.990731 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:09.990735 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:09.990751 (+ 16us) server_negotiation.cc:407] Connection header received
0809 13:06:09.990794 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:09.990797 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:09.990893 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:09.990971 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:09.992831 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:09.993812 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:09.995233 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:09.995889 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:09.996012 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:10.002037 (+ 6025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:10.002042 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:10.002045 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:10.002079 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:10.005858 (+ 3779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:10.006898 (+ 1040us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:10.006904 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:10.006907 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:10.007067 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:10.007559 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:10.007564 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:10.007567 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:10.007969 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:10.008303 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:10.009554 (+ 1251us) server_negotiation.cc:299] Negotiation successful
0809 13:06:10.009830 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239}
Aug 09 13:06:10 dist-test-slave-jq4t krb5kdc[18413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280769, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.252@KRBTEST.COM for kudu/127.28.155.252@KRBTEST.COM
I20260809 13:06:10.017270 18534 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c85edb9bd89406ab873f6077f3f931d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85edb9bd89406ab873f6077f3f931d" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 39845 } } peers { permanent_uuid: "8bf98f37e4e940d3bcfb1d913b84475c" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 38789 } } peers { permanent_uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } }
I20260809 13:06:10.017715 18534 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9c85edb9bd89406ab873f6077f3f931d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:06:10.017879 18534 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c85edb9bd89406ab873f6077f3f931d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c85edb9bd89406ab873f6077f3f931d, State: Initialized, Role: FOLLOWER
I20260809 13:06:10.018748 18534 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c85edb9bd89406ab873f6077f3f931d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85edb9bd89406ab873f6077f3f931d" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 39845 } } peers { permanent_uuid: "8bf98f37e4e940d3bcfb1d913b84475c" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 38789 } } peers { permanent_uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } }
I20260809 13:06:10.019860 18776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c85edb9bd89406ab873f6077f3f931d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85edb9bd89406ab873f6077f3f931d" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 39845 } } peers { permanent_uuid: "8bf98f37e4e940d3bcfb1d913b84475c" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 38789 } } peers { permanent_uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } } }
I20260809 13:06:10.020294 18776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c85edb9bd89406ab873f6077f3f931d [sys.catalog]: This master's current role is: FOLLOWER
I20260809 13:06:10.021392 18534 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c85edb9bd89406ab873f6077f3f931d [sys.catalog]: configured and running, proceeding with master startup.
Aug 09 13:06:10 dist-test-slave-jq4t krb5kdc[18413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280768, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.253@KRBTEST.COM
I20260809 13:06:10.023541 18774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:10.008062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58484 (local address 127.28.155.252:41101)
0809 13:06:10.008231 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:10.008237 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:10.008251 (+ 14us) server_negotiation.cc:407] Connection header received
0809 13:06:10.008293 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:10.008296 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:10.008345 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:10.008448 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:10.009180 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:10.010015 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:10.011999 (+ 1984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:10.012660 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:10.012781 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:10.016575 (+ 3794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:10.016581 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:10.016586 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:10.016628 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:10.020204 (+ 3576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:10.021095 (+ 891us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:10.021101 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:10.021104 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:10.021275 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:10.021761 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:10.021766 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:10.021770 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:10.022226 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:10.022382 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:10.022902 (+ 520us) server_negotiation.cc:299] Negotiation successful
0809 13:06:10.023168 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 13:06:10.024571 18771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:10.007816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:41101 (local address 127.0.0.1:58484)
0809 13:06:10.007985 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:10.008004 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:10.008102 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:10.008465 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:10.008468 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:10.008885 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:06:10.009027 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:10.009037 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:10.010149 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:10.010157 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:10.011843 (+ 1686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:10.011861 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:10.012786 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:10.012791 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:10.012978 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:10.013711 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:06:10.013738 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:06:10.016361 (+ 2623us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:06:10.020358 (+ 3997us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:10.020363 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:10.020366 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:10.020935 (+ 569us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:10.021425 (+ 490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:10.021432 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:10.021437 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:10.021619 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:10.022372 (+ 753us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:06:10.022378 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:06:10.022583 (+ 205us) client_negotiation.cc:769] Sending connection context
0809 13:06:10.023792 (+ 1209us) client_negotiation.cc:240] Negotiation successful
0809 13:06:10.024133 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 13:06:10.031606 18760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c: Bootstrap starting.
I20260809 13:06:10.032987 18648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:10.012195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60408 (local address 127.28.155.253:38789)
0809 13:06:10.012365 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:10.012370 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:10.012675 (+ 305us) server_negotiation.cc:407] Connection header received
0809 13:06:10.012868 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:10.012873 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:10.012953 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:10.013053 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:10.014888 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:10.015999 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:10.017889 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:10.018552 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:10.018688 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:10.025281 (+ 6593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:10.025290 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:10.025294 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:10.025337 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:10.029230 (+ 3893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:10.030241 (+ 1011us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:10.030248 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:10.030251 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:10.030435 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:10.030968 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:10.030974 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:10.030977 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:10.031382 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:10.031682 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:10.032308 (+ 626us) server_negotiation.cc:299] Negotiation successful
0809 13:06:10.032622 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 13:06:10.036749 18760 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c: Neither blocks nor log segments found. Creating new log.
I20260809 13:06:10.037974 18760 log.cc:824] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c: Log is configured to *not* fsync() on all Append() calls
I20260809 13:06:10.041350 18760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c: No bootstrap required, opened a new log
I20260809 13:06:10.033615 18431 master_runner.cc:186] Error getting master registration for 127.28.155.253:38789: OK, instance_id { permanent_uuid: "8bf98f37e4e940d3bcfb1d913b84475c" instance_seqno: 1786280769383535 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 13:06:10.046917 18431 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 13:06:10.047247 29295 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260809 13:06:10.048640 18794 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9c85edb9bd89406ab873f6077f3f931d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 13:06:10.048880 18794 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 13:06:10.050573 18760 raft_consensus.cc:348] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85edb9bd89406ab873f6077f3f931d" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 39845 } } peers { permanent_uuid: "8bf98f37e4e940d3bcfb1d913b84475c" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 38789 } } peers { permanent_uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } }
I20260809 13:06:10.051033 18760 raft_consensus.cc:374] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:06:10.051182 18760 raft_consensus.cc:729] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2cbfbc8bc0942b4868b1d295ba5b12c, State: Initialized, Role: FOLLOWER
I20260809 13:06:10.052155 18760 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85edb9bd89406ab873f6077f3f931d" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 39845 } } peers { permanent_uuid: "8bf98f37e4e940d3bcfb1d913b84475c" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 38789 } } peers { permanent_uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } }
I20260809 13:06:10.053365 18806 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85edb9bd89406ab873f6077f3f931d" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 39845 } } peers { permanent_uuid: "8bf98f37e4e940d3bcfb1d913b84475c" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 38789 } } peers { permanent_uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } } }
I20260809 13:06:10.053893 18806 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c [sys.catalog]: This master's current role is: FOLLOWER
I20260809 13:06:10.055047 18760 sys_catalog.cc:564] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c [sys.catalog]: configured and running, proceeding with master startup.
W20260809 13:06:10.057138 18462 tablet.cc:2369] T 00000000000000000000000000000000 P 9c85edb9bd89406ab873f6077f3f931d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:06:10.070194 18806 raft_consensus.cc:482] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:06:10.070602 18806 raft_consensus.cc:504] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85edb9bd89406ab873f6077f3f931d" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 39845 } } peers { permanent_uuid: "8bf98f37e4e940d3bcfb1d913b84475c" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 38789 } } peers { permanent_uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } }
I20260809 13:06:10.074326 18496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c85edb9bd89406ab873f6077f3f931d" is_pre_election: true
I20260809 13:06:10.075168 18496 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9c85edb9bd89406ab873f6077f3f931d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2cbfbc8bc0942b4868b1d295ba5b12c in term 0.
I20260809 13:06:10.076094 18685 leader_election.cc:302] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c85edb9bd89406ab873f6077f3f931d, e2cbfbc8bc0942b4868b1d295ba5b12c; no voters:
I20260809 13:06:10.083637 18806 leader_election.cc:288] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c85edb9bd89406ab873f6077f3f931d (127.28.155.254:39845), 8bf98f37e4e940d3bcfb1d913b84475c (127.28.155.253:38789)
I20260809 13:06:10.084996 18806 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:06:10.085933 18806 raft_consensus.cc:482] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:06:10.086948 18806 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:06:10.100965 18648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:10.055044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60422 (local address 127.28.155.253:38789)
0809 13:06:10.055269 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:10.055278 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:10.066561 (+ 11283us) server_negotiation.cc:407] Connection header received
0809 13:06:10.067385 (+ 824us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:10.067392 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:10.067487 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:10.067559 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:10.072554 (+ 4995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:10.073742 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:10.081115 (+ 7373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:10.081816 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:10.081939 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:10.089073 (+ 7134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:10.089082 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:10.089088 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:10.089145 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:10.094389 (+ 5244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:10.097443 (+ 3054us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:10.097454 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:10.097460 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:10.097706 (+ 246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:10.098317 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:10.098326 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:10.098332 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:10.098840 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:10.099214 (+ 374us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:10.100019 (+ 805us) server_negotiation.cc:299] Negotiation successful
0809 13:06:10.100388 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 13:06:10.108834 18806 raft_consensus.cc:504] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85edb9bd89406ab873f6077f3f931d" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 39845 } } peers { permanent_uuid: "8bf98f37e4e940d3bcfb1d913b84475c" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 38789 } } peers { permanent_uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } }
I20260809 13:06:10.110540 18496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c85edb9bd89406ab873f6077f3f931d"
I20260809 13:06:10.110929 18496 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c85edb9bd89406ab873f6077f3f931d [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:06:10.116277 18496 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9c85edb9bd89406ab873f6077f3f931d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2cbfbc8bc0942b4868b1d295ba5b12c in term 1.
I20260809 13:06:10.117030 18685 leader_election.cc:302] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c85edb9bd89406ab873f6077f3f931d, e2cbfbc8bc0942b4868b1d295ba5b12c; no voters:
I20260809 13:06:10.117564 18817 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:06:10.121038 18641 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } attempt: 5
I20260809 13:06:10.121104 18817 raft_consensus.cc:686] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c [term 1 LEADER]: Becoming Leader. State: Replica: e2cbfbc8bc0942b4868b1d295ba5b12c, State: Running, Role: LEADER
I20260809 13:06:10.125780 18766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:10.054360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56140 (local address 127.28.155.254:39845)
0809 13:06:10.054629 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:10.054639 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:10.065974 (+ 11335us) server_negotiation.cc:407] Connection header received
0809 13:06:10.066786 (+ 812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:10.066793 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:10.066886 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:10.067021 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:10.075946 (+ 8925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:10.077192 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:10.079274 (+ 2082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:10.080000 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:10.080140 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:10.110709 (+ 30569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:10.110718 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:10.110723 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:10.110771 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:10.115223 (+ 4452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:10.119938 (+ 4715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:10.119944 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:10.119948 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:10.120134 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:10.121504 (+ 1370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:10.121510 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:10.121514 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:10.121929 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:10.122200 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:10.125073 (+ 2873us) server_negotiation.cc:299] Negotiation successful
0809 13:06:10.125368 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 13:06:10.130745 18774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:10.059492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58490 (local address 127.28.155.252:41101)
0809 13:06:10.059729 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:10.059738 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:10.072305 (+ 12567us) server_negotiation.cc:407] Connection header received
0809 13:06:10.072548 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:10.072554 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:10.072653 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:10.072756 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:10.083073 (+ 10317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:10.084252 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:10.090104 (+ 5852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:10.096204 (+ 6100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:10.096376 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:10.104023 (+ 7647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:10.104034 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:10.104039 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:10.104089 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:10.108694 (+ 4605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:10.117073 (+ 8379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:10.117080 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:10.117084 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:10.117269 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:10.118664 (+ 1395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:10.118670 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:10.118674 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:10.119120 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:10.119449 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:10.122894 (+ 3445us) server_negotiation.cc:299] Negotiation successful
0809 13:06:10.123193 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 13:06:10.122289 18817 consensus_queue.cc:237] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85edb9bd89406ab873f6077f3f931d" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 39845 } } peers { permanent_uuid: "8bf98f37e4e940d3bcfb1d913b84475c" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 38789 } } peers { permanent_uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } }
Aug 09 13:06:10 dist-test-slave-jq4t krb5kdc[18413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280769, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.253@KRBTEST.COM for kudu/127.28.155.252@KRBTEST.COM
I20260809 13:06:10.140197 18806 leader_election.cc:288] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c [CANDIDATE]: Term 1 election: Requested vote from peers 9c85edb9bd89406ab873f6077f3f931d (127.28.155.254:39845), 8bf98f37e4e940d3bcfb1d913b84475c (127.28.155.253:38789)
I20260809 13:06:10.153627 18645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:10.121723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:41101 (local address 127.0.0.1:58492)
0809 13:06:10.122087 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:10.122109 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:10.122242 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:10.122855 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:10.122863 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:10.123623 (+ 760us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:06:10.123924 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:10.123942 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:10.125880 (+ 1938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:10.125888 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:10.127780 (+ 1892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:10.127803 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:10.129417 (+ 1614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:10.129426 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:10.129801 (+ 375us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:10.130674 (+ 873us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:06:10.130701 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:06:10.135022 (+ 4321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:06:10.144670 (+ 9648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:10.144676 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:10.144681 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:10.145912 (+ 1231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:10.146897 (+ 985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:10.146903 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:10.146907 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:10.148433 (+ 1526us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:10.149920 (+ 1487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:06:10.149925 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:06:10.150259 (+ 334us) client_negotiation.cc:769] Sending connection context
0809 13:06:10.150580 (+ 321us) client_negotiation.cc:240] Negotiation successful
0809 13:06:10.151709 (+ 1129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224}
I20260809 13:06:10.157051 18764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:10.121730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58492 (local address 127.28.155.252:41101)
0809 13:06:10.121898 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:10.121904 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:10.122171 (+ 267us) server_negotiation.cc:407] Connection header received
0809 13:06:10.122362 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:10.122371 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:10.122477 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:10.122606 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:10.124149 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:10.125678 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:10.128014 (+ 2336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:10.129002 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:10.129155 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:10.137022 (+ 7867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:10.137031 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:10.137038 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:10.137083 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:10.144338 (+ 7255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:10.146252 (+ 1914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:10.146260 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:10.146264 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:10.146613 (+ 349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:10.148797 (+ 2184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:10.148805 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:10.148809 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:10.149654 (+ 845us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:10.151244 (+ 1590us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:10.151888 (+ 644us) server_negotiation.cc:299] Negotiation successful
0809 13:06:10.153018 (+ 1130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 13:06:10.163390 18641 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bf98f37e4e940d3bcfb1d913b84475c: Bootstrap starting.
I20260809 13:06:10.172809 18641 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8bf98f37e4e940d3bcfb1d913b84475c: Neither blocks nor log segments found. Creating new log.
I20260809 13:06:10.175952 18819 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2cbfbc8bc0942b4868b1d295ba5b12c. Latest consensus state: current_term: 1 leader_uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85edb9bd89406ab873f6077f3f931d" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 39845 } } peers { permanent_uuid: "8bf98f37e4e940d3bcfb1d913b84475c" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 38789 } } peers { permanent_uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } } }
I20260809 13:06:10.176556 18819 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c [sys.catalog]: This master's current role is: LEADER
I20260809 13:06:10.178810 18641 log.cc:824] T 00000000000000000000000000000000 P 8bf98f37e4e940d3bcfb1d913b84475c: Log is configured to *not* fsync() on all Append() calls
W20260809 13:06:10.181689 18696 tablet.cc:2369] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:06:10.200722 18828 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:06:10.202230 18641 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bf98f37e4e940d3bcfb1d913b84475c: No bootstrap required, opened a new log
I20260809 13:06:10.207788 18834 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 13:06:10.224583 18641 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8bf98f37e4e940d3bcfb1d913b84475c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85edb9bd89406ab873f6077f3f931d" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 39845 } } peers { permanent_uuid: "8bf98f37e4e940d3bcfb1d913b84475c" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 38789 } } peers { permanent_uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } }
I20260809 13:06:10.225466 18641 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8bf98f37e4e940d3bcfb1d913b84475c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:06:10.225730 18641 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8bf98f37e4e940d3bcfb1d913b84475c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf98f37e4e940d3bcfb1d913b84475c, State: Initialized, Role: FOLLOWER
I20260809 13:06:10.227291 18641 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8bf98f37e4e940d3bcfb1d913b84475c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85edb9bd89406ab873f6077f3f931d" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 39845 } } peers { permanent_uuid: "8bf98f37e4e940d3bcfb1d913b84475c" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 38789 } } peers { permanent_uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } }
I20260809 13:06:10.216001 18653 master_runner.cc:186] Error getting master registration for 127.28.155.253:38789: OK, instance_id { permanent_uuid: "8bf98f37e4e940d3bcfb1d913b84475c" instance_seqno: 1786280769383535 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 13:06:10.229089 18653 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 13:06:10.236212 18828 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:06:10.240921 18837 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bf98f37e4e940d3bcfb1d913b84475c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85edb9bd89406ab873f6077f3f931d" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 39845 } } peers { permanent_uuid: "8bf98f37e4e940d3bcfb1d913b84475c" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 38789 } } peers { permanent_uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } } }
I20260809 13:06:10.241569 18837 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bf98f37e4e940d3bcfb1d913b84475c [sys.catalog]: This master's current role is: FOLLOWER
I20260809 13:06:10.244004 18602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf98f37e4e940d3bcfb1d913b84475c" is_pre_election: true
I20260809 13:06:10.244694 18602 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8bf98f37e4e940d3bcfb1d913b84475c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2cbfbc8bc0942b4868b1d295ba5b12c in term 0.
I20260809 13:06:10.245127 18601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf98f37e4e940d3bcfb1d913b84475c"
I20260809 13:06:10.245354 18601 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8bf98f37e4e940d3bcfb1d913b84475c [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:06:10.249109 18601 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8bf98f37e4e940d3bcfb1d913b84475c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2cbfbc8bc0942b4868b1d295ba5b12c in term 1.
I20260809 13:06:10.250243 18641 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8bf98f37e4e940d3bcfb1d913b84475c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:06:10.258116 18601 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8bf98f37e4e940d3bcfb1d913b84475c [term 1 FOLLOWER]: Refusing update from remote peer e2cbfbc8bc0942b4868b1d295ba5b12c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:06:10.258816 18496 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9c85edb9bd89406ab873f6077f3f931d [term 1 FOLLOWER]: Refusing update from remote peer e2cbfbc8bc0942b4868b1d295ba5b12c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:06:10.259198 18819 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf98f37e4e940d3bcfb1d913b84475c" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 38789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:06:10.259923 18819 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c85edb9bd89406ab873f6077f3f931d" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 39845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:06:10.296212 18837 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bf98f37e4e940d3bcfb1d913b84475c [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2cbfbc8bc0942b4868b1d295ba5b12c. Latest consensus state: current_term: 1 leader_uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85edb9bd89406ab873f6077f3f931d" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 39845 } } peers { permanent_uuid: "8bf98f37e4e940d3bcfb1d913b84475c" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 38789 } } peers { permanent_uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } } }
I20260809 13:06:10.296728 18837 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bf98f37e4e940d3bcfb1d913b84475c [sys.catalog]: This master's current role is: FOLLOWER
I20260809 13:06:10.301229 18838 mvcc.cc:205] Tried to move back new op lower bound from 7316606034963456000 to 7316606034472296448. Current Snapshot: MvccSnapshot[applied={T|T < 7316606034963456000}]
I20260809 13:06:10.304994 18819 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85edb9bd89406ab873f6077f3f931d" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 39845 } } peers { permanent_uuid: "8bf98f37e4e940d3bcfb1d913b84475c" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 38789 } } peers { permanent_uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } } }
I20260809 13:06:10.305323 18819 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c [sys.catalog]: This master's current role is: LEADER
I20260809 13:06:10.311784 18776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c85edb9bd89406ab873f6077f3f931d [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2cbfbc8bc0942b4868b1d295ba5b12c. Latest consensus state: current_term: 1 leader_uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85edb9bd89406ab873f6077f3f931d" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 39845 } } peers { permanent_uuid: "8bf98f37e4e940d3bcfb1d913b84475c" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 38789 } } peers { permanent_uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } } }
I20260809 13:06:10.312165 18776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c85edb9bd89406ab873f6077f3f931d [sys.catalog]: This master's current role is: FOLLOWER
I20260809 13:06:10.314460 18837 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bf98f37e4e940d3bcfb1d913b84475c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85edb9bd89406ab873f6077f3f931d" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 39845 } } peers { permanent_uuid: "8bf98f37e4e940d3bcfb1d913b84475c" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 38789 } } peers { permanent_uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } } }
I20260809 13:06:10.314824 18837 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bf98f37e4e940d3bcfb1d913b84475c [sys.catalog]: This master's current role is: FOLLOWER
I20260809 13:06:10.316136 18828 catalog_manager.cc:1347] Generated new cluster ID: 637d0a7c8c3945de87d0c8c1034c1d21
I20260809 13:06:10.316264 18828 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:06:10.316066 18806 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85edb9bd89406ab873f6077f3f931d" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 39845 } } peers { permanent_uuid: "8bf98f37e4e940d3bcfb1d913b84475c" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 38789 } } peers { permanent_uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } } }
I20260809 13:06:10.316399 18806 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c [sys.catalog]: This master's current role is: LEADER
I20260809 13:06:10.317211 18845 mvcc.cc:205] Tried to move back new op lower bound from 7316606034963456000 to 7316606034472296448. Current Snapshot: MvccSnapshot[applied={T|T < 7316606034963456000 or (T in {7316606034963456000})}]
I20260809 13:06:10.322233 18844 mvcc.cc:205] Tried to move back new op lower bound from 7316606034963456000 to 7316606034472296448. Current Snapshot: MvccSnapshot[applied={T|T < 7316606034963456000}]
I20260809 13:06:10.337965 18776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c85edb9bd89406ab873f6077f3f931d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c85edb9bd89406ab873f6077f3f931d" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 39845 } } peers { permanent_uuid: "8bf98f37e4e940d3bcfb1d913b84475c" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 38789 } } peers { permanent_uuid: "e2cbfbc8bc0942b4868b1d295ba5b12c" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 41101 } } }
I20260809 13:06:10.338272 18776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c85edb9bd89406ab873f6077f3f931d [sys.catalog]: This master's current role is: FOLLOWER
I20260809 13:06:10.354247 18828 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:06:10.356565 18828 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:06:10.374449 18828 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c: Generated new TSK 0
I20260809 13:06:10.375701 18828 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 13:06:10.403829 18865 catalog_manager.cc:1259] Loaded cluster ID: 637d0a7c8c3945de87d0c8c1034c1d21
I20260809 13:06:10.403963 18865 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8bf98f37e4e940d3bcfb1d913b84475c: loading cluster ID for follower catalog manager: success
I20260809 13:06:10.425347 18865 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8bf98f37e4e940d3bcfb1d913b84475c: acquiring CA information for follower catalog manager: success
I20260809 13:06:10.429252 18865 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8bf98f37e4e940d3bcfb1d913b84475c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 13:06:11.051502 18794 catalog_manager.cc:1259] Loaded cluster ID: 637d0a7c8c3945de87d0c8c1034c1d21
I20260809 13:06:11.051668 18794 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9c85edb9bd89406ab873f6077f3f931d: loading cluster ID for follower catalog manager: success
I20260809 13:06:11.054435 18794 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9c85edb9bd89406ab873f6077f3f931d: acquiring CA information for follower catalog manager: success
I20260809 13:06:11.056668 18794 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9c85edb9bd89406ab873f6077f3f931d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 13:06:11.539037 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 18431
I20260809 13:06:11.540998 18527 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:06:11.657088 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 18431
I20260809 13:06:11.686937 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 18542
I20260809 13:06:11.688179 18632 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:06:11.708827 18883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:11.707858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:39845 (local address 127.0.0.1:56152)
0809 13:06:11.708416 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:11.708641 (+ 225us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:39845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":319,"threads_started":1}
W20260809 13:06:11.709184 18685 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.155.254:39845: connect: Connection refused (error 111)
I20260809 13:06:11.710740 18883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:11.710361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:39845 (local address 127.0.0.1:56160)
0809 13:06:11.710532 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:11.710616 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:39845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 13:06:11.710963 18685 consensus_peers.cc:487] T 00000000000000000000000000000000 P e2cbfbc8bc0942b4868b1d295ba5b12c -> Peer 9c85edb9bd89406ab873f6077f3f931d (127.28.155.254:39845): Couldn't send request to peer 9c85edb9bd89406ab873f6077f3f931d. Status: Network error: Client connection negotiation failed: client connection to 127.28.155.254:39845: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 13:06:11.803131 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 18542
I20260809 13:06:11.832579 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 18653
I20260809 13:06:11.833843 18753 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:06:11.951858 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 18653
I20260809 13:06:11.951895 18883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:11.951275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:38789 (local address 127.0.0.1:60426)
0809 13:06:11.951506 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:11.951663 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:38789: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
2026-08-09T13:06:11Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (5249 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:06:12 dist-test-slave-jq4t krb5kdc[18889](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:06:12 dist-test-slave-jq4t krb5kdc[18889](info): set up 2 sockets
Aug 09 13:06:12 dist-test-slave-jq4t krb5kdc[18889](info): commencing operation
krb5kdc: starting...
W20260809 13:06:13.309633 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.306s user 0.004s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:06:13 dist-test-slave-jq4t krb5kdc[18889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280773, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:06:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:06:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
I20260809 13:06:13.624330 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:38507
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:39421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:38507
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:06:13.981804 18910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:06:13.982141 18910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:06:13.982239 18910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:06:13.989588 18910 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:06:13.989712 18910 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:06:13.989761 18910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:06:13.989822 18910 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:06:13.989868 18910 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:06:14.000062 18910 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:39421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:38507
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:38507
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:06:14.001468 18910 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:06:14.002820 18910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:06:14.015754 18918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:14.015789 18921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:14.015733 18919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:06:14.016747 18910 server_base.cc:1034] running on GCE node
I20260809 13:06:14.017584 18910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:06:14.019070 18910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:06:14.020288 18910 hybrid_clock.cc:648] HybridClock initialized: now 1786280774020246 us; error 34 us; skew 500 ppm
I20260809 13:06:14.020697 18910 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:06:14 dist-test-slave-jq4t krb5kdc[18889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280774, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:06:14.029408 18910 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:06:14.031193 18910 webserver.cc:460] Webserver started at http://127.28.155.254:35807/ using document root <none> and password file <none>
I20260809 13:06:14.031939 18910 fs_manager.cc:359] Metadata directory not provided
I20260809 13:06:14.032061 18910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:06:14.032351 18910 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:06:14.035730 18910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "fd7d174b24c443f98186ae08bcb7927b"
format_stamp: "Formatted at 2026-08-09 13:06:14 on dist-test-slave-jq4t"
server_key: "bf71859ae7857886858144acf48ef918"
server_key_iv: "5351bda5acdb778824caaa3a079c664f"
server_key_version: "encryptionkey@0"
I20260809 13:06:14.036618 18910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "fd7d174b24c443f98186ae08bcb7927b"
format_stamp: "Formatted at 2026-08-09 13:06:14 on dist-test-slave-jq4t"
server_key: "bf71859ae7857886858144acf48ef918"
server_key_iv: "5351bda5acdb778824caaa3a079c664f"
server_key_version: "encryptionkey@0"
I20260809 13:06:14.042210 18910 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 13:06:14.045858 18930 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:14.047199 18910 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260809 13:06:14.047407 18910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "fd7d174b24c443f98186ae08bcb7927b"
format_stamp: "Formatted at 2026-08-09 13:06:14 on dist-test-slave-jq4t"
server_key: "bf71859ae7857886858144acf48ef918"
server_key_iv: "5351bda5acdb778824caaa3a079c664f"
server_key_version: "encryptionkey@0"
I20260809 13:06:14.047614 18910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:06:14.104334 18910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:06:14.108911 18910 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:06:14.109208 18910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:06:14.129817 18910 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:38507
I20260809 13:06:14.129842 19007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:38507 every 8 connection(s)
I20260809 13:06:14.131367 18910 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:06:14.135542 19008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:06:14.137190 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 18910
I20260809 13:06:14.137449 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:06:14.138335 29295 external_mini_cluster.cc:1428] Setting key 955bafb0cdaf52acafab6e86dea4d332
I20260809 13:06:14.151433 19008 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd7d174b24c443f98186ae08bcb7927b: Bootstrap starting.
Aug 09 13:06:14 dist-test-slave-jq4t krb5kdc[18889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280773, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:06:14.155390 19008 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd7d174b24c443f98186ae08bcb7927b: Neither blocks nor log segments found. Creating new log.
I20260809 13:06:14.156849 19008 log.cc:824] T 00000000000000000000000000000000 P fd7d174b24c443f98186ae08bcb7927b: Log is configured to *not* fsync() on all Append() calls
I20260809 13:06:14.160121 19008 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd7d174b24c443f98186ae08bcb7927b: No bootstrap required, opened a new log
I20260809 13:06:14.163739 19012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:14.140352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45948 (local address 127.28.155.254:38507)
0809 13:06:14.141326 (+ 974us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:14.141338 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:14.141388 (+ 50us) server_negotiation.cc:407] Connection header received
0809 13:06:14.143052 (+ 1664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:14.143075 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:14.143486 (+ 411us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:14.143837 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:14.145937 (+ 2100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:14.147285 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:14.149293 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:14.149967 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:14.150097 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:14.155403 (+ 5306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:14.155413 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:14.155428 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:14.155467 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:14.159373 (+ 3906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:14.160158 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:14.160165 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:14.160171 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:14.160400 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:14.160861 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:14.160866 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:14.160870 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:14.161401 (+ 531us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:14.161770 (+ 369us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:14.162259 (+ 489us) server_negotiation.cc:299] Negotiation successful
0809 13:06:14.162718 (+ 459us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":731,"thread_start_us":468,"threads_started":1}
I20260809 13:06:14.167798 29295 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 13:06:14.169092 19008 raft_consensus.cc:348] T 00000000000000000000000000000000 P fd7d174b24c443f98186ae08bcb7927b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd7d174b24c443f98186ae08bcb7927b" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 38507 } }
I20260809 13:06:14.169482 19008 raft_consensus.cc:374] T 00000000000000000000000000000000 P fd7d174b24c443f98186ae08bcb7927b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:06:14.169601 19008 raft_consensus.cc:729] T 00000000000000000000000000000000 P fd7d174b24c443f98186ae08bcb7927b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd7d174b24c443f98186ae08bcb7927b, State: Initialized, Role: FOLLOWER
I20260809 13:06:14.170306 19008 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd7d174b24c443f98186ae08bcb7927b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd7d174b24c443f98186ae08bcb7927b" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 38507 } }
I20260809 13:06:14.170604 19008 raft_consensus.cc:388] T 00000000000000000000000000000000 P fd7d174b24c443f98186ae08bcb7927b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:06:14.170764 19008 raft_consensus.cc:482] T 00000000000000000000000000000000 P fd7d174b24c443f98186ae08bcb7927b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:06:14.170985 19008 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fd7d174b24c443f98186ae08bcb7927b [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:06:14.173408 19008 raft_consensus.cc:504] T 00000000000000000000000000000000 P fd7d174b24c443f98186ae08bcb7927b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd7d174b24c443f98186ae08bcb7927b" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 38507 } }
I20260809 13:06:14.173869 19008 leader_election.cc:302] T 00000000000000000000000000000000 P fd7d174b24c443f98186ae08bcb7927b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fd7d174b24c443f98186ae08bcb7927b; no voters:
I20260809 13:06:14.174405 19008 leader_election.cc:288] T 00000000000000000000000000000000 P fd7d174b24c443f98186ae08bcb7927b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:06:14.174561 19015 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fd7d174b24c443f98186ae08bcb7927b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:06:14.175324 19015 raft_consensus.cc:686] T 00000000000000000000000000000000 P fd7d174b24c443f98186ae08bcb7927b [term 1 LEADER]: Becoming Leader. State: Replica: fd7d174b24c443f98186ae08bcb7927b, State: Running, Role: LEADER
I20260809 13:06:14.175844 19015 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd7d174b24c443f98186ae08bcb7927b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd7d174b24c443f98186ae08bcb7927b" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 38507 } }
I20260809 13:06:14.176671 19008 sys_catalog.cc:564] T 00000000000000000000000000000000 P fd7d174b24c443f98186ae08bcb7927b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:06:14.178846 19016 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd7d174b24c443f98186ae08bcb7927b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fd7d174b24c443f98186ae08bcb7927b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd7d174b24c443f98186ae08bcb7927b" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 38507 } } }
I20260809 13:06:14.179298 19016 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd7d174b24c443f98186ae08bcb7927b [sys.catalog]: This master's current role is: LEADER
I20260809 13:06:14.179382 19017 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd7d174b24c443f98186ae08bcb7927b [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd7d174b24c443f98186ae08bcb7927b. Latest consensus state: current_term: 1 leader_uuid: "fd7d174b24c443f98186ae08bcb7927b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd7d174b24c443f98186ae08bcb7927b" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 38507 } } }
I20260809 13:06:14.179801 19017 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd7d174b24c443f98186ae08bcb7927b [sys.catalog]: This master's current role is: LEADER
I20260809 13:06:14.184468 19028 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:06:14.188840 19028 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:06:14.196947 19028 catalog_manager.cc:1347] Generated new cluster ID: b48d4918da5d458095d682b6c40370a0
I20260809 13:06:14.197077 19028 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:06:14.210530 19028 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:06:14.212563 19028 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:06:14.229671 19028 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fd7d174b24c443f98186ae08bcb7927b: Generated new TSK 0
I20260809 13:06:14.230561 19028 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 13:06:14.280995 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 18910
I20260809 13:06:14.282693 19001 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:06:14.385313 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 18910
2026-08-09T13:06:14Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2428 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:06:14 dist-test-slave-jq4t krb5kdc[19052](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:06:14 dist-test-slave-jq4t krb5kdc[19052](info): set up 2 sockets
Aug 09 13:06:14 dist-test-slave-jq4t krb5kdc[19052](info): commencing operation
krb5kdc: starting...
W20260809 13:06:15.734179 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.301s user 0.001s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:06:15 dist-test-slave-jq4t krb5kdc[19052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280775, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:06:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:06:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
I20260809 13:06:16.056057 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:37021
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:35283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:37021
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:06:16.420006 19071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:06:16.420378 19071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:06:16.420598 19071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:06:16.427994 19071 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:06:16.428153 19071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:06:16.428272 19071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:06:16.428373 19071 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:06:16.428465 19071 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:06:16.438859 19071 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:35283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:37021
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:37021
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:06:16.440362 19071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:06:16.441817 19071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:06:16.454773 19078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:16.454710 19079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:16.454728 19083 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:06:16.455744 19071 server_base.cc:1034] running on GCE node
I20260809 13:06:16.456720 19071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:06:16.458293 19071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:06:16.459563 19071 hybrid_clock.cc:648] HybridClock initialized: now 1786280776459503 us; error 46 us; skew 500 ppm
I20260809 13:06:16.459976 19071 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:06:16 dist-test-slave-jq4t krb5kdc[19052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280776, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:06:16.463459 19071 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:06:16.465216 19071 webserver.cc:460] Webserver started at http://127.28.155.254:34851/ using document root <none> and password file <none>
I20260809 13:06:16.465960 19071 fs_manager.cc:359] Metadata directory not provided
I20260809 13:06:16.466125 19071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:06:16.466455 19071 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:06:16.469816 19071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "ac2678a030804cbf9918b24d968d2adf"
format_stamp: "Formatted at 2026-08-09 13:06:16 on dist-test-slave-jq4t"
server_key: "88ba519096941ba79be43db75eaeaa0a"
server_key_iv: "6c22c0a192e91730179cda8a81c1462a"
server_key_version: "encryptionkey@0"
I20260809 13:06:16.470683 19071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "ac2678a030804cbf9918b24d968d2adf"
format_stamp: "Formatted at 2026-08-09 13:06:16 on dist-test-slave-jq4t"
server_key: "88ba519096941ba79be43db75eaeaa0a"
server_key_iv: "6c22c0a192e91730179cda8a81c1462a"
server_key_version: "encryptionkey@0"
I20260809 13:06:16.476413 19071 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 13:06:16.480008 19095 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:16.481470 19071 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:06:16.481690 19071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "ac2678a030804cbf9918b24d968d2adf"
format_stamp: "Formatted at 2026-08-09 13:06:16 on dist-test-slave-jq4t"
server_key: "88ba519096941ba79be43db75eaeaa0a"
server_key_iv: "6c22c0a192e91730179cda8a81c1462a"
server_key_version: "encryptionkey@0"
I20260809 13:06:16.481921 19071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:06:16.516630 19071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:06:16.521317 19071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:06:16.521654 19071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:06:16.542896 19071 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:37021
I20260809 13:06:16.542964 19162 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:37021 every 8 connection(s)
I20260809 13:06:16.544426 19071 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:06:16.548432 19164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:06:16.548751 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 19071
I20260809 13:06:16.548977 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:06:16.549671 29295 external_mini_cluster.cc:1428] Setting key a2907bbabcbe318db1ce179d74848020
I20260809 13:06:16.562281 19164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf: Bootstrap starting.
Aug 09 13:06:16 dist-test-slave-jq4t krb5kdc[19052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280775, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:06:16.565907 19164 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf: Neither blocks nor log segments found. Creating new log.
I20260809 13:06:16.567160 19164 log.cc:824] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf: Log is configured to *not* fsync() on all Append() calls
I20260809 13:06:16.570623 19164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf: No bootstrap required, opened a new log
I20260809 13:06:16.574926 19169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:16.551926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35446 (local address 127.28.155.254:37021)
0809 13:06:16.552855 (+ 929us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:16.552869 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:16.552917 (+ 48us) server_negotiation.cc:407] Connection header received
0809 13:06:16.555169 (+ 2252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:16.555199 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:16.555656 (+ 457us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:16.556116 (+ 460us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:16.557778 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:16.559166 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:16.560625 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:16.561358 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:16.561568 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:16.566381 (+ 4813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:16.566390 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:16.566409 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:16.566450 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:16.569864 (+ 3414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:16.570697 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:16.570704 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:16.570711 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:16.570964 (+ 253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:16.571420 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:16.571428 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:16.571430 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:16.572014 (+ 584us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:16.572394 (+ 380us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:16.572896 (+ 502us) server_negotiation.cc:299] Negotiation successful
0809 13:06:16.573433 (+ 537us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":696,"thread_start_us":422,"threads_started":1}
I20260809 13:06:16.580361 19164 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac2678a030804cbf9918b24d968d2adf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 37021 } }
I20260809 13:06:16.580839 19164 raft_consensus.cc:374] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:06:16.580960 19164 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac2678a030804cbf9918b24d968d2adf, State: Initialized, Role: FOLLOWER
I20260809 13:06:16.581566 19164 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac2678a030804cbf9918b24d968d2adf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 37021 } }
I20260809 13:06:16.581813 19164 raft_consensus.cc:388] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:06:16.581974 19164 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:06:16.582180 19164 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:06:16.584446 19164 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac2678a030804cbf9918b24d968d2adf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 37021 } }
I20260809 13:06:16.585065 19164 leader_election.cc:302] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac2678a030804cbf9918b24d968d2adf; no voters:
I20260809 13:06:16.585805 19164 leader_election.cc:288] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:06:16.585944 19172 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:06:16.586751 19172 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [term 1 LEADER]: Becoming Leader. State: Replica: ac2678a030804cbf9918b24d968d2adf, State: Running, Role: LEADER
I20260809 13:06:16.587414 19172 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac2678a030804cbf9918b24d968d2adf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 37021 } }
I20260809 13:06:16.588290 19164 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:06:16.590623 19175 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac2678a030804cbf9918b24d968d2adf. Latest consensus state: current_term: 1 leader_uuid: "ac2678a030804cbf9918b24d968d2adf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac2678a030804cbf9918b24d968d2adf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 37021 } } }
I20260809 13:06:16.590790 19174 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ac2678a030804cbf9918b24d968d2adf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac2678a030804cbf9918b24d968d2adf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 37021 } } }
I20260809 13:06:16.591164 19174 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [sys.catalog]: This master's current role is: LEADER
I20260809 13:06:16.591171 19175 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [sys.catalog]: This master's current role is: LEADER
I20260809 13:06:16.593127 19182 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:06:16.598456 19182 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:06:16.608572 19182 catalog_manager.cc:1347] Generated new cluster ID: 87b413152a764f2f97e02268b18f5f68
I20260809 13:06:16.608718 19182 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:06:16.630580 19182 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:06:16.632143 19182 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:06:16.644009 19182 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf: Generated new TSK 0
I20260809 13:06:16.645031 19182 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
I20260809 13:06:16.741094 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:0
--local_ip_for_outbound_sockets=127.28.155.193
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:37021
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:35283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:06:17.104219 19208 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:06:17.104704 19208 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:06:17.104905 19208 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:06:17.112443 19208 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:06:17.112635 19208 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:06:17.112823 19208 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:06:17.123073 19208 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:35283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:37021
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:06:17.124622 19208 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:06:17.126058 19208 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:06:17.140717 19216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:17.140688 19218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:17.140636 19221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:06:17.141594 19208 server_base.cc:1034] running on GCE node
I20260809 13:06:17.142278 19208 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:06:17.143407 19208 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:06:17.144774 19208 hybrid_clock.cc:648] HybridClock initialized: now 1786280777144711 us; error 63 us; skew 500 ppm
I20260809 13:06:17.145172 19208 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:06:17 dist-test-slave-jq4t krb5kdc[19052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280777, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:06:17.148658 19208 init.cc:377] Logged in from keytab as kudu/127.28.155.193@KRBTEST.COM (short username kudu)
I20260809 13:06:17.150173 19208 webserver.cc:460] Webserver started at http://127.28.155.193:46449/ using document root <none> and password file <none>
I20260809 13:06:17.150925 19208 fs_manager.cc:359] Metadata directory not provided
I20260809 13:06:17.151081 19208 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:06:17.151410 19208 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:06:17.154560 19208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/data/instance:
uuid: "ccd9690928c143dcbcd6e9466ee79548"
format_stamp: "Formatted at 2026-08-09 13:06:17 on dist-test-slave-jq4t"
server_key: "d730b86364d26080ec6b75c87654179e"
server_key_iv: "f85e42d7ee094804a1628bc154166661"
server_key_version: "encryptionkey@0"
I20260809 13:06:17.155405 19208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance:
uuid: "ccd9690928c143dcbcd6e9466ee79548"
format_stamp: "Formatted at 2026-08-09 13:06:17 on dist-test-slave-jq4t"
server_key: "d730b86364d26080ec6b75c87654179e"
server_key_iv: "f85e42d7ee094804a1628bc154166661"
server_key_version: "encryptionkey@0"
I20260809 13:06:17.160991 19208 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260809 13:06:17.164705 19231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:17.166098 19208 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:06:17.166287 19208 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "ccd9690928c143dcbcd6e9466ee79548"
format_stamp: "Formatted at 2026-08-09 13:06:17 on dist-test-slave-jq4t"
server_key: "d730b86364d26080ec6b75c87654179e"
server_key_iv: "f85e42d7ee094804a1628bc154166661"
server_key_version: "encryptionkey@0"
I20260809 13:06:17.166527 19208 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:06:17.193320 19208 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:06:17.198524 19208 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:06:17.198884 19208 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:06:17.199993 19208 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:06:17.201570 19208 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:06:17.201680 19208 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:17.201841 19208 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:06:17.201920 19208 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:17.237803 19208 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:33563
I20260809 13:06:17.237856 19398 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:33563 every 8 connection(s)
I20260809 13:06:17.239248 19208 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:06:17.243793 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 19208
I20260809 13:06:17.244051 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance
I20260809 13:06:17.245038 29295 external_mini_cluster.cc:1428] Setting key fd1a92494ef84aaac6415fe25c7e3db4
Aug 09 13:06:17 dist-test-slave-jq4t krb5kdc[19052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280777, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:06:17.262900 19404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:17.242044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:34523 (local address 127.28.155.254:37021)
0809 13:06:17.242578 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:17.242584 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:17.243578 (+ 994us) server_negotiation.cc:407] Connection header received
0809 13:06:17.246216 (+ 2638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:17.246222 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:17.246325 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:17.246460 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:17.248349 (+ 1889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:17.249177 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:17.250864 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:17.251306 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:17.251455 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:17.255291 (+ 3836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:17.255300 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:17.255308 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:17.255360 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:17.259188 (+ 3828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:17.260241 (+ 1053us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:17.260246 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:17.260248 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:17.260388 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:17.260990 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:17.260993 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:17.260995 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:17.261289 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:17.261408 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:17.262430 (+ 1022us) server_negotiation.cc:299] Negotiation successful
0809 13:06:17.262634 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":291,"threads_started":1}
I20260809 13:06:17.264673 19405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:17.242518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.193:34523)
0809 13:06:17.243350 (+ 832us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:17.243408 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:17.245925 (+ 2517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:17.246748 (+ 823us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:17.246757 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:17.247503 (+ 746us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:06:17.248150 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:17.248170 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:17.249361 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:17.249365 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:17.250675 (+ 1310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:17.250689 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:17.251569 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:17.251579 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:17.251846 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:17.252658 (+ 812us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:06:17.252684 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:06:17.255031 (+ 2347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:06:17.259408 (+ 4377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:17.259417 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:17.259433 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:17.260082 (+ 649us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:17.260528 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:17.260535 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:17.260547 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:17.260853 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:17.261445 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:06:17.261456 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:06:17.261990 (+ 534us) client_negotiation.cc:769] Sending connection context
0809 13:06:17.262327 (+ 337us) client_negotiation.cc:240] Negotiation successful
0809 13:06:17.262987 (+ 660us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":287,"threads_started":1}
I20260809 13:06:17.266464 19400 heartbeater.cc:347] Connected to a master server at 127.28.155.254:37021
I20260809 13:06:17.266801 19400 heartbeater.cc:464] Registering TS with master...
I20260809 13:06:17.267596 19400 heartbeater.cc:511] Master 127.28.155.254:37021 requested a full tablet report, sending...
I20260809 13:06:17.269942 19119 ts_manager.cc:194] Registered new tserver with Master: ccd9690928c143dcbcd6e9466ee79548 (127.28.155.193:33563)
I20260809 13:06:17.271767 19119 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.193@KRBTEST.COM'} at 127.28.155.193:34523
WARNING: no policy specified for kudu/127.28.155.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
I20260809 13:06:17.316375 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:0
--local_ip_for_outbound_sockets=127.28.155.194
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:37021
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:35283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:06:17.680558 19409 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:06:17.680915 19409 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:06:17.681093 19409 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:06:17.688673 19409 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:06:17.688824 19409 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:06:17.688951 19409 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:06:17.699134 19409 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:35283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:37021
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:06:17.700541 19409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:06:17.701879 19409 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:06:17.715392 19418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:17.715555 19416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:17.715524 19415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:06:17.716722 19409 server_base.cc:1034] running on GCE node
I20260809 13:06:17.717425 19409 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:06:17.718427 19409 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:06:17.719632 19409 hybrid_clock.cc:648] HybridClock initialized: now 1786280777719582 us; error 40 us; skew 500 ppm
I20260809 13:06:17.719957 19409 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:06:17 dist-test-slave-jq4t krb5kdc[19052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280777, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:06:17.723209 19409 init.cc:377] Logged in from keytab as kudu/127.28.155.194@KRBTEST.COM (short username kudu)
I20260809 13:06:17.724773 19409 webserver.cc:460] Webserver started at http://127.28.155.194:33789/ using document root <none> and password file <none>
I20260809 13:06:17.725418 19409 fs_manager.cc:359] Metadata directory not provided
I20260809 13:06:17.725519 19409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:06:17.725777 19409 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:06:17.728859 19409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/data/instance:
uuid: "b0b9ac39534841aa86be80adb09e97cd"
format_stamp: "Formatted at 2026-08-09 13:06:17 on dist-test-slave-jq4t"
server_key: "193462058ee1266ef9e24b25c930d383"
server_key_iv: "9b831eb0bb541863b83152e896f9eb22"
server_key_version: "encryptionkey@0"
I20260809 13:06:17.729640 19409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance:
uuid: "b0b9ac39534841aa86be80adb09e97cd"
format_stamp: "Formatted at 2026-08-09 13:06:17 on dist-test-slave-jq4t"
server_key: "193462058ee1266ef9e24b25c930d383"
server_key_iv: "9b831eb0bb541863b83152e896f9eb22"
server_key_version: "encryptionkey@0"
I20260809 13:06:17.735071 19409 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 13:06:17.738759 19430 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:17.740224 19409 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 13:06:17.740399 19409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "b0b9ac39534841aa86be80adb09e97cd"
format_stamp: "Formatted at 2026-08-09 13:06:17 on dist-test-slave-jq4t"
server_key: "193462058ee1266ef9e24b25c930d383"
server_key_iv: "9b831eb0bb541863b83152e896f9eb22"
server_key_version: "encryptionkey@0"
I20260809 13:06:17.740638 19409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:06:17.770920 19409 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:06:17.775630 19409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:06:17.776000 19409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:06:17.777158 19409 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:06:17.778687 19409 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:06:17.778769 19409 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:17.778939 19409 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:06:17.779016 19409 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:17.815809 19409 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:37509
I20260809 13:06:17.815867 19597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:37509 every 8 connection(s)
I20260809 13:06:17.817335 19409 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:06:17.819068 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 19409
I20260809 13:06:17.819290 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance
I20260809 13:06:17.819774 29295 external_mini_cluster.cc:1428] Setting key 331e482fa4cb0c44d3c8610fe31af9a9
Aug 09 13:06:17 dist-test-slave-jq4t krb5kdc[19052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280777, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:06:17.843765 19602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:17.820319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:34567 (local address 127.28.155.254:37021)
0809 13:06:17.823292 (+ 2973us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:17.823296 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:17.823314 (+ 18us) server_negotiation.cc:407] Connection header received
0809 13:06:17.825730 (+ 2416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:17.825735 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:17.825809 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:17.825912 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:17.828205 (+ 2293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:17.829095 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:17.831730 (+ 2635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:17.832422 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:17.832612 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:17.837367 (+ 4755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:17.837373 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:17.837376 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:17.837414 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:17.840306 (+ 2892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:17.841164 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:17.841170 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:17.841174 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:17.841323 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:17.841804 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:17.841808 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:17.841810 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:17.842100 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:17.842280 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:17.843025 (+ 745us) server_negotiation.cc:299] Negotiation successful
0809 13:06:17.843329 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2861,"thread_start_us":2735,"threads_started":1}
I20260809 13:06:17.845448 19603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:17.821121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.194:34567)
0809 13:06:17.822335 (+ 1214us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:17.822389 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:17.825364 (+ 2975us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:17.826217 (+ 853us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:17.826231 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:17.827076 (+ 845us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:06:17.827978 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:17.828008 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:17.829267 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:17.829275 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:17.831553 (+ 2278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:17.831572 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:17.832707 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:17.832717 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:17.833083 (+ 366us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:17.833971 (+ 888us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:06:17.834008 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:06:17.837084 (+ 3076us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:06:17.840521 (+ 3437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:17.840532 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:17.840557 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:17.841025 (+ 468us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:17.841454 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:17.841459 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:17.841464 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:17.841666 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:17.842240 (+ 574us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:06:17.842252 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:06:17.842643 (+ 391us) client_negotiation.cc:769] Sending connection context
0809 13:06:17.842925 (+ 282us) client_negotiation.cc:240] Negotiation successful
0809 13:06:17.843832 (+ 907us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":889,"thread_start_us":599,"threads_started":1}
I20260809 13:06:17.847254 19600 heartbeater.cc:347] Connected to a master server at 127.28.155.254:37021
I20260809 13:06:17.847626 19600 heartbeater.cc:464] Registering TS with master...
I20260809 13:06:17.848680 19600 heartbeater.cc:511] Master 127.28.155.254:37021 requested a full tablet report, sending...
I20260809 13:06:17.850559 19119 ts_manager.cc:194] Registered new tserver with Master: b0b9ac39534841aa86be80adb09e97cd (127.28.155.194:37509)
I20260809 13:06:17.851540 19119 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.194@KRBTEST.COM'} at 127.28.155.194:34567
WARNING: no policy specified for kudu/127.28.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
I20260809 13:06:17.896143 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:0
--local_ip_for_outbound_sockets=127.28.155.195
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:37021
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:35283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:06:18.260730 19607 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:06:18.261042 19607 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:06:18.261231 19607 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:06:18.268808 19607 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:06:18.268939 19607 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:06:18.269138 19607 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:06:18.275146 19400 heartbeater.cc:503] Master 127.28.155.254:37021 was elected leader, sending a full tablet report...
I20260809 13:06:18.279868 19607 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:35283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:37021
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:06:18.281338 19607 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:06:18.282696 19607 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:06:18.296607 19612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:18.296651 19616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:18.296564 19613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:06:18.297698 19607 server_base.cc:1034] running on GCE node
I20260809 13:06:18.298453 19607 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:06:18.299500 19607 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:06:18.300714 19607 hybrid_clock.cc:648] HybridClock initialized: now 1786280778300666 us; error 42 us; skew 500 ppm
I20260809 13:06:18.301066 19607 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:06:18 dist-test-slave-jq4t krb5kdc[19052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280778, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:06:18.304570 19607 init.cc:377] Logged in from keytab as kudu/127.28.155.195@KRBTEST.COM (short username kudu)
I20260809 13:06:18.306202 19607 webserver.cc:460] Webserver started at http://127.28.155.195:45463/ using document root <none> and password file <none>
I20260809 13:06:18.307003 19607 fs_manager.cc:359] Metadata directory not provided
I20260809 13:06:18.307163 19607 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:06:18.307497 19607 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:06:18.310655 19607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/data/instance:
uuid: "cffa3bdea6f94460bcc45e03cf90ec07"
format_stamp: "Formatted at 2026-08-09 13:06:18 on dist-test-slave-jq4t"
server_key: "2e253cc9a93850a83e91eb937984f692"
server_key_iv: "7d35be29fc5da39b95bceb61d87afed9"
server_key_version: "encryptionkey@0"
I20260809 13:06:18.311498 19607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance:
uuid: "cffa3bdea6f94460bcc45e03cf90ec07"
format_stamp: "Formatted at 2026-08-09 13:06:18 on dist-test-slave-jq4t"
server_key: "2e253cc9a93850a83e91eb937984f692"
server_key_iv: "7d35be29fc5da39b95bceb61d87afed9"
server_key_version: "encryptionkey@0"
I20260809 13:06:18.316870 19607 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 13:06:18.320338 19627 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:18.321704 19607 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:06:18.321902 19607 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "cffa3bdea6f94460bcc45e03cf90ec07"
format_stamp: "Formatted at 2026-08-09 13:06:18 on dist-test-slave-jq4t"
server_key: "2e253cc9a93850a83e91eb937984f692"
server_key_iv: "7d35be29fc5da39b95bceb61d87afed9"
server_key_version: "encryptionkey@0"
I20260809 13:06:18.322113 19607 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:06:18.338771 19607 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:06:18.343472 19607 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:06:18.343794 19607 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:06:18.345045 19607 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:06:18.346622 19607 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:06:18.346750 19607 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:18.346904 19607 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:06:18.346979 19607 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:18.382262 19607 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:33887
I20260809 13:06:18.382302 19799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:33887 every 8 connection(s)
I20260809 13:06:18.383625 19607 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:06:18.388814 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 19607
I20260809 13:06:18.389052 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance
I20260809 13:06:18.389719 29295 external_mini_cluster.cc:1428] Setting key 040f16e383127a8214bbc1b953aedcb8
Aug 09 13:06:18 dist-test-slave-jq4t krb5kdc[19052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280778, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:06:18.405833 19803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:18.386818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:53987 (local address 127.28.155.254:37021)
0809 13:06:18.387327 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:18.387332 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:18.388570 (+ 1238us) server_negotiation.cc:407] Connection header received
0809 13:06:18.391039 (+ 2469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:18.391044 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:18.391158 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:18.391276 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:18.393438 (+ 2162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.394305 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.395842 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.396237 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.396328 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:18.399791 (+ 3463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:18.399795 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:18.399799 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:18.399832 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:18.402468 (+ 2636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:18.403189 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:18.403193 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:18.403195 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:18.403320 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:18.403792 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:18.403795 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:18.403797 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:18.404086 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:18.404265 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:18.405167 (+ 902us) server_negotiation.cc:299] Negotiation successful
0809 13:06:18.405410 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":398,"thread_start_us":259,"threads_started":1}
I20260809 13:06:18.406848 19805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:18.387391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.195:53987)
0809 13:06:18.388199 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:18.388249 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:18.390700 (+ 2451us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:18.391601 (+ 901us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:18.391615 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:18.392367 (+ 752us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:06:18.393228 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:18.393249 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.394448 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.394452 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:18.395718 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:18.395730 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.396430 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.396434 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:18.396701 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:18.397333 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:06:18.397355 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:06:18.399591 (+ 2236us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:06:18.402614 (+ 3023us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:18.402621 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:18.402633 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:18.403070 (+ 437us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:18.403412 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:18.403415 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:18.403417 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:18.403676 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:18.404229 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:06:18.404238 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:06:18.404760 (+ 522us) client_negotiation.cc:769] Sending connection context
0809 13:06:18.405066 (+ 306us) client_negotiation.cc:240] Negotiation successful
0809 13:06:18.405649 (+ 583us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":306,"threads_started":1}
I20260809 13:06:18.408269 19801 heartbeater.cc:347] Connected to a master server at 127.28.155.254:37021
I20260809 13:06:18.408699 19801 heartbeater.cc:464] Registering TS with master...
I20260809 13:06:18.409539 19801 heartbeater.cc:511] Master 127.28.155.254:37021 requested a full tablet report, sending...
I20260809 13:06:18.411128 19119 ts_manager.cc:194] Registered new tserver with Master: cffa3bdea6f94460bcc45e03cf90ec07 (127.28.155.195:33887)
I20260809 13:06:18.412012 19119 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.195@KRBTEST.COM'} at 127.28.155.195:53987
I20260809 13:06:18.418789 29295 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 13:06:18.437682 19803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:18.423830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35452 (local address 127.28.155.254:37021)
0809 13:06:18.424045 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:18.424050 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:18.424565 (+ 515us) server_negotiation.cc:407] Connection header received
0809 13:06:18.424799 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:18.424803 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:18.424877 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:18.424991 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:18.426631 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.427516 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.429025 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.429434 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.429535 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:18.432011 (+ 2476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:18.432015 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:18.432018 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:18.432052 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:18.434979 (+ 2927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:18.435698 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:18.435703 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:18.435705 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:18.435877 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:18.436262 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:18.436265 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:18.436267 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:18.436733 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:18.436958 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:18.437229 (+ 271us) server_negotiation.cc:299] Negotiation successful
0809 13:06:18.437436 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260809 13:06:18.442368 19119 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35452:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 13:06:18.450161 19119 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:06:18.473440 19820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:18.463886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:37509 (local address 127.0.0.1:57716)
0809 13:06:18.465035 (+ 1149us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:18.465082 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:18.465271 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:18.466572 (+ 1301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:18.466579 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:18.466611 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:06:18.467000 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:18.467010 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.468601 (+ 1591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.468607 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:18.470889 (+ 2282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:18.470907 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.472332 (+ 1425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.472339 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:18.472598 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:18.472655 (+ 57us) client_negotiation.cc:769] Sending connection context
0809 13:06:18.472801 (+ 146us) client_negotiation.cc:240] Negotiation successful
0809 13:06:18.473023 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":908,"thread_start_us":742,"threads_started":1}
I20260809 13:06:18.474629 19822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:18.464159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57716 (local address 127.28.155.194:37509)
0809 13:06:18.465929 (+ 1770us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:18.465939 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:18.465970 (+ 31us) server_negotiation.cc:407] Connection header received
0809 13:06:18.466088 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:18.466097 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:18.466300 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:18.467175 (+ 875us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:06:18.467363 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.468428 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.471097 (+ 2669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.472099 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.472302 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:18.473757 (+ 1455us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:18.474149 (+ 392us) server_negotiation.cc:299] Negotiation successful
0809 13:06:18.474371 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1601,"thread_start_us":1464,"threads_started":1}
I20260809 13:06:18.479713 19502 tablet_service.cc:1467] Processing CreateTablet for tablet 3fa2eab241604d8c944fb8bd01b78f52 (DEFAULT_TABLE table=test-table [id=731faa3e9a1b42d093c3cc8067b4f79c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:06:18.481657 19502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fa2eab241604d8c944fb8bd01b78f52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:06:18.485992 19821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:18.464143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:33563 (local address 127.0.0.1:45266)
0809 13:06:18.465854 (+ 1711us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:18.465870 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:18.465990 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:18.479290 (+ 13300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:18.479296 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:18.479339 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:06:18.479696 (+ 357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:18.479707 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.481425 (+ 1718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.481432 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:18.483443 (+ 2011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:18.483457 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.485021 (+ 1564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.485030 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:18.485245 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:18.485291 (+ 46us) client_negotiation.cc:769] Sending connection context
0809 13:06:18.485392 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 13:06:18.485538 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1595,"mutex_wait_us":1,"thread_start_us":1707,"threads_started":1}
I20260809 13:06:18.486025 19826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:18.465586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45266 (local address 127.28.155.193:33563)
0809 13:06:18.476536 (+ 10950us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:18.476545 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:18.476581 (+ 36us) server_negotiation.cc:407] Connection header received
0809 13:06:18.476698 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:18.476706 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:18.478272 (+ 1566us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:18.478519 (+ 247us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:06:18.479934 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.481280 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.483625 (+ 2345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.484758 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.484993 (+ 235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:18.485256 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:18.485463 (+ 207us) server_negotiation.cc:299] Negotiation successful
0809 13:06:18.485648 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10715,"thread_start_us":9108,"threads_started":1}
I20260809 13:06:18.487658 19820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:18.464915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:33887 (local address 127.0.0.1:43362)
0809 13:06:18.474063 (+ 9148us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:18.474084 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:18.474188 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:18.480304 (+ 6116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:18.480310 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:18.480349 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:06:18.480599 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:18.480612 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.482645 (+ 2033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.482651 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:18.484568 (+ 1917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:18.484584 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.486860 (+ 2276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.486867 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:18.487059 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:18.487085 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 13:06:18.487191 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 13:06:18.487352 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8981,"thread_start_us":13998,"threads_started":1}
I20260809 13:06:18.491286 19305 tablet_service.cc:1467] Processing CreateTablet for tablet 3fa2eab241604d8c944fb8bd01b78f52 (DEFAULT_TABLE table=test-table [id=731faa3e9a1b42d093c3cc8067b4f79c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:06:18.492849 19305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fa2eab241604d8c944fb8bd01b78f52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:06:18.496047 19828 tablet_bootstrap.cc:492] T 3fa2eab241604d8c944fb8bd01b78f52 P b0b9ac39534841aa86be80adb09e97cd: Bootstrap starting.
I20260809 13:06:18.496515 19827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:18.466280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43362 (local address 127.28.155.195:33887)
0809 13:06:18.479641 (+ 13361us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:18.479650 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:18.479689 (+ 39us) server_negotiation.cc:407] Connection header received
0809 13:06:18.479799 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:18.479806 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:18.480069 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:18.480285 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:06:18.480786 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.482429 (+ 1643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.484757 (+ 2328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.486537 (+ 1780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.486760 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:18.486950 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:18.487269 (+ 319us) server_negotiation.cc:299] Negotiation successful
0809 13:06:18.487440 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13175,"thread_start_us":12995,"threads_started":1}
I20260809 13:06:18.500245 19828 tablet_bootstrap.cc:654] T 3fa2eab241604d8c944fb8bd01b78f52 P b0b9ac39534841aa86be80adb09e97cd: Neither blocks nor log segments found. Creating new log.
I20260809 13:06:18.501760 19828 log.cc:824] T 3fa2eab241604d8c944fb8bd01b78f52 P b0b9ac39534841aa86be80adb09e97cd: Log is configured to *not* fsync() on all Append() calls
I20260809 13:06:18.501222 19699 tablet_service.cc:1467] Processing CreateTablet for tablet 3fa2eab241604d8c944fb8bd01b78f52 (DEFAULT_TABLE table=test-table [id=731faa3e9a1b42d093c3cc8067b4f79c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:06:18.502873 19699 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fa2eab241604d8c944fb8bd01b78f52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:06:18.505296 19828 tablet_bootstrap.cc:492] T 3fa2eab241604d8c944fb8bd01b78f52 P b0b9ac39534841aa86be80adb09e97cd: No bootstrap required, opened a new log
I20260809 13:06:18.505611 19828 ts_tablet_manager.cc:1397] T 3fa2eab241604d8c944fb8bd01b78f52 P b0b9ac39534841aa86be80adb09e97cd: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20260809 13:06:18.509545 19830 tablet_bootstrap.cc:492] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548: Bootstrap starting.
I20260809 13:06:18.513003 19830 tablet_bootstrap.cc:654] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548: Neither blocks nor log segments found. Creating new log.
I20260809 13:06:18.514098 19830 log.cc:824] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548: Log is configured to *not* fsync() on all Append() calls
I20260809 13:06:18.516613 19828 raft_consensus.cc:348] T 3fa2eab241604d8c944fb8bd01b78f52 P b0b9ac39534841aa86be80adb09e97cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0b9ac39534841aa86be80adb09e97cd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37509 } } peers { permanent_uuid: "ccd9690928c143dcbcd6e9466ee79548" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33563 } } peers { permanent_uuid: "cffa3bdea6f94460bcc45e03cf90ec07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 33887 } }
I20260809 13:06:18.516984 19830 tablet_bootstrap.cc:492] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548: No bootstrap required, opened a new log
I20260809 13:06:18.517239 19828 raft_consensus.cc:374] T 3fa2eab241604d8c944fb8bd01b78f52 P b0b9ac39534841aa86be80adb09e97cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:06:18.517274 19830 ts_tablet_manager.cc:1397] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 13:06:18.517428 19828 raft_consensus.cc:729] T 3fa2eab241604d8c944fb8bd01b78f52 P b0b9ac39534841aa86be80adb09e97cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0b9ac39534841aa86be80adb09e97cd, State: Initialized, Role: FOLLOWER
I20260809 13:06:18.518332 19828 consensus_queue.cc:260] T 3fa2eab241604d8c944fb8bd01b78f52 P b0b9ac39534841aa86be80adb09e97cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0b9ac39534841aa86be80adb09e97cd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37509 } } peers { permanent_uuid: "ccd9690928c143dcbcd6e9466ee79548" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33563 } } peers { permanent_uuid: "cffa3bdea6f94460bcc45e03cf90ec07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 33887 } }
I20260809 13:06:18.518989 19832 tablet_bootstrap.cc:492] T 3fa2eab241604d8c944fb8bd01b78f52 P cffa3bdea6f94460bcc45e03cf90ec07: Bootstrap starting.
I20260809 13:06:18.520828 19600 heartbeater.cc:503] Master 127.28.155.254:37021 was elected leader, sending a full tablet report...
I20260809 13:06:18.521519 19828 ts_tablet_manager.cc:1428] T 3fa2eab241604d8c944fb8bd01b78f52 P b0b9ac39534841aa86be80adb09e97cd: Time spent starting tablet: real 0.016s user 0.015s sys 0.000s
I20260809 13:06:18.523064 19832 tablet_bootstrap.cc:654] T 3fa2eab241604d8c944fb8bd01b78f52 P cffa3bdea6f94460bcc45e03cf90ec07: Neither blocks nor log segments found. Creating new log.
I20260809 13:06:18.524425 19832 log.cc:824] T 3fa2eab241604d8c944fb8bd01b78f52 P cffa3bdea6f94460bcc45e03cf90ec07: Log is configured to *not* fsync() on all Append() calls
I20260809 13:06:18.527915 19830 raft_consensus.cc:348] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0b9ac39534841aa86be80adb09e97cd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37509 } } peers { permanent_uuid: "ccd9690928c143dcbcd6e9466ee79548" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33563 } } peers { permanent_uuid: "cffa3bdea6f94460bcc45e03cf90ec07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 33887 } }
I20260809 13:06:18.528303 19832 tablet_bootstrap.cc:492] T 3fa2eab241604d8c944fb8bd01b78f52 P cffa3bdea6f94460bcc45e03cf90ec07: No bootstrap required, opened a new log
I20260809 13:06:18.528330 19830 raft_consensus.cc:374] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:06:18.528458 19830 raft_consensus.cc:729] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd9690928c143dcbcd6e9466ee79548, State: Initialized, Role: FOLLOWER
I20260809 13:06:18.528652 19832 ts_tablet_manager.cc:1397] T 3fa2eab241604d8c944fb8bd01b78f52 P cffa3bdea6f94460bcc45e03cf90ec07: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260809 13:06:18.529135 19830 consensus_queue.cc:260] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0b9ac39534841aa86be80adb09e97cd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37509 } } peers { permanent_uuid: "ccd9690928c143dcbcd6e9466ee79548" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33563 } } peers { permanent_uuid: "cffa3bdea6f94460bcc45e03cf90ec07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 33887 } }
I20260809 13:06:18.531190 19830 ts_tablet_manager.cc:1428] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
I20260809 13:06:18.538062 19832 raft_consensus.cc:348] T 3fa2eab241604d8c944fb8bd01b78f52 P cffa3bdea6f94460bcc45e03cf90ec07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0b9ac39534841aa86be80adb09e97cd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37509 } } peers { permanent_uuid: "ccd9690928c143dcbcd6e9466ee79548" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33563 } } peers { permanent_uuid: "cffa3bdea6f94460bcc45e03cf90ec07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 33887 } }
I20260809 13:06:18.538506 19832 raft_consensus.cc:374] T 3fa2eab241604d8c944fb8bd01b78f52 P cffa3bdea6f94460bcc45e03cf90ec07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:06:18.538640 19832 raft_consensus.cc:729] T 3fa2eab241604d8c944fb8bd01b78f52 P cffa3bdea6f94460bcc45e03cf90ec07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffa3bdea6f94460bcc45e03cf90ec07, State: Initialized, Role: FOLLOWER
I20260809 13:06:18.539248 19832 consensus_queue.cc:260] T 3fa2eab241604d8c944fb8bd01b78f52 P cffa3bdea6f94460bcc45e03cf90ec07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0b9ac39534841aa86be80adb09e97cd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37509 } } peers { permanent_uuid: "ccd9690928c143dcbcd6e9466ee79548" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33563 } } peers { permanent_uuid: "cffa3bdea6f94460bcc45e03cf90ec07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 33887 } }
I20260809 13:06:18.540372 19801 heartbeater.cc:503] Master 127.28.155.254:37021 was elected leader, sending a full tablet report...
I20260809 13:06:18.540901 19832 ts_tablet_manager.cc:1428] T 3fa2eab241604d8c944fb8bd01b78f52 P cffa3bdea6f94460bcc45e03cf90ec07: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
W20260809 13:06:18.569657 19601 tablet.cc:2369] T 3fa2eab241604d8c944fb8bd01b78f52 P b0b9ac39534841aa86be80adb09e97cd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:06:18.594900 19835 raft_consensus.cc:482] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:06:18.595218 19835 raft_consensus.cc:504] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0b9ac39534841aa86be80adb09e97cd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37509 } } peers { permanent_uuid: "ccd9690928c143dcbcd6e9466ee79548" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33563 } } peers { permanent_uuid: "cffa3bdea6f94460bcc45e03cf90ec07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 33887 } }
I20260809 13:06:18.596998 19835 leader_election.cc:288] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0b9ac39534841aa86be80adb09e97cd (127.28.155.194:37509), cffa3bdea6f94460bcc45e03cf90ec07 (127.28.155.195:33887)
I20260809 13:06:18.604221 19822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:18.597626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:57547 (local address 127.28.155.194:37509)
0809 13:06:18.597883 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:18.597892 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:18.598515 (+ 623us) server_negotiation.cc:407] Connection header received
0809 13:06:18.598684 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:18.598689 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:18.598771 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:18.598874 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:06:18.599579 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.600345 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.602374 (+ 2029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.603183 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.603301 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:18.603353 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:18.603815 (+ 462us) server_negotiation.cc:299] Negotiation successful
0809 13:06:18.603954 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 13:06:18.604312 19841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:18.597460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:37509 (local address 127.28.155.193:57547)
0809 13:06:18.598389 (+ 929us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:18.598411 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:18.598537 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:18.598910 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:18.598914 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:18.598943 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:06:18.599402 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:18.599413 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.600515 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.600522 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:18.602204 (+ 1682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:18.602217 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.603437 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.603444 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:18.603617 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:18.603665 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 13:06:18.603767 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 13:06:18.603912 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":766,"mutex_wait_us":63,"thread_start_us":704,"threads_started":1}
I20260809 13:06:18.604715 19827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:18.597523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:43917 (local address 127.28.155.195:33887)
0809 13:06:18.597775 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:18.597784 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:18.598698 (+ 914us) server_negotiation.cc:407] Connection header received
0809 13:06:18.598912 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:18.598918 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:18.599002 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:18.599107 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:06:18.599742 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.600574 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.602449 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.603598 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.603782 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:18.603886 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:18.604233 (+ 347us) server_negotiation.cc:299] Negotiation successful
0809 13:06:18.604402 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260809 13:06:18.605355 19527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fa2eab241604d8c944fb8bd01b78f52" candidate_uuid: "ccd9690928c143dcbcd6e9466ee79548" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0b9ac39534841aa86be80adb09e97cd" is_pre_election: true
I20260809 13:06:18.605993 19840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:18.597534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:33887 (local address 127.28.155.193:43917)
0809 13:06:18.598567 (+ 1033us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:18.598586 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:18.598727 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:18.599139 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:18.599143 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:18.599163 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:06:18.599548 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:18.599560 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.600715 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.600719 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:18.602216 (+ 1497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:18.602230 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.603858 (+ 1628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.603865 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:18.604033 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:18.604079 (+ 46us) client_negotiation.cc:769] Sending connection context
0809 13:06:18.604187 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 13:06:18.604416 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":880,"mutex_wait_us":2,"thread_start_us":467,"threads_started":1}
I20260809 13:06:18.605966 19527 raft_consensus.cc:2454] T 3fa2eab241604d8c944fb8bd01b78f52 P b0b9ac39534841aa86be80adb09e97cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd9690928c143dcbcd6e9466ee79548 in term 0.
I20260809 13:06:18.606784 19233 leader_election.cc:302] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0b9ac39534841aa86be80adb09e97cd, ccd9690928c143dcbcd6e9466ee79548; no voters:
I20260809 13:06:18.607066 19726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fa2eab241604d8c944fb8bd01b78f52" candidate_uuid: "ccd9690928c143dcbcd6e9466ee79548" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffa3bdea6f94460bcc45e03cf90ec07" is_pre_election: true
I20260809 13:06:18.607226 19835 raft_consensus.cc:2781] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:06:18.607388 19835 raft_consensus.cc:482] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:06:18.607517 19835 raft_consensus.cc:3037] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:06:18.607637 19726 raft_consensus.cc:2454] T 3fa2eab241604d8c944fb8bd01b78f52 P cffa3bdea6f94460bcc45e03cf90ec07 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd9690928c143dcbcd6e9466ee79548 in term 0.
I20260809 13:06:18.610168 19835 raft_consensus.cc:504] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0b9ac39534841aa86be80adb09e97cd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37509 } } peers { permanent_uuid: "ccd9690928c143dcbcd6e9466ee79548" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33563 } } peers { permanent_uuid: "cffa3bdea6f94460bcc45e03cf90ec07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 33887 } }
I20260809 13:06:18.610925 19835 leader_election.cc:288] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548 [CANDIDATE]: Term 1 election: Requested vote from peers b0b9ac39534841aa86be80adb09e97cd (127.28.155.194:37509), cffa3bdea6f94460bcc45e03cf90ec07 (127.28.155.195:33887)
I20260809 13:06:18.611392 19527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fa2eab241604d8c944fb8bd01b78f52" candidate_uuid: "ccd9690928c143dcbcd6e9466ee79548" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0b9ac39534841aa86be80adb09e97cd"
I20260809 13:06:18.611464 19726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fa2eab241604d8c944fb8bd01b78f52" candidate_uuid: "ccd9690928c143dcbcd6e9466ee79548" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffa3bdea6f94460bcc45e03cf90ec07"
I20260809 13:06:18.611652 19527 raft_consensus.cc:3037] T 3fa2eab241604d8c944fb8bd01b78f52 P b0b9ac39534841aa86be80adb09e97cd [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:06:18.611671 19726 raft_consensus.cc:3037] T 3fa2eab241604d8c944fb8bd01b78f52 P cffa3bdea6f94460bcc45e03cf90ec07 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:06:18.614082 19527 raft_consensus.cc:2454] T 3fa2eab241604d8c944fb8bd01b78f52 P b0b9ac39534841aa86be80adb09e97cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd9690928c143dcbcd6e9466ee79548 in term 1.
I20260809 13:06:18.614091 19726 raft_consensus.cc:2454] T 3fa2eab241604d8c944fb8bd01b78f52 P cffa3bdea6f94460bcc45e03cf90ec07 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd9690928c143dcbcd6e9466ee79548 in term 1.
I20260809 13:06:18.614575 19233 leader_election.cc:302] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0b9ac39534841aa86be80adb09e97cd, ccd9690928c143dcbcd6e9466ee79548; no voters:
I20260809 13:06:18.614903 19835 raft_consensus.cc:2781] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:06:18.615396 19835 raft_consensus.cc:686] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548 [term 1 LEADER]: Becoming Leader. State: Replica: ccd9690928c143dcbcd6e9466ee79548, State: Running, Role: LEADER
I20260809 13:06:18.615921 19835 consensus_queue.cc:237] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0b9ac39534841aa86be80adb09e97cd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37509 } } peers { permanent_uuid: "ccd9690928c143dcbcd6e9466ee79548" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33563 } } peers { permanent_uuid: "cffa3bdea6f94460bcc45e03cf90ec07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 33887 } }
I20260809 13:06:18.621140 19119 catalog_manager.cc:5495] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd9690928c143dcbcd6e9466ee79548 (127.28.155.193). New cstate: current_term: 1 leader_uuid: "ccd9690928c143dcbcd6e9466ee79548" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0b9ac39534841aa86be80adb09e97cd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccd9690928c143dcbcd6e9466ee79548" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cffa3bdea6f94460bcc45e03cf90ec07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 33887 } health_report { overall_health: UNKNOWN } } }
W20260809 13:06:18.635402 19802 tablet.cc:2369] T 3fa2eab241604d8c944fb8bd01b78f52 P cffa3bdea6f94460bcc45e03cf90ec07: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:06:18.672802 19826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:18.667013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45276 (local address 127.28.155.193:33563)
0809 13:06:18.667234 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:18.667239 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:18.667258 (+ 19us) server_negotiation.cc:407] Connection header received
0809 13:06:18.667362 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:18.667366 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:18.667447 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:18.667577 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:06:18.667938 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.668923 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.670531 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.670988 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.671088 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:18.671642 (+ 554us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:06:18.672188 (+ 546us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:06:18.672300 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:18.672408 (+ 108us) server_negotiation.cc:299] Negotiation successful
0809 13:06:18.672499 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 13:06:18.681576 19726 raft_consensus.cc:1261] T 3fa2eab241604d8c944fb8bd01b78f52 P cffa3bdea6f94460bcc45e03cf90ec07 [term 1 FOLLOWER]: Refusing update from remote peer ccd9690928c143dcbcd6e9466ee79548: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:06:18.681581 19527 raft_consensus.cc:1261] T 3fa2eab241604d8c944fb8bd01b78f52 P b0b9ac39534841aa86be80adb09e97cd [term 1 FOLLOWER]: Refusing update from remote peer ccd9690928c143dcbcd6e9466ee79548: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:06:18.682729 19835 consensus_queue.cc:1035] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffa3bdea6f94460bcc45e03cf90ec07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:06:18.683068 19842 consensus_queue.cc:1035] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0b9ac39534841aa86be80adb09e97cd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:06:18.697888 19848 mvcc.cc:205] Tried to move back new op lower bound from 7316606069468991488 to 7316606069215121408. Current Snapshot: MvccSnapshot[applied={T|T < 7316606069468991488}]
I20260809 13:06:18.712327 19119 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35452:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:06:18.712666 19119 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35452:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:06:18.716811 19119 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf: Sending DeleteTablet for 3 replicas of tablet 3fa2eab241604d8c944fb8bd01b78f52
I20260809 13:06:18.718272 19305 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fa2eab241604d8c944fb8bd01b78f52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:06:18 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:45266
I20260809 13:06:18.718231 19502 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fa2eab241604d8c944fb8bd01b78f52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:06:18 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:57716
I20260809 13:06:18.718304 19699 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fa2eab241604d8c944fb8bd01b78f52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:06:18 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:43362
I20260809 13:06:18.719311 19857 tablet_replica.cc:330] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548: stopping tablet replica
I20260809 13:06:18.719393 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 19208
I20260809 13:06:18.719870 19859 tablet_replica.cc:330] T 3fa2eab241604d8c944fb8bd01b78f52 P b0b9ac39534841aa86be80adb09e97cd: stopping tablet replica
I20260809 13:06:18.720335 19859 raft_consensus.cc:2229] T 3fa2eab241604d8c944fb8bd01b78f52 P b0b9ac39534841aa86be80adb09e97cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:06:18.720826 19857 raft_consensus.cc:2229] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548 [term 1 LEADER]: Raft consensus shutting down.
I20260809 13:06:18.722208 19857 raft_consensus.cc:2258] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:06:18.722426 19859 raft_consensus.cc:2258] T 3fa2eab241604d8c944fb8bd01b78f52 P b0b9ac39534841aa86be80adb09e97cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:06:18.725565 19858 tablet_replica.cc:330] T 3fa2eab241604d8c944fb8bd01b78f52 P cffa3bdea6f94460bcc45e03cf90ec07: stopping tablet replica
I20260809 13:06:18.725907 19859 ts_tablet_manager.cc:1905] T 3fa2eab241604d8c944fb8bd01b78f52 P b0b9ac39534841aa86be80adb09e97cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:06:18.726691 19858 raft_consensus.cc:2229] T 3fa2eab241604d8c944fb8bd01b78f52 P cffa3bdea6f94460bcc45e03cf90ec07 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:06:18.727344 19858 raft_consensus.cc:2258] T 3fa2eab241604d8c944fb8bd01b78f52 P cffa3bdea6f94460bcc45e03cf90ec07 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:06:18.729669 19857 ts_tablet_manager.cc:1905] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:06:18.729750 19858 ts_tablet_manager.cc:1905] T 3fa2eab241604d8c944fb8bd01b78f52 P cffa3bdea6f94460bcc45e03cf90ec07: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:06:18.733723 19859 ts_tablet_manager.cc:1918] T 3fa2eab241604d8c944fb8bd01b78f52 P b0b9ac39534841aa86be80adb09e97cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:06:18.733992 19859 log.cc:1196] T 3fa2eab241604d8c944fb8bd01b78f52 P b0b9ac39534841aa86be80adb09e97cd: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/wal/wals/3fa2eab241604d8c944fb8bd01b78f52
I20260809 13:06:18.734685 19859 ts_tablet_manager.cc:1939] T 3fa2eab241604d8c944fb8bd01b78f52 P b0b9ac39534841aa86be80adb09e97cd: Deleting consensus metadata
I20260809 13:06:18.736909 19097 catalog_manager.cc:4841] TS b0b9ac39534841aa86be80adb09e97cd (127.28.155.194:37509): tablet 3fa2eab241604d8c944fb8bd01b78f52 (table test-table [id=731faa3e9a1b42d093c3cc8067b4f79c]) successfully deleted
I20260809 13:06:18.737561 19858 ts_tablet_manager.cc:1918] T 3fa2eab241604d8c944fb8bd01b78f52 P cffa3bdea6f94460bcc45e03cf90ec07: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:06:18.737754 19858 log.cc:1196] T 3fa2eab241604d8c944fb8bd01b78f52 P cffa3bdea6f94460bcc45e03cf90ec07: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/wal/wals/3fa2eab241604d8c944fb8bd01b78f52
I20260809 13:06:18.738392 19858 ts_tablet_manager.cc:1939] T 3fa2eab241604d8c944fb8bd01b78f52 P cffa3bdea6f94460bcc45e03cf90ec07: Deleting consensus metadata
Aug 09 13:06:18 dist-test-slave-jq4t krb5kdc[19052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280775, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.193@KRBTEST.COM
I20260809 13:06:18.740449 19098 catalog_manager.cc:4841] TS cffa3bdea6f94460bcc45e03cf90ec07 (127.28.155.195:33887): tablet 3fa2eab241604d8c944fb8bd01b78f52 (table test-table [id=731faa3e9a1b42d093c3cc8067b4f79c]) successfully deleted
I20260809 13:06:18.743211 19857 ts_tablet_manager.cc:1918] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:06:18.743417 19857 log.cc:1196] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/wal/wals/3fa2eab241604d8c944fb8bd01b78f52
I20260809 13:06:18.744045 19857 ts_tablet_manager.cc:1939] T 3fa2eab241604d8c944fb8bd01b78f52 P ccd9690928c143dcbcd6e9466ee79548: Deleting consensus metadata
I20260809 13:06:18.746042 19096 catalog_manager.cc:4841] TS ccd9690928c143dcbcd6e9466ee79548 (127.28.155.193:33563): tablet 3fa2eab241604d8c944fb8bd01b78f52 (table test-table [id=731faa3e9a1b42d093c3cc8067b4f79c]) successfully deleted
I20260809 13:06:18.749011 19826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:18.720930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45292 (local address 127.28.155.193:33563)
0809 13:06:18.721196 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:18.721206 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:18.725948 (+ 4742us) server_negotiation.cc:407] Connection header received
0809 13:06:18.726266 (+ 318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:18.726272 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:18.726381 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:18.726483 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:18.729158 (+ 2675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.730264 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.732551 (+ 2287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.733295 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.733420 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:18.740567 (+ 7147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:18.740584 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:18.740604 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:18.740673 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:18.745523 (+ 4850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:18.746744 (+ 1221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:18.746752 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:18.746754 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:18.746916 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:18.747378 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:18.747382 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:18.747384 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:18.747751 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:18.748095 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:18.748405 (+ 310us) server_negotiation.cc:299] Negotiation successful
0809 13:06:18.748677 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260809 13:06:18.749759 19394 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:06:18.851887 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 19208
I20260809 13:06:18.879200 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 19409
Aug 09 13:06:18 dist-test-slave-jq4t krb5kdc[19052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280775, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.194@KRBTEST.COM
I20260809 13:06:18.901402 19822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:18.880010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57724 (local address 127.28.155.194:37509)
0809 13:06:18.880190 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:18.880194 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:18.880232 (+ 38us) server_negotiation.cc:407] Connection header received
0809 13:06:18.880425 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:18.880429 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:18.880578 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:18.880665 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:18.882401 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.883675 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.885639 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:18.886047 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:18.886243 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:18.895611 (+ 9368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:18.895634 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:18.895651 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:18.895692 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:18.898739 (+ 3047us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:18.899422 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:18.899429 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:18.899432 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:18.899564 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:18.899888 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:18.899891 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:18.899893 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:18.900298 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:18.900647 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:18.900821 (+ 174us) server_negotiation.cc:299] Negotiation successful
0809 13:06:18.900999 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 13:06:18.902132 19588 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:06:18.995328 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 19409
I20260809 13:06:19.018653 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 19607
Aug 09 13:06:19 dist-test-slave-jq4t krb5kdc[19052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280775, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.195@KRBTEST.COM
I20260809 13:06:19.039673 19827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:19.019572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43364 (local address 127.28.155.195:33887)
0809 13:06:19.019755 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:19.019760 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:19.019781 (+ 21us) server_negotiation.cc:407] Connection header received
0809 13:06:19.019909 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:19.019914 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:19.019995 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:19.020099 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:19.021641 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:19.022456 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:19.023723 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:19.024108 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:19.024200 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:19.028799 (+ 4599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:19.028825 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:19.028847 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:19.028899 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:19.036989 (+ 8090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:19.037778 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:19.037786 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:19.037789 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:19.037945 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:19.038301 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:19.038304 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:19.038307 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:19.038679 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:19.038911 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:19.039226 (+ 315us) server_negotiation.cc:299] Negotiation successful
0809 13:06:19.039409 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 13:06:19.040392 19793 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:06:19.133561 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 19607
I20260809 13:06:19.160184 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 19071
I20260809 13:06:19.161486 19157 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:06:19.277308 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 19071
I20260809 13:06:19.312127 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:37021
--webserver_interface=127.28.155.254
--webserver_port=34851
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:35283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:37021
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:06:19.674459 19865 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:06:19.674780 19865 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:06:19.674886 19865 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:06:19.682242 19865 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:06:19.682350 19865 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:06:19.682397 19865 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:06:19.682457 19865 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:06:19.682504 19865 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:06:19.692430 19865 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:35283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:37021
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:37021
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=34851
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:06:19.693780 19865 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:06:19.695160 19865 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:06:19.722110 19878 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:19.722183 19877 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:19.722134 19885 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:06:19.722981 19865 server_base.cc:1034] running on GCE node
I20260809 13:06:19.723941 19865 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:06:19.725683 19865 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:06:19.726976 19865 hybrid_clock.cc:648] HybridClock initialized: now 1786280779726915 us; error 61 us; skew 500 ppm
I20260809 13:06:19.727459 19865 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:06:19 dist-test-slave-jq4t krb5kdc[19052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280779, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:06:19.731664 19865 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:06:19.733628 19865 webserver.cc:460] Webserver started at http://127.28.155.254:34851/ using document root <none> and password file <none>
I20260809 13:06:19.734498 19865 fs_manager.cc:359] Metadata directory not provided
I20260809 13:06:19.734684 19865 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:06:19.741288 19865 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 13:06:19.744470 19899 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:19.746052 19865 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 13:06:19.746268 19865 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "ac2678a030804cbf9918b24d968d2adf"
format_stamp: "Formatted at 2026-08-09 13:06:16 on dist-test-slave-jq4t"
server_key: "88ba519096941ba79be43db75eaeaa0a"
server_key_iv: "6c22c0a192e91730179cda8a81c1462a"
server_key_version: "encryptionkey@0"
I20260809 13:06:19.747468 19865 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:06:19.763324 19865 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:06:19.768049 19865 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:06:19.768378 19865 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:06:19.789450 19865 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:37021
I20260809 13:06:19.789482 19983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:37021 every 8 connection(s)
I20260809 13:06:19.791267 19865 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:06:19.793836 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 19865
I20260809 13:06:19.794883 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:33563
--local_ip_for_outbound_sockets=127.28.155.193
--tserver_master_addrs=127.28.155.254:37021
--webserver_port=46449
--webserver_interface=127.28.155.193
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:35283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 13:06:19.801589 19984 sys_catalog.cc:263] Verifying existing consensus state
I20260809 13:06:19.807085 19984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf: Bootstrap starting.
I20260809 13:06:19.829169 19984 log.cc:824] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf: Log is configured to *not* fsync() on all Append() calls
I20260809 13:06:19.842281 19984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 13:06:19.842871 19984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf: Bootstrap complete.
I20260809 13:06:19.853015 19984 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac2678a030804cbf9918b24d968d2adf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 37021 } }
I20260809 13:06:19.853886 19984 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac2678a030804cbf9918b24d968d2adf, State: Initialized, Role: FOLLOWER
I20260809 13:06:19.854660 19984 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac2678a030804cbf9918b24d968d2adf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 37021 } }
I20260809 13:06:19.854933 19984 raft_consensus.cc:388] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:06:19.855069 19984 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:06:19.855266 19984 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [term 1 FOLLOWER]: Advancing to term 2
I20260809 13:06:19.859457 19984 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac2678a030804cbf9918b24d968d2adf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 37021 } }
I20260809 13:06:19.860105 19984 leader_election.cc:302] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac2678a030804cbf9918b24d968d2adf; no voters:
I20260809 13:06:19.861171 19984 leader_election.cc:288] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 13:06:19.861323 19991 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [term 2 FOLLOWER]: Leader election won for term 2
I20260809 13:06:19.862689 19991 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [term 2 LEADER]: Becoming Leader. State: Replica: ac2678a030804cbf9918b24d968d2adf, State: Running, Role: LEADER
I20260809 13:06:19.863358 19991 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac2678a030804cbf9918b24d968d2adf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 37021 } }
I20260809 13:06:19.863744 19984 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:06:19.866151 19994 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac2678a030804cbf9918b24d968d2adf. Latest consensus state: current_term: 2 leader_uuid: "ac2678a030804cbf9918b24d968d2adf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac2678a030804cbf9918b24d968d2adf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 37021 } } }
I20260809 13:06:19.866542 19994 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [sys.catalog]: This master's current role is: LEADER
I20260809 13:06:19.866254 19992 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ac2678a030804cbf9918b24d968d2adf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac2678a030804cbf9918b24d968d2adf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 37021 } } }
I20260809 13:06:19.866684 19992 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [sys.catalog]: This master's current role is: LEADER
I20260809 13:06:19.867537 19999 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:06:19.884694 19999 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:06:19.886965 19999 catalog_manager.cc:1259] Loaded cluster ID: 87b413152a764f2f97e02268b18f5f68
I20260809 13:06:19.887176 19999 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:06:19.890846 19999 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260809 13:06:19.909137 19999 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260809 13:06:19.933102 19999 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:06:19.934690 19999 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf: Loaded TSK: 0
I20260809 13:06:19.935873 19999 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 13:06:20.207741 19986 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:06:20.208106 19986 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:06:20.208288 19986 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:06:20.216061 19986 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:06:20.216199 19986 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:06:20.216392 19986 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:06:20.226684 19986 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:35283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:33563
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=46449
--tserver_master_addrs=127.28.155.254:37021
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:06:20.228111 19986 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:06:20.229563 19986 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:06:20.245123 20023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:20.245751 20022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:06:20.246464 19986 server_base.cc:1034] running on GCE node
W20260809 13:06:20.246594 20027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:06:20.247303 19986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:06:20.248241 19986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:06:20.249493 19986 hybrid_clock.cc:648] HybridClock initialized: now 1786280780249433 us; error 47 us; skew 500 ppm
I20260809 13:06:20.249876 19986 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:06:20 dist-test-slave-jq4t krb5kdc[19052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280780, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:06:20.253696 19986 init.cc:377] Logged in from keytab as kudu/127.28.155.193@KRBTEST.COM (short username kudu)
I20260809 13:06:20.255306 19986 webserver.cc:460] Webserver started at http://127.28.155.193:46449/ using document root <none> and password file <none>
I20260809 13:06:20.256035 19986 fs_manager.cc:359] Metadata directory not provided
I20260809 13:06:20.256192 19986 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:06:20.262012 19986 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.003s
I20260809 13:06:20.265206 20035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:20.266700 19986 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:06:20.266889 19986 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "ccd9690928c143dcbcd6e9466ee79548"
format_stamp: "Formatted at 2026-08-09 13:06:17 on dist-test-slave-jq4t"
server_key: "d730b86364d26080ec6b75c87654179e"
server_key_iv: "f85e42d7ee094804a1628bc154166661"
server_key_version: "encryptionkey@0"
I20260809 13:06:20.267903 19986 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:06:20.288097 19986 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:06:20.293100 19986 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:06:20.293419 19986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:06:20.294565 19986 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:06:20.296056 19986 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:06:20.296152 19986 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:20.296319 19986 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:06:20.296424 19986 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:20.332551 19986 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:33563
I20260809 13:06:20.332616 20211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:33563 every 8 connection(s)
I20260809 13:06:20.334167 19986 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:06:20.340987 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 19986
I20260809 13:06:20.341817 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:37509
--local_ip_for_outbound_sockets=127.28.155.194
--tserver_master_addrs=127.28.155.254:37021
--webserver_port=33789
--webserver_interface=127.28.155.194
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:35283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 13:06:20 dist-test-slave-jq4t krb5kdc[19052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280780, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:06:20.361466 20214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:20.337382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:44283 (local address 127.28.155.254:37021)
0809 13:06:20.337996 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:20.338008 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:20.338631 (+ 623us) server_negotiation.cc:407] Connection header received
0809 13:06:20.341043 (+ 2412us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:20.341065 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:20.341560 (+ 495us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:20.342015 (+ 455us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:20.343722 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:20.345821 (+ 2099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:20.347463 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:20.348628 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:20.348828 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:20.352963 (+ 4135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:20.352976 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:20.352998 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:20.353073 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:20.356411 (+ 3338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:20.357497 (+ 1086us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:20.357505 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:20.357510 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:20.357687 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:20.358245 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:20.358248 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:20.358250 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:20.358760 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:20.358950 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:20.359992 (+ 1042us) server_negotiation.cc:299] Negotiation successful
0809 13:06:20.360328 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":273,"threads_started":1}
I20260809 13:06:20.361896 20218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:20.337541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.193:44283)
0809 13:06:20.338417 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:20.338465 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:20.340319 (+ 1854us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:20.342277 (+ 1958us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:20.342285 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:20.342848 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:06:20.343450 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:20.343470 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:20.345999 (+ 2529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:20.346003 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:20.347297 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:20.347312 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:20.348884 (+ 1572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:20.348890 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:20.349104 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:20.349914 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:06:20.349939 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:06:20.352642 (+ 2703us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:06:20.356607 (+ 3965us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:20.356620 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:20.356639 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:20.357341 (+ 702us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:20.357841 (+ 500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:20.357849 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:20.357856 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:20.358121 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:20.358932 (+ 811us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:06:20.358944 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:06:20.359460 (+ 516us) client_negotiation.cc:769] Sending connection context
0809 13:06:20.359797 (+ 337us) client_negotiation.cc:240] Negotiation successful
0809 13:06:20.360447 (+ 650us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":377,"threads_started":1}
I20260809 13:06:20.364915 20212 heartbeater.cc:347] Connected to a master server at 127.28.155.254:37021
I20260809 13:06:20.365265 20212 heartbeater.cc:464] Registering TS with master...
I20260809 13:06:20.366084 20212 heartbeater.cc:511] Master 127.28.155.254:37021 requested a full tablet report, sending...
I20260809 13:06:20.368604 19929 ts_manager.cc:194] Registered new tserver with Master: ccd9690928c143dcbcd6e9466ee79548 (127.28.155.193:33563)
I20260809 13:06:20.370172 19929 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.193@KRBTEST.COM'} at 127.28.155.193:44283
W20260809 13:06:20.714349 20219 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:06:20.714648 20219 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:06:20.714802 20219 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:06:20.722535 20219 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:06:20.722658 20219 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:06:20.722860 20219 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:06:20.733114 20219 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:35283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:37509
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=33789
--tserver_master_addrs=127.28.155.254:37021
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:06:20.734503 20219 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:06:20.735898 20219 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:06:20.750339 20226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:20.750387 20227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:20.750428 20232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:06:20.751112 20219 server_base.cc:1034] running on GCE node
I20260809 13:06:20.751765 20219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:06:20.753013 20219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:06:20.754256 20219 hybrid_clock.cc:648] HybridClock initialized: now 1786280780754212 us; error 52 us; skew 500 ppm
I20260809 13:06:20.754599 20219 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:06:20 dist-test-slave-jq4t krb5kdc[19052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280780, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:06:20.758064 20219 init.cc:377] Logged in from keytab as kudu/127.28.155.194@KRBTEST.COM (short username kudu)
I20260809 13:06:20.759771 20219 webserver.cc:460] Webserver started at http://127.28.155.194:33789/ using document root <none> and password file <none>
I20260809 13:06:20.760643 20219 fs_manager.cc:359] Metadata directory not provided
I20260809 13:06:20.760823 20219 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:06:20.766731 20219 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.003s
I20260809 13:06:20.769960 20240 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:20.771464 20219 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:06:20.771701 20219 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "b0b9ac39534841aa86be80adb09e97cd"
format_stamp: "Formatted at 2026-08-09 13:06:17 on dist-test-slave-jq4t"
server_key: "193462058ee1266ef9e24b25c930d383"
server_key_iv: "9b831eb0bb541863b83152e896f9eb22"
server_key_version: "encryptionkey@0"
I20260809 13:06:20.773028 20219 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:06:20.786543 20219 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:06:20.792160 20219 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:06:20.792471 20219 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:06:20.793815 20219 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:06:20.795606 20219 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:06:20.795727 20219 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:20.795828 20219 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:06:20.795898 20219 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:20.836947 20219 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:37509
I20260809 13:06:20.837057 20401 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:37509 every 8 connection(s)
I20260809 13:06:20.838655 20219 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:06:20.839013 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 20219
I20260809 13:06:20.839912 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:33887
--local_ip_for_outbound_sockets=127.28.155.195
--tserver_master_addrs=127.28.155.254:37021
--webserver_port=45463
--webserver_interface=127.28.155.195
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:35283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 13:06:20 dist-test-slave-jq4t krb5kdc[19052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280780, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:06:20.864223 20214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:20.841893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:45283 (local address 127.28.155.254:37021)
0809 13:06:20.842133 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:20.842140 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:20.843506 (+ 1366us) server_negotiation.cc:407] Connection header received
0809 13:06:20.846550 (+ 3044us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:20.846554 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:20.846657 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:20.846751 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:20.849105 (+ 2354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:20.850214 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:20.852944 (+ 2730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:20.853732 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:20.853884 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:20.857770 (+ 3886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:20.857775 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:20.857778 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:20.857816 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:20.860730 (+ 2914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:20.861614 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:20.861620 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:20.861622 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:20.861767 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:20.862274 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:20.862278 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:20.862280 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:20.862585 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:20.862752 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:20.863541 (+ 789us) server_negotiation.cc:299] Negotiation successful
0809 13:06:20.863806 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260809 13:06:20.865556 20404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:20.842391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.194:45283)
0809 13:06:20.843272 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:20.843331 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:20.846188 (+ 2857us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:20.847065 (+ 877us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:20.847080 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:20.847942 (+ 862us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:06:20.848871 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:20.848902 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:20.850413 (+ 1511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:20.850422 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:20.852757 (+ 2335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:20.852777 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:20.853976 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:20.853996 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:20.854208 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:20.854996 (+ 788us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:06:20.855021 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:06:20.857494 (+ 2473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:06:20.860907 (+ 3413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:20.860917 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:20.860938 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:20.861444 (+ 506us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:20.861894 (+ 450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:20.861899 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:20.861903 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:20.862131 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:20.862734 (+ 603us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:06:20.862742 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:06:20.863138 (+ 396us) client_negotiation.cc:769] Sending connection context
0809 13:06:20.863427 (+ 289us) client_negotiation.cc:240] Negotiation successful
0809 13:06:20.864113 (+ 686us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":325,"threads_started":1}
I20260809 13:06:20.867295 20402 heartbeater.cc:347] Connected to a master server at 127.28.155.254:37021
I20260809 13:06:20.867633 20402 heartbeater.cc:464] Registering TS with master...
I20260809 13:06:20.868422 20402 heartbeater.cc:511] Master 127.28.155.254:37021 requested a full tablet report, sending...
I20260809 13:06:20.870085 19929 ts_manager.cc:194] Registered new tserver with Master: b0b9ac39534841aa86be80adb09e97cd (127.28.155.194:37509)
I20260809 13:06:20.870992 19929 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.194@KRBTEST.COM'} at 127.28.155.194:45283
W20260809 13:06:21.209808 20405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:06:21.210306 20405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:06:21.210477 20405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:06:21.218276 20405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:06:21.218410 20405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:06:21.218598 20405 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:06:21.229001 20405 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:35283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:33887
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=45463
--tserver_master_addrs=127.28.155.254:37021
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:06:21.230443 20405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:06:21.231868 20405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:06:21.245800 20417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:21.245865 20415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:21.245890 20414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:06:21.246762 20405 server_base.cc:1034] running on GCE node
I20260809 13:06:21.247495 20405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:06:21.248644 20405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:06:21.249881 20405 hybrid_clock.cc:648] HybridClock initialized: now 1786280781249834 us; error 44 us; skew 500 ppm
I20260809 13:06:21.250298 20405 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:06:21 dist-test-slave-jq4t krb5kdc[19052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280781, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:06:21.254045 20405 init.cc:377] Logged in from keytab as kudu/127.28.155.195@KRBTEST.COM (short username kudu)
I20260809 13:06:21.255676 20405 webserver.cc:460] Webserver started at http://127.28.155.195:45463/ using document root <none> and password file <none>
I20260809 13:06:21.256453 20405 fs_manager.cc:359] Metadata directory not provided
I20260809 13:06:21.256691 20405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:06:21.262463 20405 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 13:06:21.265508 20427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:21.266888 20405 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:06:21.267083 20405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "cffa3bdea6f94460bcc45e03cf90ec07"
format_stamp: "Formatted at 2026-08-09 13:06:18 on dist-test-slave-jq4t"
server_key: "2e253cc9a93850a83e91eb937984f692"
server_key_iv: "7d35be29fc5da39b95bceb61d87afed9"
server_key_version: "encryptionkey@0"
I20260809 13:06:21.268146 20405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:06:21.286677 20405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:06:21.291646 20405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:06:21.291960 20405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:06:21.293217 20405 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:06:21.294685 20405 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:06:21.294821 20405 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:21.294953 20405 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:06:21.295046 20405 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:21.331724 20405 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:33887
I20260809 13:06:21.331743 20586 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:33887 every 8 connection(s)
I20260809 13:06:21.333775 20405 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:06:21.335726 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 20405
Aug 09 13:06:21 dist-test-slave-jq4t krb5kdc[19052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280781, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:06:21.364359 20214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:21.336943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35466 (local address 127.28.155.254:37021)
0809 13:06:21.337394 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:21.337403 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:21.348206 (+ 10803us) server_negotiation.cc:407] Connection header received
0809 13:06:21.348418 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:21.348423 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:21.348537 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:21.348628 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:21.350771 (+ 2143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.351921 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.354114 (+ 2193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.354563 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.354719 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:21.358186 (+ 3467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:21.358190 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:21.358193 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:21.358225 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:21.361261 (+ 3036us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:21.362118 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:21.362122 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:21.362124 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:21.362246 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:21.362678 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:21.362683 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:21.362686 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:21.363057 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:21.363313 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:21.363695 (+ 382us) server_negotiation.cc:299] Negotiation successful
0809 13:06:21.363945 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281}
I20260809 13:06:21.365888 20592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:21.337055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:51457 (local address 127.28.155.254:37021)
0809 13:06:21.347864 (+ 10809us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:21.347870 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:21.347892 (+ 22us) server_negotiation.cc:407] Connection header received
0809 13:06:21.347968 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:21.347973 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:21.348059 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:21.348230 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:21.350591 (+ 2361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.351921 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.354468 (+ 2547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.354987 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.355136 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:21.358899 (+ 3763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:21.358907 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:21.358913 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:21.358969 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:21.362247 (+ 3278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:21.363195 (+ 948us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:21.363200 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:21.363203 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:21.363356 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:21.363937 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:21.363941 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:21.363944 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:21.364279 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:21.364394 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:21.365390 (+ 996us) server_negotiation.cc:299] Negotiation successful
0809 13:06:21.365560 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10707,"thread_start_us":11016,"threads_started":1}
I20260809 13:06:21.367472 20593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:21.337458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.195:51457)
0809 13:06:21.345543 (+ 8085us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:21.345601 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:21.347389 (+ 1788us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:21.348643 (+ 1254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:21.348656 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:21.349472 (+ 816us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:06:21.350370 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:21.350398 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.352129 (+ 1731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.352134 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:21.354282 (+ 2148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:21.354295 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.355241 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.355250 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:21.355500 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:21.356117 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:06:21.356140 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:06:21.358641 (+ 2501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:06:21.362415 (+ 3774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:21.362422 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:21.362436 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:21.363049 (+ 613us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:21.363516 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:21.363521 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:21.363524 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:21.363789 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:21.364418 (+ 629us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:06:21.364428 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:06:21.364962 (+ 534us) client_negotiation.cc:769] Sending connection context
0809 13:06:21.365256 (+ 294us) client_negotiation.cc:240] Negotiation successful
0809 13:06:21.365846 (+ 590us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7745,"thread_start_us":7507,"threads_started":1}
I20260809 13:06:21.368907 20587 heartbeater.cc:347] Connected to a master server at 127.28.155.254:37021
I20260809 13:06:21.369210 20587 heartbeater.cc:464] Registering TS with master...
I20260809 13:06:21.369946 20587 heartbeater.cc:511] Master 127.28.155.254:37021 requested a full tablet report, sending...
I20260809 13:06:21.371338 19929 ts_manager.cc:194] Registered new tserver with Master: cffa3bdea6f94460bcc45e03cf90ec07 (127.28.155.195:33887)
I20260809 13:06:21.372402 19929 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.195@KRBTEST.COM'} at 127.28.155.195:51457
I20260809 13:06:21.373802 20212 heartbeater.cc:503] Master 127.28.155.254:37021 was elected leader, sending a full tablet report...
I20260809 13:06:21.379868 29295 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 13:06:21.394254 20592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:21.381159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35482 (local address 127.28.155.254:37021)
0809 13:06:21.381448 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:21.381457 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:21.381922 (+ 465us) server_negotiation.cc:407] Connection header received
0809 13:06:21.382238 (+ 316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:21.382246 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:21.382500 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:21.382696 (+ 196us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:06:21.383375 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.384441 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.390830 (+ 6389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.391576 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.391728 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:21.392785 (+ 1057us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:06:21.393598 (+ 813us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:06:21.393782 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:21.393838 (+ 56us) server_negotiation.cc:299] Negotiation successful
0809 13:06:21.393937 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 13:06:21.395663 19929 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:35482:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 13:06:21.403332 19929 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:06:21.437326 20615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:21.415911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:33887 (local address 127.0.0.1:43372)
0809 13:06:21.425234 (+ 9323us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:21.425291 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:21.425481 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:21.427566 (+ 2085us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:21.427573 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:21.427605 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:06:21.428103 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:21.428118 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.431128 (+ 3010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.431136 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:21.434173 (+ 3037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:21.434196 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.436282 (+ 2086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.436289 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:21.436563 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:21.436631 (+ 68us) client_negotiation.cc:769] Sending connection context
0809 13:06:21.436737 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 13:06:21.436921 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9016,"thread_start_us":10127,"threads_started":1}
I20260809 13:06:21.437745 20609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:21.416203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43372 (local address 127.28.155.195:33887)
0809 13:06:21.426835 (+ 10632us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:21.426849 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:21.426893 (+ 44us) server_negotiation.cc:407] Connection header received
0809 13:06:21.427025 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:21.427037 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:21.427304 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:21.428333 (+ 1029us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:06:21.428731 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.430956 (+ 2225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.434480 (+ 3524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.436026 (+ 1546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.436962 (+ 936us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:21.437173 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:21.437253 (+ 80us) server_negotiation.cc:299] Negotiation successful
0809 13:06:21.437420 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10387,"thread_start_us":10213,"threads_started":1}
I20260809 13:06:21.441881 20498 tablet_service.cc:1467] Processing CreateTablet for tablet 9c1b3f994cad488b912b8690325f4f2c (DEFAULT_TABLE table=test-table [id=cf54ad99cac64e0cb36d4506c7e196ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:06:21.443456 20604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:21.416348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:33563 (local address 127.0.0.1:45302)
0809 13:06:21.426319 (+ 9971us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:21.426340 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:21.426463 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:21.434382 (+ 7919us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:21.434388 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:21.434415 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:06:21.434960 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:21.434975 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.437246 (+ 2271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.437251 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:21.440976 (+ 3725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:21.441001 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.442526 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.442533 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:21.442737 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:21.442776 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 13:06:21.442882 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 13:06:21.443027 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9834,"mutex_wait_us":1,"thread_start_us":18280,"threads_started":1}
I20260809 13:06:21.443485 20611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:21.416901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45302 (local address 127.28.155.193:33563)
0809 13:06:21.433085 (+ 16184us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:21.433098 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:21.433139 (+ 41us) server_negotiation.cc:407] Connection header received
0809 13:06:21.433265 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:21.433277 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:21.433604 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:21.434964 (+ 1360us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:06:21.435464 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.437082 (+ 1618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.441191 (+ 4109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.442244 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.442499 (+ 255us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:21.442683 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:21.442960 (+ 277us) server_negotiation.cc:299] Negotiation successful
0809 13:06:21.443155 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15925,"thread_start_us":17334,"threads_started":1}
I20260809 13:06:21.443758 20498 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c1b3f994cad488b912b8690325f4f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:06:21.445067 20613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:21.424346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:37509 (local address 127.0.0.1:57740)
0809 13:06:21.434959 (+ 10613us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:21.434978 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:21.435119 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:21.436163 (+ 1044us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:21.436169 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:21.436201 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:06:21.436640 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:21.436651 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.438520 (+ 1869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.438526 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:21.442172 (+ 3646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:21.442193 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.444191 (+ 1998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.444198 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:21.444367 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:21.444412 (+ 45us) client_negotiation.cc:769] Sending connection context
0809 13:06:21.444527 (+ 115us) client_negotiation.cc:240] Negotiation successful
0809 13:06:21.444658 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10458,"mutex_wait_us":1546,"thread_start_us":726,"threads_started":1}
I20260809 13:06:21.445125 20612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:21.416933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57740 (local address 127.28.155.194:37509)
0809 13:06:21.434248 (+ 17315us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:21.434257 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:21.435274 (+ 1017us) server_negotiation.cc:407] Connection header received
0809 13:06:21.435393 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:21.435404 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:21.435653 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:21.435855 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:06:21.436824 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.438370 (+ 1546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.442381 (+ 4011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.443947 (+ 1566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.444145 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:21.444325 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:21.444619 (+ 294us) server_negotiation.cc:299] Negotiation successful
0809 13:06:21.444804 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17166,"thread_start_us":17074,"threads_started":1}
I20260809 13:06:21.447980 20109 tablet_service.cc:1467] Processing CreateTablet for tablet 9c1b3f994cad488b912b8690325f4f2c (DEFAULT_TABLE table=test-table [id=cf54ad99cac64e0cb36d4506c7e196ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:06:21.449278 20109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c1b3f994cad488b912b8690325f4f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:06:21.449159 20307 tablet_service.cc:1467] Processing CreateTablet for tablet 9c1b3f994cad488b912b8690325f4f2c (DEFAULT_TABLE table=test-table [id=cf54ad99cac64e0cb36d4506c7e196ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:06:21.450572 20307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c1b3f994cad488b912b8690325f4f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:06:21.460568 20617 tablet_bootstrap.cc:492] T 9c1b3f994cad488b912b8690325f4f2c P cffa3bdea6f94460bcc45e03cf90ec07: Bootstrap starting.
I20260809 13:06:21.462813 20618 tablet_bootstrap.cc:492] T 9c1b3f994cad488b912b8690325f4f2c P ccd9690928c143dcbcd6e9466ee79548: Bootstrap starting.
I20260809 13:06:21.465517 20617 tablet_bootstrap.cc:654] T 9c1b3f994cad488b912b8690325f4f2c P cffa3bdea6f94460bcc45e03cf90ec07: Neither blocks nor log segments found. Creating new log.
I20260809 13:06:21.466668 20619 tablet_bootstrap.cc:492] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd: Bootstrap starting.
I20260809 13:06:21.466745 20618 tablet_bootstrap.cc:654] T 9c1b3f994cad488b912b8690325f4f2c P ccd9690928c143dcbcd6e9466ee79548: Neither blocks nor log segments found. Creating new log.
I20260809 13:06:21.467387 20617 log.cc:824] T 9c1b3f994cad488b912b8690325f4f2c P cffa3bdea6f94460bcc45e03cf90ec07: Log is configured to *not* fsync() on all Append() calls
I20260809 13:06:21.468086 20618 log.cc:824] T 9c1b3f994cad488b912b8690325f4f2c P ccd9690928c143dcbcd6e9466ee79548: Log is configured to *not* fsync() on all Append() calls
I20260809 13:06:21.470345 20619 tablet_bootstrap.cc:654] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd: Neither blocks nor log segments found. Creating new log.
I20260809 13:06:21.470805 20617 tablet_bootstrap.cc:492] T 9c1b3f994cad488b912b8690325f4f2c P cffa3bdea6f94460bcc45e03cf90ec07: No bootstrap required, opened a new log
I20260809 13:06:21.471146 20617 ts_tablet_manager.cc:1397] T 9c1b3f994cad488b912b8690325f4f2c P cffa3bdea6f94460bcc45e03cf90ec07: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.004s
I20260809 13:06:21.471311 20618 tablet_bootstrap.cc:492] T 9c1b3f994cad488b912b8690325f4f2c P ccd9690928c143dcbcd6e9466ee79548: No bootstrap required, opened a new log
I20260809 13:06:21.471570 20619 log.cc:824] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd: Log is configured to *not* fsync() on all Append() calls
I20260809 13:06:21.471652 20618 ts_tablet_manager.cc:1397] T 9c1b3f994cad488b912b8690325f4f2c P ccd9690928c143dcbcd6e9466ee79548: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20260809 13:06:21.475040 20619 tablet_bootstrap.cc:492] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd: No bootstrap required, opened a new log
I20260809 13:06:21.475360 20619 ts_tablet_manager.cc:1397] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260809 13:06:21.482702 20619 raft_consensus.cc:348] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffa3bdea6f94460bcc45e03cf90ec07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 33887 } } peers { permanent_uuid: "ccd9690928c143dcbcd6e9466ee79548" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33563 } } peers { permanent_uuid: "b0b9ac39534841aa86be80adb09e97cd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37509 } }
I20260809 13:06:21.482718 20617 raft_consensus.cc:348] T 9c1b3f994cad488b912b8690325f4f2c P cffa3bdea6f94460bcc45e03cf90ec07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffa3bdea6f94460bcc45e03cf90ec07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 33887 } } peers { permanent_uuid: "ccd9690928c143dcbcd6e9466ee79548" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33563 } } peers { permanent_uuid: "b0b9ac39534841aa86be80adb09e97cd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37509 } }
I20260809 13:06:21.482718 20618 raft_consensus.cc:348] T 9c1b3f994cad488b912b8690325f4f2c P ccd9690928c143dcbcd6e9466ee79548 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffa3bdea6f94460bcc45e03cf90ec07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 33887 } } peers { permanent_uuid: "ccd9690928c143dcbcd6e9466ee79548" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33563 } } peers { permanent_uuid: "b0b9ac39534841aa86be80adb09e97cd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37509 } }
I20260809 13:06:21.483131 20619 raft_consensus.cc:374] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:06:21.483165 20618 raft_consensus.cc:374] T 9c1b3f994cad488b912b8690325f4f2c P ccd9690928c143dcbcd6e9466ee79548 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:06:21.483165 20617 raft_consensus.cc:374] T 9c1b3f994cad488b912b8690325f4f2c P cffa3bdea6f94460bcc45e03cf90ec07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:06:21.483249 20619 raft_consensus.cc:729] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0b9ac39534841aa86be80adb09e97cd, State: Initialized, Role: FOLLOWER
I20260809 13:06:21.483281 20617 raft_consensus.cc:729] T 9c1b3f994cad488b912b8690325f4f2c P cffa3bdea6f94460bcc45e03cf90ec07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffa3bdea6f94460bcc45e03cf90ec07, State: Initialized, Role: FOLLOWER
I20260809 13:06:21.483323 20618 raft_consensus.cc:729] T 9c1b3f994cad488b912b8690325f4f2c P ccd9690928c143dcbcd6e9466ee79548 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd9690928c143dcbcd6e9466ee79548, State: Initialized, Role: FOLLOWER
I20260809 13:06:21.483999 20619 consensus_queue.cc:260] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffa3bdea6f94460bcc45e03cf90ec07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 33887 } } peers { permanent_uuid: "ccd9690928c143dcbcd6e9466ee79548" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33563 } } peers { permanent_uuid: "b0b9ac39534841aa86be80adb09e97cd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37509 } }
I20260809 13:06:21.483960 20618 consensus_queue.cc:260] T 9c1b3f994cad488b912b8690325f4f2c P ccd9690928c143dcbcd6e9466ee79548 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffa3bdea6f94460bcc45e03cf90ec07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 33887 } } peers { permanent_uuid: "ccd9690928c143dcbcd6e9466ee79548" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33563 } } peers { permanent_uuid: "b0b9ac39534841aa86be80adb09e97cd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37509 } }
I20260809 13:06:21.483960 20617 consensus_queue.cc:260] T 9c1b3f994cad488b912b8690325f4f2c P cffa3bdea6f94460bcc45e03cf90ec07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffa3bdea6f94460bcc45e03cf90ec07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 33887 } } peers { permanent_uuid: "ccd9690928c143dcbcd6e9466ee79548" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33563 } } peers { permanent_uuid: "b0b9ac39534841aa86be80adb09e97cd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37509 } }
I20260809 13:06:21.485316 20402 heartbeater.cc:503] Master 127.28.155.254:37021 was elected leader, sending a full tablet report...
I20260809 13:06:21.486179 20587 heartbeater.cc:503] Master 127.28.155.254:37021 was elected leader, sending a full tablet report...
I20260809 13:06:21.486357 20618 ts_tablet_manager.cc:1428] T 9c1b3f994cad488b912b8690325f4f2c P ccd9690928c143dcbcd6e9466ee79548: Time spent starting tablet: real 0.015s user 0.011s sys 0.002s
I20260809 13:06:21.487442 20619 ts_tablet_manager.cc:1428] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd: Time spent starting tablet: real 0.012s user 0.008s sys 0.002s
I20260809 13:06:21.487741 20617 ts_tablet_manager.cc:1428] T 9c1b3f994cad488b912b8690325f4f2c P cffa3bdea6f94460bcc45e03cf90ec07: Time spent starting tablet: real 0.016s user 0.012s sys 0.004s
I20260809 13:06:21.525938 20626 raft_consensus.cc:482] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:06:21.526306 20626 raft_consensus.cc:504] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffa3bdea6f94460bcc45e03cf90ec07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 33887 } } peers { permanent_uuid: "ccd9690928c143dcbcd6e9466ee79548" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33563 } } peers { permanent_uuid: "b0b9ac39534841aa86be80adb09e97cd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37509 } }
I20260809 13:06:21.528163 20626 leader_election.cc:288] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffa3bdea6f94460bcc45e03cf90ec07 (127.28.155.195:33887), ccd9690928c143dcbcd6e9466ee79548 (127.28.155.193:33563)
I20260809 13:06:21.535871 20611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:21.528836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:45195 (local address 127.28.155.193:33563)
0809 13:06:21.529102 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:21.529112 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:21.530212 (+ 1100us) server_negotiation.cc:407] Connection header received
0809 13:06:21.530412 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:21.530417 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:21.530507 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:21.530609 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:06:21.531296 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.532015 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.534014 (+ 1999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.534839 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.535039 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:21.535133 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:21.535455 (+ 322us) server_negotiation.cc:299] Negotiation successful
0809 13:06:21.535599 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260809 13:06:21.535940 20609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:21.528849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:48989 (local address 127.28.155.195:33887)
0809 13:06:21.529109 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:21.529119 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:21.530118 (+ 999us) server_negotiation.cc:407] Connection header received
0809 13:06:21.530354 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:21.530360 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:21.530440 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:21.530546 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:06:21.531186 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.531952 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.534037 (+ 2085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.534850 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.535034 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:21.535134 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:21.535471 (+ 337us) server_negotiation.cc:299] Negotiation successful
0809 13:06:21.535599 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 13:06:21.536175 20631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:21.528780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:33563 (local address 127.28.155.194:45195)
0809 13:06:21.530094 (+ 1314us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:21.530113 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:21.530272 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:21.530624 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:21.530628 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:21.530659 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:06:21.531137 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:21.531145 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.532151 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.532160 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:21.533845 (+ 1685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:21.533861 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.535121 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.535127 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:21.535289 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:21.535314 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 13:06:21.535425 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 13:06:21.535557 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1180,"mutex_wait_us":33,"thread_start_us":631,"threads_started":1}
I20260809 13:06:21.536295 20630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:21.528733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:33887 (local address 127.28.155.194:48989)
0809 13:06:21.529995 (+ 1262us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:21.530012 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:21.530197 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:21.530562 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:21.530566 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:21.530591 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:06:21.531030 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:21.531043 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.532088 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.532096 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:21.533870 (+ 1774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:21.533890 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.535137 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.535145 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:21.535313 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:21.535335 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 13:06:21.535443 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 13:06:21.535573 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1119,"mutex_wait_us":77,"thread_start_us":642,"threads_started":1}
I20260809 13:06:21.537370 20522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c1b3f994cad488b912b8690325f4f2c" candidate_uuid: "b0b9ac39534841aa86be80adb09e97cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffa3bdea6f94460bcc45e03cf90ec07" is_pre_election: true
I20260809 13:06:21.537371 20142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c1b3f994cad488b912b8690325f4f2c" candidate_uuid: "b0b9ac39534841aa86be80adb09e97cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd9690928c143dcbcd6e9466ee79548" is_pre_election: true
I20260809 13:06:21.537940 20522 raft_consensus.cc:2454] T 9c1b3f994cad488b912b8690325f4f2c P cffa3bdea6f94460bcc45e03cf90ec07 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0b9ac39534841aa86be80adb09e97cd in term 0.
I20260809 13:06:21.537928 20142 raft_consensus.cc:2454] T 9c1b3f994cad488b912b8690325f4f2c P ccd9690928c143dcbcd6e9466ee79548 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0b9ac39534841aa86be80adb09e97cd in term 0.
I20260809 13:06:21.538684 20241 leader_election.cc:302] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: b0b9ac39534841aa86be80adb09e97cd, ccd9690928c143dcbcd6e9466ee79548, cffa3bdea6f94460bcc45e03cf90ec07; no voters:
I20260809 13:06:21.539216 20626 raft_consensus.cc:2781] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:06:21.539383 20626 raft_consensus.cc:482] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:06:21.539497 20626 raft_consensus.cc:3037] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:06:21.541975 20626 raft_consensus.cc:504] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffa3bdea6f94460bcc45e03cf90ec07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 33887 } } peers { permanent_uuid: "ccd9690928c143dcbcd6e9466ee79548" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33563 } } peers { permanent_uuid: "b0b9ac39534841aa86be80adb09e97cd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37509 } }
I20260809 13:06:21.542620 20626 leader_election.cc:288] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd [CANDIDATE]: Term 1 election: Requested vote from peers cffa3bdea6f94460bcc45e03cf90ec07 (127.28.155.195:33887), ccd9690928c143dcbcd6e9466ee79548 (127.28.155.193:33563)
I20260809 13:06:21.543166 20522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c1b3f994cad488b912b8690325f4f2c" candidate_uuid: "b0b9ac39534841aa86be80adb09e97cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffa3bdea6f94460bcc45e03cf90ec07"
I20260809 13:06:21.543171 20142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c1b3f994cad488b912b8690325f4f2c" candidate_uuid: "b0b9ac39534841aa86be80adb09e97cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd9690928c143dcbcd6e9466ee79548"
I20260809 13:06:21.543373 20522 raft_consensus.cc:3037] T 9c1b3f994cad488b912b8690325f4f2c P cffa3bdea6f94460bcc45e03cf90ec07 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:06:21.543396 20142 raft_consensus.cc:3037] T 9c1b3f994cad488b912b8690325f4f2c P ccd9690928c143dcbcd6e9466ee79548 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:06:21.545821 20142 raft_consensus.cc:2454] T 9c1b3f994cad488b912b8690325f4f2c P ccd9690928c143dcbcd6e9466ee79548 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0b9ac39534841aa86be80adb09e97cd in term 1.
I20260809 13:06:21.545955 20522 raft_consensus.cc:2454] T 9c1b3f994cad488b912b8690325f4f2c P cffa3bdea6f94460bcc45e03cf90ec07 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0b9ac39534841aa86be80adb09e97cd in term 1.
I20260809 13:06:21.546353 20241 leader_election.cc:302] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0b9ac39534841aa86be80adb09e97cd, ccd9690928c143dcbcd6e9466ee79548; no voters:
I20260809 13:06:21.546674 20626 raft_consensus.cc:2781] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:06:21.547165 20626 raft_consensus.cc:686] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd [term 1 LEADER]: Becoming Leader. State: Replica: b0b9ac39534841aa86be80adb09e97cd, State: Running, Role: LEADER
I20260809 13:06:21.547683 20626 consensus_queue.cc:237] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffa3bdea6f94460bcc45e03cf90ec07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 33887 } } peers { permanent_uuid: "ccd9690928c143dcbcd6e9466ee79548" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33563 } } peers { permanent_uuid: "b0b9ac39534841aa86be80adb09e97cd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37509 } }
I20260809 13:06:21.553088 19929 catalog_manager.cc:5495] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd reported cstate change: term changed from 0 to 1, leader changed from <none> to b0b9ac39534841aa86be80adb09e97cd (127.28.155.194). New cstate: current_term: 1 leader_uuid: "b0b9ac39534841aa86be80adb09e97cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffa3bdea6f94460bcc45e03cf90ec07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccd9690928c143dcbcd6e9466ee79548" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0b9ac39534841aa86be80adb09e97cd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37509 } health_report { overall_health: HEALTHY } } }
W20260809 13:06:21.586640 20589 tablet.cc:2369] T 9c1b3f994cad488b912b8690325f4f2c P cffa3bdea6f94460bcc45e03cf90ec07: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 13:06:21.586894 20213 tablet.cc:2369] T 9c1b3f994cad488b912b8690325f4f2c P ccd9690928c143dcbcd6e9466ee79548: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 13:06:21.590965 20403 tablet.cc:2369] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:06:21.593848 20612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:21.588216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57754 (local address 127.28.155.194:37509)
0809 13:06:21.588471 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:21.588527 (+ 56us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:21.588548 (+ 21us) server_negotiation.cc:407] Connection header received
0809 13:06:21.588761 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:21.588765 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:21.588859 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:21.588997 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:06:21.589354 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.590112 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.591651 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.592111 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.592211 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:21.592726 (+ 515us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:06:21.593262 (+ 536us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:06:21.593387 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:21.593453 (+ 66us) server_negotiation.cc:299] Negotiation successful
0809 13:06:21.593528 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260809 13:06:21.602497 20142 raft_consensus.cc:1261] T 9c1b3f994cad488b912b8690325f4f2c P ccd9690928c143dcbcd6e9466ee79548 [term 1 FOLLOWER]: Refusing update from remote peer b0b9ac39534841aa86be80adb09e97cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:06:21.602497 20522 raft_consensus.cc:1261] T 9c1b3f994cad488b912b8690325f4f2c P cffa3bdea6f94460bcc45e03cf90ec07 [term 1 FOLLOWER]: Refusing update from remote peer b0b9ac39534841aa86be80adb09e97cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:06:21.603577 20626 consensus_queue.cc:1035] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd9690928c143dcbcd6e9466ee79548" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 33563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:06:21.603902 20634 consensus_queue.cc:1035] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffa3bdea6f94460bcc45e03cf90ec07" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:06:21.624605 20642 mvcc.cc:205] Tried to move back new op lower bound from 7316606081433051136 to 7316606081223786496. Current Snapshot: MvccSnapshot[applied={T|T < 7316606081433051136 or (T in {7316606081433051136})}]
I20260809 13:06:21.633034 19929 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:35482:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:06:21.633348 19929 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:35482:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:06:21.637506 19929 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf: Sending DeleteTablet for 3 replicas of tablet 9c1b3f994cad488b912b8690325f4f2c
I20260809 13:06:21.638820 20498 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c1b3f994cad488b912b8690325f4f2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:06:21 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:43372
I20260809 13:06:21.638820 20307 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c1b3f994cad488b912b8690325f4f2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:06:21 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:57740
I20260809 13:06:21.638823 20109 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c1b3f994cad488b912b8690325f4f2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:06:21 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:45302
I20260809 13:06:21.639587 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 19986
I20260809 13:06:21.642055 20658 tablet_replica.cc:330] T 9c1b3f994cad488b912b8690325f4f2c P ccd9690928c143dcbcd6e9466ee79548: stopping tablet replica
I20260809 13:06:21.642673 20658 raft_consensus.cc:2229] T 9c1b3f994cad488b912b8690325f4f2c P ccd9690928c143dcbcd6e9466ee79548 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:06:21.643397 20658 raft_consensus.cc:2258] T 9c1b3f994cad488b912b8690325f4f2c P ccd9690928c143dcbcd6e9466ee79548 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:06:21.644409 20656 tablet_replica.cc:330] T 9c1b3f994cad488b912b8690325f4f2c P cffa3bdea6f94460bcc45e03cf90ec07: stopping tablet replica
I20260809 13:06:21.644670 20657 tablet_replica.cc:330] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd: stopping tablet replica
I20260809 13:06:21.645047 20656 raft_consensus.cc:2229] T 9c1b3f994cad488b912b8690325f4f2c P cffa3bdea6f94460bcc45e03cf90ec07 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:06:21.645102 20657 raft_consensus.cc:2229] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd [term 1 LEADER]: Raft consensus shutting down.
I20260809 13:06:21.645844 20657 raft_consensus.cc:2258] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:06:21.647267 20656 raft_consensus.cc:2258] T 9c1b3f994cad488b912b8690325f4f2c P cffa3bdea6f94460bcc45e03cf90ec07 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:06:21.647926 20658 ts_tablet_manager.cc:1905] T 9c1b3f994cad488b912b8690325f4f2c P ccd9690928c143dcbcd6e9466ee79548: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:06:21.649734 20656 ts_tablet_manager.cc:1905] T 9c1b3f994cad488b912b8690325f4f2c P cffa3bdea6f94460bcc45e03cf90ec07: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:06:21.652210 20657 ts_tablet_manager.cc:1905] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:06:21.656432 20658 ts_tablet_manager.cc:1918] T 9c1b3f994cad488b912b8690325f4f2c P ccd9690928c143dcbcd6e9466ee79548: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:06:21.656711 20658 log.cc:1196] T 9c1b3f994cad488b912b8690325f4f2c P ccd9690928c143dcbcd6e9466ee79548: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/wal/wals/9c1b3f994cad488b912b8690325f4f2c
I20260809 13:06:21.657447 20658 ts_tablet_manager.cc:1939] T 9c1b3f994cad488b912b8690325f4f2c P ccd9690928c143dcbcd6e9466ee79548: Deleting consensus metadata
I20260809 13:06:21.659783 20611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:21.641284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45308 (local address 127.28.155.193:33563)
0809 13:06:21.641522 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:21.641528 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:21.641553 (+ 25us) server_negotiation.cc:407] Connection header received
0809 13:06:21.641637 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:21.641645 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:21.641756 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:21.641902 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:21.643886 (+ 1984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.645143 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.647195 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.647885 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.648022 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:21.651655 (+ 3633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:21.651676 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:21.651694 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:21.651737 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:21.656156 (+ 4419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:21.657222 (+ 1066us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:21.657232 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:21.657236 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:21.657443 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:21.657912 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:21.657918 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:21.657921 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:21.658466 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:21.658830 (+ 364us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:21.659115 (+ 285us) server_negotiation.cc:299] Negotiation successful
0809 13:06:21.659363 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 13:06:21.659965 19901 catalog_manager.cc:4841] TS ccd9690928c143dcbcd6e9466ee79548 (127.28.155.193:33563): tablet 9c1b3f994cad488b912b8690325f4f2c (table test-table [id=cf54ad99cac64e0cb36d4506c7e196ae]) successfully deleted
I20260809 13:06:21.660774 20205 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:06:21.664676 20657 ts_tablet_manager.cc:1918] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:06:21.665005 20657 log.cc:1196] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/wal/wals/9c1b3f994cad488b912b8690325f4f2c
I20260809 13:06:21.665012 20656 ts_tablet_manager.cc:1918] T 9c1b3f994cad488b912b8690325f4f2c P cffa3bdea6f94460bcc45e03cf90ec07: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:06:21.665266 20656 log.cc:1196] T 9c1b3f994cad488b912b8690325f4f2c P cffa3bdea6f94460bcc45e03cf90ec07: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/wal/wals/9c1b3f994cad488b912b8690325f4f2c
I20260809 13:06:21.665911 20656 ts_tablet_manager.cc:1939] T 9c1b3f994cad488b912b8690325f4f2c P cffa3bdea6f94460bcc45e03cf90ec07: Deleting consensus metadata
I20260809 13:06:21.665936 20657 ts_tablet_manager.cc:1939] T 9c1b3f994cad488b912b8690325f4f2c P b0b9ac39534841aa86be80adb09e97cd: Deleting consensus metadata
I20260809 13:06:21.668190 19904 catalog_manager.cc:4841] TS cffa3bdea6f94460bcc45e03cf90ec07 (127.28.155.195:33887): tablet 9c1b3f994cad488b912b8690325f4f2c (table test-table [id=cf54ad99cac64e0cb36d4506c7e196ae]) successfully deleted
I20260809 13:06:21.668326 19902 catalog_manager.cc:4841] TS b0b9ac39534841aa86be80adb09e97cd (127.28.155.194:37509): tablet 9c1b3f994cad488b912b8690325f4f2c (table test-table [id=cf54ad99cac64e0cb36d4506c7e196ae]) successfully deleted
I20260809 13:06:21.762540 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 19986
I20260809 13:06:21.791353 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 20219
I20260809 13:06:21.811137 20612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:21.792416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57764 (local address 127.28.155.194:37509)
0809 13:06:21.792658 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:21.792664 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:21.792689 (+ 25us) server_negotiation.cc:407] Connection header received
0809 13:06:21.792926 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:21.792931 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:21.793015 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:21.793120 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:21.795041 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.796280 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.798366 (+ 2086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.799100 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.799235 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:21.803164 (+ 3929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:21.803191 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:21.803217 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:21.803273 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:21.807641 (+ 4368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:21.808726 (+ 1085us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:21.808740 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:21.808744 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:21.808934 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:21.809419 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:21.809425 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:21.809429 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:21.809955 (+ 526us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:21.810261 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:21.810615 (+ 354us) server_negotiation.cc:299] Negotiation successful
0809 13:06:21.810794 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260809 13:06:21.811997 20395 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:06:21.936825 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 20219
I20260809 13:06:21.967474 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 20405
I20260809 13:06:21.982199 20609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:21.968312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43384 (local address 127.28.155.195:33887)
0809 13:06:21.968560 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:21.968567 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:21.968593 (+ 26us) server_negotiation.cc:407] Connection header received
0809 13:06:21.968826 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:21.968833 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:21.968942 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:21.969071 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:21.970544 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.971325 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.972960 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:21.973389 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:21.973532 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:21.976326 (+ 2794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:21.976341 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:21.976358 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:21.976419 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:21.979123 (+ 2704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:21.979904 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:21.979913 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:21.979916 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:21.980069 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:21.980519 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:21.980527 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:21.980534 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:21.980914 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:21.981249 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:21.981604 (+ 355us) server_negotiation.cc:299] Negotiation successful
0809 13:06:21.981851 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260809 13:06:21.982930 20580 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:06:22.078102 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 20405
I20260809 13:06:22.107376 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 19865
I20260809 13:06:22.108839 19976 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:06:22.230355 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 19865
I20260809 13:06:22.262037 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:37021
--webserver_interface=127.28.155.254
--webserver_port=34851
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:35283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:37021
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:06:22.620277 20664 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:06:22.620661 20664 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:06:22.620889 20664 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:06:22.628461 20664 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:06:22.628605 20664 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:06:22.628700 20664 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:06:22.628813 20664 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:06:22.628890 20664 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:06:22.639498 20664 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:35283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:37021
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:37021
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=34851
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:06:22.641114 20664 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:06:22.642544 20664 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:06:22.655262 20670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:22.655228 20676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:22.655354 20671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:06:22.662169 20664 server_base.cc:1034] running on GCE node
I20260809 13:06:22.663131 20664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:06:22.664848 20664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:06:22.666105 20664 hybrid_clock.cc:648] HybridClock initialized: now 1786280782666056 us; error 77 us; skew 500 ppm
I20260809 13:06:22.666471 20664 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:06:22 dist-test-slave-jq4t krb5kdc[19052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280782, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:06:22.669939 20664 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:06:22.671658 20664 webserver.cc:460] Webserver started at http://127.28.155.254:34851/ using document root <none> and password file <none>
I20260809 13:06:22.672534 20664 fs_manager.cc:359] Metadata directory not provided
I20260809 13:06:22.672693 20664 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:06:22.678767 20664 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 13:06:22.681910 20683 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:22.683387 20664 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:06:22.683594 20664 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "ac2678a030804cbf9918b24d968d2adf"
format_stamp: "Formatted at 2026-08-09 13:06:16 on dist-test-slave-jq4t"
server_key: "88ba519096941ba79be43db75eaeaa0a"
server_key_iv: "6c22c0a192e91730179cda8a81c1462a"
server_key_version: "encryptionkey@0"
I20260809 13:06:22.684681 20664 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:06:22.703034 20664 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:06:22.707291 20664 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:06:22.707597 20664 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:06:22.729223 20664 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:37021
I20260809 13:06:22.729244 20756 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:37021 every 8 connection(s)
I20260809 13:06:22.731070 20664 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:06:22.734043 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 20664
I20260809 13:06:22.735169 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:33563
--local_ip_for_outbound_sockets=127.28.155.193
--tserver_master_addrs=127.28.155.254:37021
--webserver_port=46449
--webserver_interface=127.28.155.193
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:35283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 13:06:22.741278 20757 sys_catalog.cc:263] Verifying existing consensus state
I20260809 13:06:22.746783 20757 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf: Bootstrap starting.
I20260809 13:06:22.769682 20757 log.cc:824] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf: Log is configured to *not* fsync() on all Append() calls
I20260809 13:06:22.787297 20757 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 13:06:22.787964 20757 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf: Bootstrap complete.
I20260809 13:06:22.798090 20757 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac2678a030804cbf9918b24d968d2adf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 37021 } }
I20260809 13:06:22.799058 20757 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac2678a030804cbf9918b24d968d2adf, State: Initialized, Role: FOLLOWER
I20260809 13:06:22.799829 20757 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac2678a030804cbf9918b24d968d2adf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 37021 } }
I20260809 13:06:22.800094 20757 raft_consensus.cc:388] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:06:22.800244 20757 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:06:22.800463 20757 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [term 2 FOLLOWER]: Advancing to term 3
I20260809 13:06:22.804662 20757 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac2678a030804cbf9918b24d968d2adf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 37021 } }
I20260809 13:06:22.805182 20757 leader_election.cc:302] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac2678a030804cbf9918b24d968d2adf; no voters:
I20260809 13:06:22.805974 20757 leader_election.cc:288] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 13:06:22.806120 20763 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [term 3 FOLLOWER]: Leader election won for term 3
I20260809 13:06:22.807416 20763 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [term 3 LEADER]: Becoming Leader. State: Replica: ac2678a030804cbf9918b24d968d2adf, State: Running, Role: LEADER
I20260809 13:06:22.808104 20763 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac2678a030804cbf9918b24d968d2adf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 37021 } }
I20260809 13:06:22.808425 20757 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:06:22.811229 20766 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac2678a030804cbf9918b24d968d2adf. Latest consensus state: current_term: 3 leader_uuid: "ac2678a030804cbf9918b24d968d2adf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac2678a030804cbf9918b24d968d2adf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 37021 } } }
I20260809 13:06:22.811964 20766 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [sys.catalog]: This master's current role is: LEADER
I20260809 13:06:22.811686 20764 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "ac2678a030804cbf9918b24d968d2adf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac2678a030804cbf9918b24d968d2adf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 37021 } } }
I20260809 13:06:22.812999 20764 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac2678a030804cbf9918b24d968d2adf [sys.catalog]: This master's current role is: LEADER
I20260809 13:06:22.826010 20771 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:06:22.838058 20771 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:06:22.840381 20771 catalog_manager.cc:1259] Loaded cluster ID: 87b413152a764f2f97e02268b18f5f68
I20260809 13:06:22.840646 20771 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260809 13:06:22.843888 20771 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fd57347a9ad google::LogMessage::Fail() at ??:0
@ 0x7fd57347d88a google::LogMessage::SendToLog() at ??:0
@ 0x7fd57347a4de google::LogMessage::Flush() at ??:0
@ 0x7fd57347ba19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fd588ead512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7fd588eaa976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fd588f32610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7fd588f32439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fd5760c6345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fd5760c991c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fd5760c9799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fd5760a4eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fd57937e6db start_thread at ??:0
@ 0x7fd57231461f clone at ??:0
W20260809 13:06:23.182663 20760 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:06:23.183000 20760 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:06:23.183104 20760 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:06:23.190644 20760 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:06:23.190773 20760 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:06:23.190917 20760 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:06:23.201270 20760 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:35283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:33563
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=46449
--tserver_master_addrs=127.28.155.254:37021
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:06:23.202710 20760 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:06:23.204113 20760 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:06:23.218568 20817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:23.219184 20816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:23.218526 20819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:06:23.219952 20760 server_base.cc:1034] running on GCE node
I20260809 13:06:23.220867 20760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:06:23.222040 20760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:06:23.223249 20760 hybrid_clock.cc:648] HybridClock initialized: now 1786280783223204 us; error 37 us; skew 500 ppm
I20260809 13:06:23.223627 20760 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:06:23 dist-test-slave-jq4t krb5kdc[19052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280783, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:06:23.227062 20760 init.cc:377] Logged in from keytab as kudu/127.28.155.193@KRBTEST.COM (short username kudu)
I20260809 13:06:23.228607 20760 webserver.cc:460] Webserver started at http://127.28.155.193:46449/ using document root <none> and password file <none>
I20260809 13:06:23.229301 20760 fs_manager.cc:359] Metadata directory not provided
I20260809 13:06:23.229405 20760 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:06:23.235039 20760 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.003s
I20260809 13:06:23.237905 20829 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:23.239358 20760 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:06:23.239565 20760 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "ccd9690928c143dcbcd6e9466ee79548"
format_stamp: "Formatted at 2026-08-09 13:06:17 on dist-test-slave-jq4t"
server_key: "d730b86364d26080ec6b75c87654179e"
server_key_iv: "f85e42d7ee094804a1628bc154166661"
server_key_version: "encryptionkey@0"
I20260809 13:06:23.240727 20760 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:06:23.294411 20760 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:06:23.299554 20760 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:06:23.299877 20760 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:06:23.301146 20760 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:06:23.302629 20760 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:06:23.302779 20760 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:23.302929 20760 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:06:23.303035 20760 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:23.339881 20760 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:33563
I20260809 13:06:23.339977 20982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:33563 every 8 connection(s)
I20260809 13:06:23.341563 20760 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:06:23.346091 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 20760
I20260809 13:06:23.346818 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:37509
--local_ip_for_outbound_sockets=127.28.155.194
--tserver_master_addrs=127.28.155.254:37021
--webserver_port=33789
--webserver_interface=127.28.155.194
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:35283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 13:06:23.346873 20990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:23.344757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.193:54539)
0809 13:06:23.345671 (+ 914us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:23.345915 (+ 244us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":611,"thread_start_us":367,"threads_started":1}
W20260809 13:06:23.347724 20984 heartbeater.cc:644] Failed to heartbeat to 127.28.155.254:37021 (0 consecutive failures): Network error: Failed to ping master at 127.28.155.254:37021: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
I20260809 13:06:23.348694 20990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:23.348298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.193:50167)
0809 13:06:23.348461 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:23.348585 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 13:06:23.349663 20990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:23.349330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.193:60109)
0809 13:06:23.349474 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:23.349557 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260809 13:06:23.349922 20984 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 13:06:23.711752 20993 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:06:23.712064 20993 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:06:23.712178 20993 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:06:23.719558 20993 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:06:23.719677 20993 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:06:23.719794 20993 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:06:23.730151 20993 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:35283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:37509
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=33789
--tserver_master_addrs=127.28.155.254:37021
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:06:23.731515 20993 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:06:23.732857 20993 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:06:23.746774 20999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:23.746825 21006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:23.746731 21001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:06:23.747691 20993 server_base.cc:1034] running on GCE node
I20260809 13:06:23.748463 20993 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:06:23.749590 20993 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:06:23.750862 20993 hybrid_clock.cc:648] HybridClock initialized: now 1786280783750801 us; error 54 us; skew 500 ppm
I20260809 13:06:23.751226 20993 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:06:23 dist-test-slave-jq4t krb5kdc[19052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280783, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:06:23.754611 20993 init.cc:377] Logged in from keytab as kudu/127.28.155.194@KRBTEST.COM (short username kudu)
I20260809 13:06:23.756098 20993 webserver.cc:460] Webserver started at http://127.28.155.194:33789/ using document root <none> and password file <none>
I20260809 13:06:23.756875 20993 fs_manager.cc:359] Metadata directory not provided
I20260809 13:06:23.756989 20993 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:06:23.762727 20993 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 13:06:23.765512 21015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:23.766887 20993 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:06:23.767035 20993 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "b0b9ac39534841aa86be80adb09e97cd"
format_stamp: "Formatted at 2026-08-09 13:06:17 on dist-test-slave-jq4t"
server_key: "193462058ee1266ef9e24b25c930d383"
server_key_iv: "9b831eb0bb541863b83152e896f9eb22"
server_key_version: "encryptionkey@0"
I20260809 13:06:23.768036 20993 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:06:23.782030 20993 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:06:23.786026 20993 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:06:23.786263 20993 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:06:23.787256 20993 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:06:23.788668 20993 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:06:23.788761 20993 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:23.788843 20993 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:06:23.788898 20993 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:23.825099 20993 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:37509
I20260809 13:06:23.825187 21179 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:37509 every 8 connection(s)
I20260809 13:06:23.826714 20993 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:06:23.828977 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 20993
I20260809 13:06:23.829700 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:33887
--local_ip_for_outbound_sockets=127.28.155.195
--tserver_master_addrs=127.28.155.254:37021
--webserver_port=45463
--webserver_interface=127.28.155.195
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:35283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 13:06:23.832350 21184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:23.830185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.194:46953)
0809 13:06:23.831111 (+ 926us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:23.831402 (+ 291us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":602,"thread_start_us":395,"threads_started":1}
W20260809 13:06:23.833125 21181 heartbeater.cc:644] Failed to heartbeat to 127.28.155.254:37021 (0 consecutive failures): Network error: Failed to ping master at 127.28.155.254:37021: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
I20260809 13:06:23.834074 21184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:23.833727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.194:60793)
0809 13:06:23.833882 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:23.833962 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260809 13:06:23.834941 21184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:23.834604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.194:36239)
0809 13:06:23.834746 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:23.834833 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 13:06:23.835192 21181 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 13:06:24.187363 21187 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:06:24.187681 21187 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:06:24.187844 21187 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:06:24.195361 21187 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:06:24.195474 21187 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:06:24.195644 21187 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:06:24.205703 21187 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:35283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:33887
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=45463
--tserver_master_addrs=127.28.155.254:37021
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:06:24.207109 21187 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:06:24.208523 21187 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:06:24.222205 21194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:24.222278 21197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:24.222255 21195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:06:24.223510 21187 server_base.cc:1034] running on GCE node
I20260809 13:06:24.224200 21187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:06:24.225277 21187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:06:24.226543 21187 hybrid_clock.cc:648] HybridClock initialized: now 1786280784226491 us; error 58 us; skew 500 ppm
I20260809 13:06:24.226907 21187 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:06:24 dist-test-slave-jq4t krb5kdc[19052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280784, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:06:24.234055 21187 init.cc:377] Logged in from keytab as kudu/127.28.155.195@KRBTEST.COM (short username kudu)
I20260809 13:06:24.235569 21187 webserver.cc:460] Webserver started at http://127.28.155.195:45463/ using document root <none> and password file <none>
I20260809 13:06:24.236264 21187 fs_manager.cc:359] Metadata directory not provided
I20260809 13:06:24.236370 21187 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:06:24.241978 21187 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.003s
I20260809 13:06:24.244920 21206 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:24.246356 21187 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 13:06:24.246511 21187 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "cffa3bdea6f94460bcc45e03cf90ec07"
format_stamp: "Formatted at 2026-08-09 13:06:18 on dist-test-slave-jq4t"
server_key: "2e253cc9a93850a83e91eb937984f692"
server_key_iv: "7d35be29fc5da39b95bceb61d87afed9"
server_key_version: "encryptionkey@0"
I20260809 13:06:24.247537 21187 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:06:24.297624 21187 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:06:24.302203 21187 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:06:24.302467 21187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:06:24.303551 21187 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:06:24.305035 21187 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:06:24.305143 21187 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:24.305229 21187 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:06:24.305290 21187 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:24.342162 21187 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:33887
I20260809 13:06:24.342211 21374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:33887 every 8 connection(s)
I20260809 13:06:24.343757 21187 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:06:24.349103 21378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:24.347094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.195:34831)
0809 13:06:24.347885 (+ 791us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:24.348139 (+ 254us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":321,"threads_started":1}
W20260809 13:06:24.349799 21375 heartbeater.cc:644] Failed to heartbeat to 127.28.155.254:37021 (0 consecutive failures): Network error: Failed to ping master at 127.28.155.254:37021: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
I20260809 13:06:24.350806 21378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:24.350328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.195:33579)
0809 13:06:24.350540 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:24.350660 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260809 13:06:24.351811 21378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:24.351484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.195:47067)
0809 13:06:24.351630 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:24.351704 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 13:06:24.351821 21379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:24.350674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.193:44647)
0809 13:06:24.351373 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:24.351558 (+ 185us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":370,"threads_started":1}
W20260809 13:06:24.352133 21375 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 13:06:24.352952 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 21187
I20260809 13:06:24.836814 21381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:24.835816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.194:56947)
0809 13:06:24.836369 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:24.836568 (+ 199us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":253,"threads_started":1}
I20260809 13:06:25.353782 21383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:25.352935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.193:37861)
0809 13:06:25.353454 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:25.353578 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":273,"threads_started":1}
I20260809 13:06:25.354357 21382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:25.352907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.195:58897)
0809 13:06:25.353919 (+ 1012us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:25.354110 (+ 191us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":879,"thread_start_us":696,"threads_started":1}
I20260809 13:06:25.838788 21385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:25.837925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.194:45889)
0809 13:06:25.838495 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:25.838595 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":285,"threads_started":1}
I20260809 13:06:26.355672 21387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:26.354779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.193:41969)
0809 13:06:26.355381 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:26.355476 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":332,"threads_started":1}
I20260809 13:06:26.356050 21388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:26.355207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.195:45231)
0809 13:06:26.355738 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:26.355848 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":293,"threads_started":1}
I20260809 13:06:26.840947 21389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:26.839985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.194:40135)
0809 13:06:26.840660 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:26.840752 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":382,"threads_started":1}
I20260809 13:06:27.357774 21391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:27.356829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.193:46389)
0809 13:06:27.357466 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:27.357596 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":291,"threads_started":1}
I20260809 13:06:27.357833 21392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:27.357018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.195:39455)
0809 13:06:27.357573 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:27.357659 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":308,"threads_started":1}
I20260809 13:06:27.843031 21393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:27.842185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.194:46257)
0809 13:06:27.842703 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:27.842811 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":263,"threads_started":1}
I20260809 13:06:28.359655 21394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:28.358883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.195:39021)
0809 13:06:28.359394 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:28.359480 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":287,"threads_started":1}
I20260809 13:06:28.360153 21395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:28.358895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.193:56409)
0809 13:06:28.359819 (+ 924us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:28.359978 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":774,"thread_start_us":661,"threads_started":1}
I20260809 13:06:28.845448 21396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:28.844449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.194:33697)
0809 13:06:28.845155 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:28.845247 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":360,"threads_started":1}
I20260809 13:06:29.361670 21397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:29.360817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.195:53371)
0809 13:06:29.361380 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:29.361467 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":317,"threads_started":1}
I20260809 13:06:29.362064 21398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:29.361162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.193:39591)
0809 13:06:29.361765 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:29.361886 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":356,"threads_started":1}
I20260809 13:06:29.847342 21399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:29.846475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.194:48153)
0809 13:06:29.847062 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:29.847166 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":288,"threads_started":1}
I20260809 13:06:30.363703 21400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:30.362709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.195:58833)
0809 13:06:30.363324 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:30.363478 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":314,"threads_started":1}
I20260809 13:06:30.364044 21401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:30.363132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.193:47243)
0809 13:06:30.363657 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:30.363751 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":231,"threads_started":1}
I20260809 13:06:30.849546 21403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:30.848474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.194:45557)
0809 13:06:30.849194 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:30.849292 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":314,"threads_started":1}
I20260809 13:06:31.365607 21408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:31.364694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.195:41741)
0809 13:06:31.365282 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:31.365382 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":302,"threads_started":1}
I20260809 13:06:31.365772 21409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:31.364968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.193:45007)
0809 13:06:31.365491 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:31.365577 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":298,"threads_started":1}
I20260809 13:06:31.851404 21410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:31.850495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.194:55907)
0809 13:06:31.851098 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:31.851184 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":356,"threads_started":1}
I20260809 13:06:32.367738 21415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:32.366882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.193:53681)
0809 13:06:32.367436 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:32.367539 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":303,"threads_started":1}
I20260809 13:06:32.368469 21413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:32.366873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.195:59549)
0809 13:06:32.368239 (+ 1366us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:32.368321 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1270,"thread_start_us":1151,"threads_started":1}
I20260809 13:06:32.853395 21416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:32.852448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.194:54635)
0809 13:06:32.853099 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:32.853198 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":263,"threads_started":1}
I20260809 13:06:33.369765 21417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:33.368855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.193:40401)
0809 13:06:33.369422 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:33.369530 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":446,"threads_started":1}
I20260809 13:06:33.370266 21418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:33.369434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.195:46477)
0809 13:06:33.369988 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:33.370085 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":345,"threads_started":1}
I20260809 13:06:33.855264 21419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:33.854452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.194:43253)
0809 13:06:33.854977 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:33.855071 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":267,"threads_started":1}
I20260809 13:06:34.371779 21420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:34.370877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.193:51253)
0809 13:06:34.371478 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:34.371569 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":340,"threads_started":1}
I20260809 13:06:34.372149 21422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:34.371231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.195:55181)
0809 13:06:34.371794 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:34.371878 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":338,"threads_started":1}
I20260809 13:06:34.857045 21424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:34.856232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.194:54671)
0809 13:06:34.856743 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:34.856838 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":290,"threads_started":1}
I20260809 13:06:35.373719 21426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:35.372810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.193:57675)
0809 13:06:35.373364 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:35.373495 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":255,"threads_started":1}
I20260809 13:06:35.373997 21427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:35.373170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.195:36787)
0809 13:06:35.373649 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:35.373737 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":263,"threads_started":1}
I20260809 13:06:35.858841 21428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:35.858095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.194:54269)
0809 13:06:35.858584 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:35.858673 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":236,"threads_started":1}
I20260809 13:06:36.375725 21430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:36.374961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.195:39311)
0809 13:06:36.375470 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:36.375564 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":279,"threads_started":1}
I20260809 13:06:36.376176 21429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:36.374654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.193:36509)
0809 13:06:36.375839 (+ 1185us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:36.375972 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1072,"thread_start_us":932,"threads_started":1}
I20260809 13:06:36.860848 21433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:36.859941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.194:59383)
0809 13:06:36.860541 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:36.860643 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":303,"threads_started":1}
I20260809 13:06:37.377907 21434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:37.376823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.195:41945)
0809 13:06:37.377487 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:37.377635 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":361,"threads_started":1}
I20260809 13:06:37.378288 21435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:37.377138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.193:37457)
0809 13:06:37.377803 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:37.377928 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":412,"threads_started":1}
I20260809 13:06:37.862736 21437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:37.861930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.194:51939)
0809 13:06:37.862428 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:37.862534 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":254,"threads_started":1}
I20260809 13:06:38.379854 21438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:38.378924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.195:54603)
0809 13:06:38.379475 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:38.379587 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":412,"threads_started":1}
I20260809 13:06:38.380931 21439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:38.379508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.193:38475)
0809 13:06:38.380293 (+ 785us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:38.380572 (+ 279us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":530,"threads_started":1}
I20260809 13:06:38.864995 21440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:38.864072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.194:44941)
0809 13:06:38.864669 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:38.864781 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":284,"threads_started":1}
I20260809 13:06:39.356802 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 20760
I20260809 13:06:39.378068 21441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:39.358165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38510 (local address 127.28.155.193:33563)
0809 13:06:39.360550 (+ 2385us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:39.360575 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:39.360621 (+ 46us) server_negotiation.cc:407] Connection header received
0809 13:06:39.362280 (+ 1659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:39.362291 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:39.362738 (+ 447us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:39.363111 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:39.364853 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:39.366153 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:39.367453 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:39.368164 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:39.368373 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:39.371334 (+ 2961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:39.371342 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:39.371357 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:39.371399 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:39.374462 (+ 3063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:39.375230 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:39.375237 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:39.375245 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:39.375433 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:39.375831 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:39.375836 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:39.375840 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:39.376436 (+ 596us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:39.376841 (+ 405us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:39.377286 (+ 445us) server_negotiation.cc:299] Negotiation successful
0809 13:06:39.377767 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2119,"thread_start_us":1936,"threads_started":1}
I20260809 13:06:39.379669 20978 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:06:39.394996 21444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:39.381786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.195:49065)
0809 13:06:39.394527 (+ 12741us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:39.394746 (+ 219us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12565,"thread_start_us":12123,"threads_started":1}
I20260809 13:06:39.478080 21445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:39.382263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37021 (local address 127.28.155.193:60827)
0809 13:06:39.477420 (+ 95157us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:39.477699 (+ 279us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95005,"thread_start_us":94820,"threads_started":1}
I20260809 13:06:39.478525 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 20760
I20260809 13:06:39.506551 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 20993
I20260809 13:06:39.525909 21446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:39.507783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50878 (local address 127.28.155.194:37509)
0809 13:06:39.508366 (+ 583us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:39.508382 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:39.508423 (+ 41us) server_negotiation.cc:407] Connection header received
0809 13:06:39.510202 (+ 1779us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:39.510211 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:39.510654 (+ 443us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:39.510973 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:39.512443 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:39.514043 (+ 1600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:39.515365 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:39.516121 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:39.516265 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:39.519106 (+ 2841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:39.519114 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:39.519132 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:39.519184 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:39.522492 (+ 3308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:39.523234 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:39.523242 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:39.523250 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:39.523456 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:39.523842 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:39.523846 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:39.523848 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:39.524463 (+ 615us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:39.524796 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:39.525208 (+ 412us) server_negotiation.cc:299] Negotiation successful
0809 13:06:39.525575 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":280,"threads_started":1}
I20260809 13:06:39.527395 21174 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:06:39.616971 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 20993
I20260809 13:06:39.646744 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 21187
I20260809 13:06:39.666080 21449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:39.648096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40744 (local address 127.28.155.195:33887)
0809 13:06:39.648803 (+ 707us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:39.648818 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:39.648865 (+ 47us) server_negotiation.cc:407] Connection header received
0809 13:06:39.650638 (+ 1773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:39.650649 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:39.651184 (+ 535us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:39.651487 (+ 303us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:39.653276 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:39.654533 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:39.655853 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:39.656677 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:39.656818 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:39.659625 (+ 2807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:39.659633 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:39.659647 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:39.659686 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:39.662815 (+ 3129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:39.663535 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:39.663542 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:39.663548 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:39.663724 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:39.664083 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:39.664086 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:39.664088 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:39.664699 (+ 611us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:39.664941 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:39.665327 (+ 386us) server_negotiation.cc:299] Negotiation successful
0809 13:06:39.665759 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":357,"threads_started":1}
I20260809 13:06:39.667477 21366 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:06:39.756388 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 21187
2026-08-09T13:06:39Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (25377 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:06:39 dist-test-slave-jq4t krb5kdc[21457](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:06:39 dist-test-slave-jq4t krb5kdc[21457](info): set up 2 sockets
Aug 09 13:06:39 dist-test-slave-jq4t krb5kdc[21457](info): commencing operation
krb5kdc: starting...
W20260809 13:06:41.134702 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.324s user 0.003s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:06:41 dist-test-slave-jq4t krb5kdc[21457](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280801, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:06:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:06:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
I20260809 13:06:41.464226 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:41979
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:34587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:41979
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:06:41.831516 21474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:06:41.831876 21474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:06:41.832070 21474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:06:41.839840 21474 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 13:06:41.839987 21474 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 13:06:41.840077 21474 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 13:06:41.840164 21474 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:06:41.840260 21474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:06:41.840390 21474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:06:41.840466 21474 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:06:41.840580 21474 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:06:41.851418 21474 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:34587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:41979
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:41979
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:06:41.852934 21474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:06:41.854437 21474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:06:41.867285 21480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:41.867259 21484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:41.867202 21486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:06:41.869892 21474 server_base.cc:1034] running on GCE node
I20260809 13:06:41.870841 21474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:06:41.872448 21474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:06:41.873766 21474 hybrid_clock.cc:648] HybridClock initialized: now 1786280801873708 us; error 38 us; skew 500 ppm
I20260809 13:06:41.874123 21474 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:06:41 dist-test-slave-jq4t krb5kdc[21457](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280801, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:06:41.877696 21474 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:06:41.879338 21474 webserver.cc:460] Webserver started at http://127.28.155.254:38855/ using document root <none> and password file <none>
I20260809 13:06:41.880105 21474 fs_manager.cc:359] Metadata directory not provided
I20260809 13:06:41.880244 21474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:06:41.880664 21474 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:06:41.883814 21474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "c799bc54783c4ae6b655d1a28f08a4bf"
format_stamp: "Formatted at 2026-08-09 13:06:41 on dist-test-slave-jq4t"
server_key: "8dd543171a6313c5ab2793d91d12086e"
server_key_iv: "567baabfd040ed5c32ea3c0f3aadfa93"
server_key_version: "encryptionkey@0"
I20260809 13:06:41.884742 21474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "c799bc54783c4ae6b655d1a28f08a4bf"
format_stamp: "Formatted at 2026-08-09 13:06:41 on dist-test-slave-jq4t"
server_key: "8dd543171a6313c5ab2793d91d12086e"
server_key_iv: "567baabfd040ed5c32ea3c0f3aadfa93"
server_key_version: "encryptionkey@0"
I20260809 13:06:41.890390 21474 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 13:06:41.894181 21497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:41.895613 21474 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 13:06:41.895826 21474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "c799bc54783c4ae6b655d1a28f08a4bf"
format_stamp: "Formatted at 2026-08-09 13:06:41 on dist-test-slave-jq4t"
server_key: "8dd543171a6313c5ab2793d91d12086e"
server_key_iv: "567baabfd040ed5c32ea3c0f3aadfa93"
server_key_version: "encryptionkey@0"
I20260809 13:06:41.896111 21474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:06:41.929123 21474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:06:41.933701 21474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:06:41.933997 21474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:06:41.954633 21474 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:41979
I20260809 13:06:41.954655 21564 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:41979 every 8 connection(s)
I20260809 13:06:41.956152 21474 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:06:41.957564 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 21474
I20260809 13:06:41.957815 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:06:41.958549 29295 external_mini_cluster.cc:1428] Setting key a7ff693d304939ef810db9f337382244
I20260809 13:06:41.961066 21565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 13:06:41 dist-test-slave-jq4t krb5kdc[21457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280801, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:06:41.976408 21565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf: Bootstrap starting.
I20260809 13:06:41.980370 21565 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf: Neither blocks nor log segments found. Creating new log.
I20260809 13:06:41.981583 21565 log.cc:824] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf: Log is configured to *not* fsync() on all Append() calls
I20260809 13:06:41.984805 21570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:41.960745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45320 (local address 127.28.155.254:41979)
0809 13:06:41.961592 (+ 847us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:41.961604 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:41.961648 (+ 44us) server_negotiation.cc:407] Connection header received
0809 13:06:41.963386 (+ 1738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:41.963409 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:41.963791 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:41.964135 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:41.966384 (+ 2249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:41.968898 (+ 2514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:41.970807 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:41.971524 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:41.971670 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:41.976946 (+ 5276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:41.976954 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:41.976969 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:41.977014 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:41.980194 (+ 3180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:41.981074 (+ 880us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:41.981082 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:41.981089 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:41.981280 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:41.981718 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:41.981724 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:41.981728 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:41.982496 (+ 768us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:41.982856 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:41.983262 (+ 406us) server_negotiation.cc:299] Negotiation successful
0809 13:06:41.983695 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":645,"thread_start_us":404,"threads_started":1}
I20260809 13:06:41.985169 21565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf: No bootstrap required, opened a new log
I20260809 13:06:41.993430 21565 raft_consensus.cc:348] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c799bc54783c4ae6b655d1a28f08a4bf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 41979 } }
I20260809 13:06:41.993988 21565 raft_consensus.cc:374] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:06:41.994153 21565 raft_consensus.cc:729] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c799bc54783c4ae6b655d1a28f08a4bf, State: Initialized, Role: FOLLOWER
I20260809 13:06:41.994865 21565 consensus_queue.cc:260] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c799bc54783c4ae6b655d1a28f08a4bf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 41979 } }
I20260809 13:06:41.995095 21565 raft_consensus.cc:388] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:06:41.995203 21565 raft_consensus.cc:482] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:06:41.995342 21565 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:06:41.997753 21565 raft_consensus.cc:504] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c799bc54783c4ae6b655d1a28f08a4bf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 41979 } }
I20260809 13:06:41.998353 21565 leader_election.cc:302] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c799bc54783c4ae6b655d1a28f08a4bf; no voters:
I20260809 13:06:41.999141 21565 leader_election.cc:288] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:06:41.999301 21572 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:06:42.000290 21572 raft_consensus.cc:686] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [term 1 LEADER]: Becoming Leader. State: Replica: c799bc54783c4ae6b655d1a28f08a4bf, State: Running, Role: LEADER
I20260809 13:06:42.000955 21572 consensus_queue.cc:237] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c799bc54783c4ae6b655d1a28f08a4bf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 41979 } }
I20260809 13:06:42.001636 21565 sys_catalog.cc:564] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:06:42.003952 21575 sys_catalog.cc:455] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader c799bc54783c4ae6b655d1a28f08a4bf. Latest consensus state: current_term: 1 leader_uuid: "c799bc54783c4ae6b655d1a28f08a4bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c799bc54783c4ae6b655d1a28f08a4bf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 41979 } } }
I20260809 13:06:42.004740 21575 sys_catalog.cc:458] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [sys.catalog]: This master's current role is: LEADER
I20260809 13:06:42.003923 21573 sys_catalog.cc:455] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c799bc54783c4ae6b655d1a28f08a4bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c799bc54783c4ae6b655d1a28f08a4bf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 41979 } } }
I20260809 13:06:42.005374 21573 sys_catalog.cc:458] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [sys.catalog]: This master's current role is: LEADER
I20260809 13:06:42.006803 21585 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:06:42.011981 21585 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:06:42.021540 21585 catalog_manager.cc:1347] Generated new cluster ID: 49058844f6cd4c12a08cee075201d50d
I20260809 13:06:42.021692 21585 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:06:42.036120 21585 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:06:42.038201 21585 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:06:42.048128 21585 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf: Generated new TSK 0
I20260809 13:06:42.049286 21585 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
I20260809 13:06:42.140192 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:0
--local_ip_for_outbound_sockets=127.28.155.193
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:41979
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:34587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:06:42.506886 21600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:06:42.507249 21600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:06:42.507428 21600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:06:42.515493 21600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:06:42.515691 21600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:06:42.515882 21600 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:06:42.526365 21600 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:34587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:41979
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:06:42.527833 21600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:06:42.529341 21600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:06:42.543521 21608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:42.543826 21607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:42.543632 21613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:06:42.544441 21600 server_base.cc:1034] running on GCE node
I20260809 13:06:42.545171 21600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:06:42.546142 21600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:06:42.547358 21600 hybrid_clock.cc:648] HybridClock initialized: now 1786280802547318 us; error 36 us; skew 500 ppm
I20260809 13:06:42.547712 21600 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:06:42 dist-test-slave-jq4t krb5kdc[21457](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280802, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:06:42.551177 21600 init.cc:377] Logged in from keytab as kudu/127.28.155.193@KRBTEST.COM (short username kudu)
I20260809 13:06:42.552816 21600 webserver.cc:460] Webserver started at http://127.28.155.193:39083/ using document root <none> and password file <none>
I20260809 13:06:42.553546 21600 fs_manager.cc:359] Metadata directory not provided
I20260809 13:06:42.553685 21600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:06:42.554035 21600 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:06:42.557214 21600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/data/instance:
uuid: "32431bad486442a1957c9dbaa6768419"
format_stamp: "Formatted at 2026-08-09 13:06:42 on dist-test-slave-jq4t"
server_key: "a7d222713ac126e6a00e5bc9e894a855"
server_key_iv: "3161193cdd1e469ffe00d5eb21cbdf97"
server_key_version: "encryptionkey@0"
I20260809 13:06:42.558017 21600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance:
uuid: "32431bad486442a1957c9dbaa6768419"
format_stamp: "Formatted at 2026-08-09 13:06:42 on dist-test-slave-jq4t"
server_key: "a7d222713ac126e6a00e5bc9e894a855"
server_key_iv: "3161193cdd1e469ffe00d5eb21cbdf97"
server_key_version: "encryptionkey@0"
I20260809 13:06:42.563632 21600 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 13:06:42.567489 21623 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:42.569046 21600 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:06:42.569248 21600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "32431bad486442a1957c9dbaa6768419"
format_stamp: "Formatted at 2026-08-09 13:06:42 on dist-test-slave-jq4t"
server_key: "a7d222713ac126e6a00e5bc9e894a855"
server_key_iv: "3161193cdd1e469ffe00d5eb21cbdf97"
server_key_version: "encryptionkey@0"
I20260809 13:06:42.569474 21600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:06:42.586421 21600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:06:42.590850 21600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:06:42.591183 21600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:06:42.592311 21600 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:06:42.593844 21600 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:06:42.593923 21600 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:42.594110 21600 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:06:42.594166 21600 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:42.630771 21600 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:42839
I20260809 13:06:42.630811 21781 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:42839 every 8 connection(s)
I20260809 13:06:42.632234 21600 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:06:42.636344 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 21600
I20260809 13:06:42.636668 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance
I20260809 13:06:42.637580 29295 external_mini_cluster.cc:1428] Setting key 8df8085b10eb0ccc8a2471e3c2be827f
Aug 09 13:06:42 dist-test-slave-jq4t krb5kdc[21457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280802, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:06:42.656284 21786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:42.635159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:54059 (local address 127.28.155.254:41979)
0809 13:06:42.635689 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:42.635697 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:42.636973 (+ 1276us) server_negotiation.cc:407] Connection header received
0809 13:06:42.639169 (+ 2196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:42.639174 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:42.639251 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:42.639351 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:42.641258 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:42.642499 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:42.644111 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:42.644867 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:42.645019 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:42.648693 (+ 3674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:42.648702 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:42.648710 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:42.648759 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:42.652747 (+ 3988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:42.653605 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:42.653613 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:42.653619 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:42.653790 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:42.654321 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:42.654325 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:42.654329 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:42.654629 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:42.654818 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:42.655598 (+ 780us) server_negotiation.cc:299] Negotiation successful
0809 13:06:42.655864 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":242,"threads_started":1}
I20260809 13:06:42.657390 21788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:42.635755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.193:54059)
0809 13:06:42.636756 (+ 1001us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:42.636822 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:42.638819 (+ 1997us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:42.639678 (+ 859us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:42.639688 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:42.640272 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:06:42.641063 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:42.641086 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:42.642673 (+ 1587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:42.642677 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:42.643947 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:42.643960 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:42.645109 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:42.645114 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:42.645322 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:42.646068 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:06:42.646091 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:06:42.648395 (+ 2304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:06:42.652918 (+ 4523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:42.652927 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:42.652942 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:42.653450 (+ 508us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:42.653951 (+ 501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:42.653956 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:42.653959 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:42.654187 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:42.654777 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:06:42.654785 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:06:42.655198 (+ 413us) client_negotiation.cc:769] Sending connection context
0809 13:06:42.655488 (+ 290us) client_negotiation.cc:240] Negotiation successful
0809 13:06:42.656107 (+ 619us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"thread_start_us":393,"threads_started":1}
I20260809 13:06:42.659308 21782 heartbeater.cc:347] Connected to a master server at 127.28.155.254:41979
I20260809 13:06:42.659667 21782 heartbeater.cc:464] Registering TS with master...
I20260809 13:06:42.660602 21782 heartbeater.cc:511] Master 127.28.155.254:41979 requested a full tablet report, sending...
I20260809 13:06:42.663326 21523 ts_manager.cc:194] Registered new tserver with Master: 32431bad486442a1957c9dbaa6768419 (127.28.155.193:42839)
I20260809 13:06:42.665638 21523 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.193@KRBTEST.COM'} at 127.28.155.193:54059
WARNING: no policy specified for kudu/127.28.155.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
I20260809 13:06:42.712839 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:0
--local_ip_for_outbound_sockets=127.28.155.194
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:41979
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:34587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:06:43.086243 21792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:06:43.086722 21792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:06:43.086905 21792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:06:43.100418 21792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:06:43.100628 21792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:06:43.100865 21792 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:06:43.119750 21792 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:34587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:41979
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:06:43.121814 21792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:06:43.123919 21792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:06:43.142288 21798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:43.142143 21799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:43.142994 21802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:06:43.144873 21792 server_base.cc:1034] running on GCE node
I20260809 13:06:43.145670 21792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:06:43.148811 21792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:06:43.150115 21792 hybrid_clock.cc:648] HybridClock initialized: now 1786280803150006 us; error 99 us; skew 500 ppm
I20260809 13:06:43.150589 21792 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:06:43 dist-test-slave-jq4t krb5kdc[21457](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280803, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:06:43.154933 21792 init.cc:377] Logged in from keytab as kudu/127.28.155.194@KRBTEST.COM (short username kudu)
I20260809 13:06:43.156677 21792 webserver.cc:460] Webserver started at http://127.28.155.194:43511/ using document root <none> and password file <none>
I20260809 13:06:43.157464 21792 fs_manager.cc:359] Metadata directory not provided
I20260809 13:06:43.157629 21792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:06:43.157987 21792 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:06:43.161345 21792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/data/instance:
uuid: "a1e962f4526b469ca869b7a1f39b1417"
format_stamp: "Formatted at 2026-08-09 13:06:43 on dist-test-slave-jq4t"
server_key: "9eba38b9a8f026cc275e94993e44f540"
server_key_iv: "3ca5f7dfc8df45729e4a779d4e603302"
server_key_version: "encryptionkey@0"
I20260809 13:06:43.162271 21792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance:
uuid: "a1e962f4526b469ca869b7a1f39b1417"
format_stamp: "Formatted at 2026-08-09 13:06:43 on dist-test-slave-jq4t"
server_key: "9eba38b9a8f026cc275e94993e44f540"
server_key_iv: "3ca5f7dfc8df45729e4a779d4e603302"
server_key_version: "encryptionkey@0"
I20260809 13:06:43.167999 21792 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260809 13:06:43.171970 21815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:43.173619 21792 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:06:43.173832 21792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "a1e962f4526b469ca869b7a1f39b1417"
format_stamp: "Formatted at 2026-08-09 13:06:43 on dist-test-slave-jq4t"
server_key: "9eba38b9a8f026cc275e94993e44f540"
server_key_iv: "3ca5f7dfc8df45729e4a779d4e603302"
server_key_version: "encryptionkey@0"
I20260809 13:06:43.174160 21792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:06:43.201792 21792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:06:43.206990 21792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:06:43.207409 21792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:06:43.208681 21792 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:06:43.210419 21792 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:06:43.210533 21792 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:43.210698 21792 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:06:43.210776 21792 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:43.247483 21792 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:35147
I20260809 13:06:43.247551 21972 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:35147 every 8 connection(s)
I20260809 13:06:43.248966 21792 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:06:43.257588 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 21792
I20260809 13:06:43.257771 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance
I20260809 13:06:43.258263 29295 external_mini_cluster.cc:1428] Setting key b490129382da0ce60d74beb3146edf6a
Aug 09 13:06:43 dist-test-slave-jq4t krb5kdc[21457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280803, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:06:43.273150 21975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:43.251865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:34411 (local address 127.28.155.254:41979)
0809 13:06:43.252380 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:43.252386 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:43.253531 (+ 1145us) server_negotiation.cc:407] Connection header received
0809 13:06:43.255408 (+ 1877us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:43.255413 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:43.255521 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:43.255626 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:43.257368 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:43.258290 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:43.260363 (+ 2073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:43.260939 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:43.261045 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:43.265720 (+ 4675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:43.265730 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:43.265737 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:43.265788 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:43.269561 (+ 3773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:43.270350 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:43.270358 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:43.270364 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:43.270531 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:43.270992 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:43.270999 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:43.271005 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:43.271425 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:43.271588 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:43.272339 (+ 751us) server_negotiation.cc:299] Negotiation successful
0809 13:06:43.272648 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":223,"threads_started":1}
I20260809 13:06:43.274139 21976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:43.252558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.194:34411)
0809 13:06:43.253344 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:43.253385 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:43.255125 (+ 1740us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:43.255838 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:43.255847 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:43.256440 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:06:43.257117 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:43.257186 (+ 69us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:43.258526 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:43.258532 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:43.260192 (+ 1660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:43.260218 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:43.261190 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:43.261199 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:43.261517 (+ 318us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:43.262348 (+ 831us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:06:43.262384 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:06:43.265446 (+ 3062us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:06:43.269712 (+ 4266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:43.269720 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:43.269734 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:43.270201 (+ 467us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:43.270653 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:43.270657 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:43.270659 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:43.270869 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:43.271566 (+ 697us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:06:43.271572 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:06:43.271924 (+ 352us) client_negotiation.cc:769] Sending connection context
0809 13:06:43.272179 (+ 255us) client_negotiation.cc:240] Negotiation successful
0809 13:06:43.272700 (+ 521us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":324,"threads_started":1}
I20260809 13:06:43.275759 21973 heartbeater.cc:347] Connected to a master server at 127.28.155.254:41979
I20260809 13:06:43.276139 21973 heartbeater.cc:464] Registering TS with master...
I20260809 13:06:43.277004 21973 heartbeater.cc:511] Master 127.28.155.254:41979 requested a full tablet report, sending...
I20260809 13:06:43.278651 21523 ts_manager.cc:194] Registered new tserver with Master: a1e962f4526b469ca869b7a1f39b1417 (127.28.155.194:35147)
I20260809 13:06:43.279613 21523 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.194@KRBTEST.COM'} at 127.28.155.194:34411
WARNING: no policy specified for kudu/127.28.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
I20260809 13:06:43.331996 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:0
--local_ip_for_outbound_sockets=127.28.155.195
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:41979
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:34587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 13:06:43.669304 21782 heartbeater.cc:503] Master 127.28.155.254:41979 was elected leader, sending a full tablet report...
W20260809 13:06:43.708418 21979 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:06:43.708822 21979 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:06:43.708997 21979 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:06:43.717203 21979 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:06:43.717324 21979 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:06:43.717515 21979 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:06:43.727870 21979 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:34587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:41979
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:06:43.729413 21979 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:06:43.730849 21979 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:06:43.744987 21986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:43.745042 21988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:06:43.745076 21984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:06:43.745875 21979 server_base.cc:1034] running on GCE node
I20260809 13:06:43.746616 21979 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:06:43.747645 21979 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:06:43.748883 21979 hybrid_clock.cc:648] HybridClock initialized: now 1786280803748832 us; error 64 us; skew 500 ppm
I20260809 13:06:43.749229 21979 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:06:43 dist-test-slave-jq4t krb5kdc[21457](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280803, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:06:43.756057 21979 init.cc:377] Logged in from keytab as kudu/127.28.155.195@KRBTEST.COM (short username kudu)
I20260809 13:06:43.757673 21979 webserver.cc:460] Webserver started at http://127.28.155.195:43387/ using document root <none> and password file <none>
I20260809 13:06:43.758386 21979 fs_manager.cc:359] Metadata directory not provided
I20260809 13:06:43.758507 21979 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:06:43.758780 21979 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:06:43.761934 21979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/data/instance:
uuid: "068b996951764080a3ba7a22c4c37878"
format_stamp: "Formatted at 2026-08-09 13:06:43 on dist-test-slave-jq4t"
server_key: "5fff6486a033b52506a8d3a2d083bdc8"
server_key_iv: "c722ecba876d7e0bad7db53fb5e458dd"
server_key_version: "encryptionkey@0"
I20260809 13:06:43.762718 21979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance:
uuid: "068b996951764080a3ba7a22c4c37878"
format_stamp: "Formatted at 2026-08-09 13:06:43 on dist-test-slave-jq4t"
server_key: "5fff6486a033b52506a8d3a2d083bdc8"
server_key_iv: "c722ecba876d7e0bad7db53fb5e458dd"
server_key_version: "encryptionkey@0"
I20260809 13:06:43.768338 21979 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 13:06:43.772188 21998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:43.773918 21979 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:06:43.774138 21979 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "068b996951764080a3ba7a22c4c37878"
format_stamp: "Formatted at 2026-08-09 13:06:43 on dist-test-slave-jq4t"
server_key: "5fff6486a033b52506a8d3a2d083bdc8"
server_key_iv: "c722ecba876d7e0bad7db53fb5e458dd"
server_key_version: "encryptionkey@0"
I20260809 13:06:43.774434 21979 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:06:43.805707 21979 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:06:43.810523 21979 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:06:43.810853 21979 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:06:43.811939 21979 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:06:43.813468 21979 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:06:43.813546 21979 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:43.813701 21979 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:06:43.813788 21979 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:06:43.851606 21979 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:36419
I20260809 13:06:43.851658 22165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:36419 every 8 connection(s)
I20260809 13:06:43.853083 21979 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:06:43.856243 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 21979
I20260809 13:06:43.856510 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance
I20260809 13:06:43.857067 29295 external_mini_cluster.cc:1428] Setting key 75d54eac8a199f0f2c82f988faa997e2
Aug 09 13:06:43 dist-test-slave-jq4t krb5kdc[21457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280803, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:06:43.875738 22170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:43.855985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:39751 (local address 127.28.155.254:41979)
0809 13:06:43.856662 (+ 677us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:43.856668 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:43.860370 (+ 3702us) server_negotiation.cc:407] Connection header received
0809 13:06:43.860437 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:43.860442 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:43.860581 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:43.860704 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:43.862345 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:43.863178 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:43.864870 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:43.865283 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:43.865429 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:43.869171 (+ 3742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:43.869177 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:43.869180 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:43.869216 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:43.872313 (+ 3097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:43.873409 (+ 1096us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:43.873414 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:43.873416 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:43.873584 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:43.874090 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:43.874094 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:43.874096 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:43.874376 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:43.874560 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:43.875237 (+ 677us) server_negotiation.cc:299] Negotiation successful
0809 13:06:43.875422 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":528,"thread_start_us":270,"threads_started":1}
I20260809 13:06:43.876830 22171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:43.856704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.195:39751)
0809 13:06:43.857565 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:43.857624 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:43.859966 (+ 2342us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:43.861001 (+ 1035us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:43.861010 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:43.861570 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:06:43.862162 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:43.862180 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:43.863341 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:43.863352 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:43.864717 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:43.864730 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:43.865537 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:43.865545 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:43.865798 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:43.866548 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:06:43.866572 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:06:43.868920 (+ 2348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:06:43.872527 (+ 3607us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:43.872538 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:43.872578 (+ 40us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:43.873227 (+ 649us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:43.873714 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:06:43.873719 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:06:43.873723 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:06:43.873943 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:06:43.874513 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:06:43.874520 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:06:43.874876 (+ 356us) client_negotiation.cc:769] Sending connection context
0809 13:06:43.875122 (+ 246us) client_negotiation.cc:240] Negotiation successful
0809 13:06:43.875561 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":376,"threads_started":1}
I20260809 13:06:43.878543 22166 heartbeater.cc:347] Connected to a master server at 127.28.155.254:41979
I20260809 13:06:43.878952 22166 heartbeater.cc:464] Registering TS with master...
I20260809 13:06:43.879833 22166 heartbeater.cc:511] Master 127.28.155.254:41979 requested a full tablet report, sending...
I20260809 13:06:43.881426 21523 ts_manager.cc:194] Registered new tserver with Master: 068b996951764080a3ba7a22c4c37878 (127.28.155.195:36419)
I20260809 13:06:43.882301 21523 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.195@KRBTEST.COM'} at 127.28.155.195:39751
I20260809 13:06:43.886118 29295 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 13:06:43.905619 22170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:43.890919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45336 (local address 127.28.155.254:41979)
0809 13:06:43.891191 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:43.891198 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:43.891518 (+ 320us) server_negotiation.cc:407] Connection header received
0809 13:06:43.891659 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:43.891664 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:43.891730 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:43.891815 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:43.893542 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:43.894703 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:43.896373 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:43.896835 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:43.896938 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:43.899634 (+ 2696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:43.899639 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:43.899642 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:43.899678 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:43.902521 (+ 2843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:43.903397 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:43.903402 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:43.903405 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:43.903546 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:43.903958 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:43.903961 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:43.903963 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:43.904410 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:43.904688 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:43.904986 (+ 298us) server_negotiation.cc:299] Negotiation successful
0809 13:06:43.905181 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 13:06:43.910200 21523 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45336:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 13:06:43.917733 21523 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:06:43.953406 22188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:43.932596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36174 (local address 127.28.155.195:36419)
0809 13:06:43.944508 (+ 11912us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:43.944524 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:43.944571 (+ 47us) server_negotiation.cc:407] Connection header received
0809 13:06:43.944717 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:43.944728 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:43.945087 (+ 359us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:43.945335 (+ 248us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:06:43.946138 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:43.947843 (+ 1705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:43.951023 (+ 3180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:43.952031 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:43.952256 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:43.952467 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:43.952802 (+ 335us) server_negotiation.cc:299] Negotiation successful
0809 13:06:43.952979 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11632,"thread_start_us":11397,"threads_started":1}
I20260809 13:06:43.953600 22190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:43.932405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:36419 (local address 127.0.0.1:36174)
0809 13:06:43.943414 (+ 11009us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:43.943433 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:43.943568 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:43.945361 (+ 1793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:43.945370 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:43.945404 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:06:43.945903 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:43.945919 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:43.948082 (+ 2163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:43.948088 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:43.950810 (+ 2722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:43.950850 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:43.952260 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:43.952266 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:43.952468 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:43.952576 (+ 108us) client_negotiation.cc:769] Sending connection context
0809 13:06:43.952749 (+ 173us) client_negotiation.cc:240] Negotiation successful
0809 13:06:43.953114 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10874,"mutex_wait_us":133,"thread_start_us":10698,"threads_started":1}
I20260809 13:06:43.956342 22185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:43.930795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:35147 (local address 127.0.0.1:43138)
0809 13:06:43.939009 (+ 8214us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:43.939075 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:43.939300 (+ 225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:43.948678 (+ 9378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:43.948683 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:43.948710 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:06:43.949293 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:43.949305 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:43.951099 (+ 1794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:43.951105 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:43.953292 (+ 2187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:43.953313 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:43.955492 (+ 2179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:43.955499 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:43.955683 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:43.955716 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 13:06:43.955801 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 13:06:43.955936 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7851,"mutex_wait_us":29,"thread_start_us":7660,"threads_started":1}
I20260809 13:06:43.957201 22186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:43.931135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43138 (local address 127.28.155.194:35147)
0809 13:06:43.947980 (+ 16845us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:43.947991 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:43.948039 (+ 48us) server_negotiation.cc:407] Connection header received
0809 13:06:43.948145 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:43.948153 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:43.948433 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:43.948673 (+ 240us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:06:43.949493 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:43.950958 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:43.953516 (+ 2558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:43.955263 (+ 1747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:43.955462 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:43.955654 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:43.956708 (+ 1054us) server_negotiation.cc:299] Negotiation successful
0809 13:06:43.956891 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16666,"thread_start_us":16727,"threads_started":1}
I20260809 13:06:43.958268 22192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:43.932437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:42839 (local address 127.0.0.1:39662)
0809 13:06:43.947929 (+ 15492us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:43.947950 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:43.948090 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:43.948982 (+ 892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:43.948988 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:43.949035 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:06:43.949844 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:43.949860 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:43.952410 (+ 2550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:43.952415 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:43.955016 (+ 2601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:43.955033 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:43.957365 (+ 2332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:43.957372 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:43.957538 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:43.957570 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 13:06:43.957677 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 13:06:43.957807 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15367,"mutex_wait_us":48,"thread_start_us":15206,"threads_started":1}
I20260809 13:06:43.958303 22187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:43.931333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39662 (local address 127.28.155.193:42839)
0809 13:06:43.947538 (+ 16205us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:43.947547 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:43.948132 (+ 585us) server_negotiation.cc:407] Connection header received
0809 13:06:43.948258 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:43.948264 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:43.948442 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:43.948724 (+ 282us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:06:43.950059 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:43.952240 (+ 2181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:43.955322 (+ 3082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:43.956795 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:43.957019 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:43.957200 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:43.957739 (+ 539us) server_negotiation.cc:299] Negotiation successful
0809 13:06:43.957954 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16018,"thread_start_us":15839,"threads_started":1}
I20260809 13:06:43.960312 22066 tablet_service.cc:1467] Processing CreateTablet for tablet f7ae4dd3947c4955b4f0a2853fe8526d (DEFAULT_TABLE table=test-table [id=7cb2e4525e5c4724b62d9f3c7f181e48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:06:43.962178 22066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7ae4dd3947c4955b4f0a2853fe8526d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:06:43.962486 21693 tablet_service.cc:1467] Processing CreateTablet for tablet f7ae4dd3947c4955b4f0a2853fe8526d (DEFAULT_TABLE table=test-table [id=7cb2e4525e5c4724b62d9f3c7f181e48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:06:43.964053 21693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7ae4dd3947c4955b4f0a2853fe8526d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:06:43.964000 21885 tablet_service.cc:1467] Processing CreateTablet for tablet f7ae4dd3947c4955b4f0a2853fe8526d (DEFAULT_TABLE table=test-table [id=7cb2e4525e5c4724b62d9f3c7f181e48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:06:43.965294 21885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7ae4dd3947c4955b4f0a2853fe8526d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:06:43.980657 22197 tablet_bootstrap.cc:492] T f7ae4dd3947c4955b4f0a2853fe8526d P 32431bad486442a1957c9dbaa6768419: Bootstrap starting.
I20260809 13:06:43.982748 22199 tablet_bootstrap.cc:492] T f7ae4dd3947c4955b4f0a2853fe8526d P 068b996951764080a3ba7a22c4c37878: Bootstrap starting.
I20260809 13:06:43.984406 22198 tablet_bootstrap.cc:492] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417: Bootstrap starting.
I20260809 13:06:43.985713 22197 tablet_bootstrap.cc:654] T f7ae4dd3947c4955b4f0a2853fe8526d P 32431bad486442a1957c9dbaa6768419: Neither blocks nor log segments found. Creating new log.
I20260809 13:06:43.986558 22199 tablet_bootstrap.cc:654] T f7ae4dd3947c4955b4f0a2853fe8526d P 068b996951764080a3ba7a22c4c37878: Neither blocks nor log segments found. Creating new log.
I20260809 13:06:43.987989 22197 log.cc:824] T f7ae4dd3947c4955b4f0a2853fe8526d P 32431bad486442a1957c9dbaa6768419: Log is configured to *not* fsync() on all Append() calls
I20260809 13:06:43.988024 22199 log.cc:824] T f7ae4dd3947c4955b4f0a2853fe8526d P 068b996951764080a3ba7a22c4c37878: Log is configured to *not* fsync() on all Append() calls
I20260809 13:06:43.988243 22198 tablet_bootstrap.cc:654] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417: Neither blocks nor log segments found. Creating new log.
I20260809 13:06:43.989570 22198 log.cc:824] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417: Log is configured to *not* fsync() on all Append() calls
I20260809 13:06:43.991578 22197 tablet_bootstrap.cc:492] T f7ae4dd3947c4955b4f0a2853fe8526d P 32431bad486442a1957c9dbaa6768419: No bootstrap required, opened a new log
I20260809 13:06:43.991667 22199 tablet_bootstrap.cc:492] T f7ae4dd3947c4955b4f0a2853fe8526d P 068b996951764080a3ba7a22c4c37878: No bootstrap required, opened a new log
I20260809 13:06:43.991880 22197 ts_tablet_manager.cc:1397] T f7ae4dd3947c4955b4f0a2853fe8526d P 32431bad486442a1957c9dbaa6768419: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.002s
I20260809 13:06:43.991957 22199 ts_tablet_manager.cc:1397] T f7ae4dd3947c4955b4f0a2853fe8526d P 068b996951764080a3ba7a22c4c37878: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.007s
I20260809 13:06:43.992817 22198 tablet_bootstrap.cc:492] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417: No bootstrap required, opened a new log
I20260809 13:06:43.993083 22198 ts_tablet_manager.cc:1397] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260809 13:06:44.000459 22197 raft_consensus.cc:348] T f7ae4dd3947c4955b4f0a2853fe8526d P 32431bad486442a1957c9dbaa6768419 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e962f4526b469ca869b7a1f39b1417" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35147 } } peers { permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 } } peers { permanent_uuid: "068b996951764080a3ba7a22c4c37878" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36419 } }
I20260809 13:06:44.000982 22197 raft_consensus.cc:374] T f7ae4dd3947c4955b4f0a2853fe8526d P 32431bad486442a1957c9dbaa6768419 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:06:44.001259 22197 raft_consensus.cc:729] T f7ae4dd3947c4955b4f0a2853fe8526d P 32431bad486442a1957c9dbaa6768419 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32431bad486442a1957c9dbaa6768419, State: Initialized, Role: FOLLOWER
I20260809 13:06:44.002007 22197 consensus_queue.cc:260] T f7ae4dd3947c4955b4f0a2853fe8526d P 32431bad486442a1957c9dbaa6768419 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e962f4526b469ca869b7a1f39b1417" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35147 } } peers { permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 } } peers { permanent_uuid: "068b996951764080a3ba7a22c4c37878" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36419 } }
I20260809 13:06:44.003528 22199 raft_consensus.cc:348] T f7ae4dd3947c4955b4f0a2853fe8526d P 068b996951764080a3ba7a22c4c37878 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e962f4526b469ca869b7a1f39b1417" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35147 } } peers { permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 } } peers { permanent_uuid: "068b996951764080a3ba7a22c4c37878" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36419 } }
I20260809 13:06:44.004074 22199 raft_consensus.cc:374] T f7ae4dd3947c4955b4f0a2853fe8526d P 068b996951764080a3ba7a22c4c37878 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:06:44.004194 22199 raft_consensus.cc:729] T f7ae4dd3947c4955b4f0a2853fe8526d P 068b996951764080a3ba7a22c4c37878 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 068b996951764080a3ba7a22c4c37878, State: Initialized, Role: FOLLOWER
I20260809 13:06:44.004107 22198 raft_consensus.cc:348] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e962f4526b469ca869b7a1f39b1417" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35147 } } peers { permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 } } peers { permanent_uuid: "068b996951764080a3ba7a22c4c37878" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36419 } }
I20260809 13:06:44.004587 22198 raft_consensus.cc:374] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:06:44.004710 22198 raft_consensus.cc:729] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1e962f4526b469ca869b7a1f39b1417, State: Initialized, Role: FOLLOWER
I20260809 13:06:44.005077 22199 consensus_queue.cc:260] T f7ae4dd3947c4955b4f0a2853fe8526d P 068b996951764080a3ba7a22c4c37878 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e962f4526b469ca869b7a1f39b1417" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35147 } } peers { permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 } } peers { permanent_uuid: "068b996951764080a3ba7a22c4c37878" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36419 } }
I20260809 13:06:44.005298 22198 consensus_queue.cc:260] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e962f4526b469ca869b7a1f39b1417" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35147 } } peers { permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 } } peers { permanent_uuid: "068b996951764080a3ba7a22c4c37878" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36419 } }
I20260809 13:06:44.010203 22197 ts_tablet_manager.cc:1428] T f7ae4dd3947c4955b4f0a2853fe8526d P 32431bad486442a1957c9dbaa6768419: Time spent starting tablet: real 0.018s user 0.017s sys 0.001s
I20260809 13:06:44.010865 22198 ts_tablet_manager.cc:1428] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417: Time spent starting tablet: real 0.018s user 0.014s sys 0.004s
I20260809 13:06:44.010906 21973 heartbeater.cc:503] Master 127.28.155.254:41979 was elected leader, sending a full tablet report...
I20260809 13:06:44.011866 22166 heartbeater.cc:503] Master 127.28.155.254:41979 was elected leader, sending a full tablet report...
I20260809 13:06:44.012562 22199 ts_tablet_manager.cc:1428] T f7ae4dd3947c4955b4f0a2853fe8526d P 068b996951764080a3ba7a22c4c37878: Time spent starting tablet: real 0.020s user 0.015s sys 0.007s
W20260809 13:06:44.105008 22167 tablet.cc:2369] T f7ae4dd3947c4955b4f0a2853fe8526d P 068b996951764080a3ba7a22c4c37878: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 13:06:44.135222 21783 tablet.cc:2369] T f7ae4dd3947c4955b4f0a2853fe8526d P 32431bad486442a1957c9dbaa6768419: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:06:44.170202 22207 raft_consensus.cc:482] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:06:44.170601 22207 raft_consensus.cc:504] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e962f4526b469ca869b7a1f39b1417" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35147 } } peers { permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 } } peers { permanent_uuid: "068b996951764080a3ba7a22c4c37878" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36419 } }
I20260809 13:06:44.172590 22207 leader_election.cc:288] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32431bad486442a1957c9dbaa6768419 (127.28.155.193:42839), 068b996951764080a3ba7a22c4c37878 (127.28.155.195:36419)
I20260809 13:06:44.178838 22206 raft_consensus.cc:482] T f7ae4dd3947c4955b4f0a2853fe8526d P 068b996951764080a3ba7a22c4c37878 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:06:44.179255 22206 raft_consensus.cc:504] T f7ae4dd3947c4955b4f0a2853fe8526d P 068b996951764080a3ba7a22c4c37878 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e962f4526b469ca869b7a1f39b1417" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35147 } } peers { permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 } } peers { permanent_uuid: "068b996951764080a3ba7a22c4c37878" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36419 } }
I20260809 13:06:44.180832 22187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:44.173380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:59217 (local address 127.28.155.193:42839)
0809 13:06:44.173628 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:44.173636 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:44.174483 (+ 847us) server_negotiation.cc:407] Connection header received
0809 13:06:44.174722 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:44.174732 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:44.174795 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:44.174898 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:06:44.175613 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:44.176328 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:44.178453 (+ 2125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:44.179775 (+ 1322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:44.179991 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:44.180072 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:44.180414 (+ 342us) server_negotiation.cc:299] Negotiation successful
0809 13:06:44.180586 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260809 13:06:44.181192 22208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:44.173181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:36419 (local address 127.28.155.194:37655)
0809 13:06:44.174268 (+ 1087us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:44.174284 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:44.174500 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:44.174864 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:44.174870 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:44.174897 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:06:44.175334 (+ 437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:44.175344 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:44.176414 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:44.176421 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:44.178390 (+ 1969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:44.178403 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:44.180310 (+ 1907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:44.180319 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:44.180524 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:44.180556 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 13:06:44.180642 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 13:06:44.180783 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":915,"mutex_wait_us":57,"thread_start_us":631,"threads_started":1}
I20260809 13:06:44.181237 22209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:44.173269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:42839 (local address 127.28.155.194:59217)
0809 13:06:44.174358 (+ 1089us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:44.174377 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:44.174555 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:44.174924 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:44.174929 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:44.174959 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:06:44.175442 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:44.175451 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:44.176500 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:44.176512 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:44.178282 (+ 1770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:44.178299 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:44.180012 (+ 1713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:44.180020 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:44.180196 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:44.180244 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 13:06:44.180352 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 13:06:44.180547 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":942,"mutex_wait_us":46,"thread_start_us":629,"threads_started":1}
I20260809 13:06:44.181588 22188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:44.173195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:37655 (local address 127.28.155.195:36419)
0809 13:06:44.173446 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:44.173455 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:44.174423 (+ 968us) server_negotiation.cc:407] Connection header received
0809 13:06:44.174661 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:44.174672 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:44.174737 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:44.174839 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:06:44.175509 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:44.176262 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:44.178617 (+ 2355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:44.179887 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:44.180073 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:44.180154 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:44.181178 (+ 1024us) server_negotiation.cc:299] Negotiation successful
0809 13:06:44.181322 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260809 13:06:44.181620 22206 leader_election.cc:288] T f7ae4dd3947c4955b4f0a2853fe8526d P 068b996951764080a3ba7a22c4c37878 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1e962f4526b469ca869b7a1f39b1417 (127.28.155.194:35147), 32431bad486442a1957c9dbaa6768419 (127.28.155.193:42839)
I20260809 13:06:44.182555 21726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ae4dd3947c4955b4f0a2853fe8526d" candidate_uuid: "a1e962f4526b469ca869b7a1f39b1417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32431bad486442a1957c9dbaa6768419" is_pre_election: true
I20260809 13:06:44.182749 22095 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ae4dd3947c4955b4f0a2853fe8526d" candidate_uuid: "a1e962f4526b469ca869b7a1f39b1417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "068b996951764080a3ba7a22c4c37878" is_pre_election: true
I20260809 13:06:44.183220 22095 raft_consensus.cc:2454] T f7ae4dd3947c4955b4f0a2853fe8526d P 068b996951764080a3ba7a22c4c37878 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1e962f4526b469ca869b7a1f39b1417 in term 0.
I20260809 13:06:44.183259 21726 raft_consensus.cc:2454] T f7ae4dd3947c4955b4f0a2853fe8526d P 32431bad486442a1957c9dbaa6768419 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1e962f4526b469ca869b7a1f39b1417 in term 0.
I20260809 13:06:44.184095 21821 leader_election.cc:302] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068b996951764080a3ba7a22c4c37878, a1e962f4526b469ca869b7a1f39b1417; no voters:
I20260809 13:06:44.184556 22207 raft_consensus.cc:2781] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:06:44.184739 22207 raft_consensus.cc:482] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:06:44.184854 22207 raft_consensus.cc:3037] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:06:44.188400 22207 raft_consensus.cc:504] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e962f4526b469ca869b7a1f39b1417" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35147 } } peers { permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 } } peers { permanent_uuid: "068b996951764080a3ba7a22c4c37878" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36419 } }
I20260809 13:06:44.189774 22207 leader_election.cc:288] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417 [CANDIDATE]: Term 1 election: Requested vote from peers 32431bad486442a1957c9dbaa6768419 (127.28.155.193:42839), 068b996951764080a3ba7a22c4c37878 (127.28.155.195:36419)
I20260809 13:06:44.189767 21726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ae4dd3947c4955b4f0a2853fe8526d" candidate_uuid: "a1e962f4526b469ca869b7a1f39b1417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32431bad486442a1957c9dbaa6768419"
I20260809 13:06:44.190047 21726 raft_consensus.cc:3037] T f7ae4dd3947c4955b4f0a2853fe8526d P 32431bad486442a1957c9dbaa6768419 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:06:44.190586 22171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:44.182253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:35147 (local address 127.28.155.195:46373)
0809 13:06:44.182559 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:44.182580 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:44.182699 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:44.183275 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:44.183280 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:44.183309 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:06:44.183584 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:44.183600 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:44.185285 (+ 1685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:44.185290 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:44.187568 (+ 2278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:44.187587 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:44.189349 (+ 1762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:44.189355 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:44.189591 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:44.189629 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 13:06:44.189733 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 13:06:44.190264 (+ 531us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177}
I20260809 13:06:44.191046 22186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:44.182208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:46373 (local address 127.28.155.194:35147)
0809 13:06:44.182399 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:44.182407 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:44.182833 (+ 426us) server_negotiation.cc:407] Connection header received
0809 13:06:44.182902 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:44.182909 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:44.183004 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:44.183090 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:06:44.183801 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:44.185097 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:44.187743 (+ 2646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:44.189168 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:44.189330 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:44.189426 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:44.190006 (+ 580us) server_negotiation.cc:299] Negotiation successful
0809 13:06:44.190149 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 13:06:44.190485 22095 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ae4dd3947c4955b4f0a2853fe8526d" candidate_uuid: "a1e962f4526b469ca869b7a1f39b1417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "068b996951764080a3ba7a22c4c37878"
I20260809 13:06:44.191442 22095 raft_consensus.cc:3037] T f7ae4dd3947c4955b4f0a2853fe8526d P 068b996951764080a3ba7a22c4c37878 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:06:44.192279 22212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:44.182754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:42839 (local address 127.28.155.195:34865)
0809 13:06:44.185046 (+ 2292us) negotiation.cc:107] Waiting for socket to connect
0809 13:06:44.185062 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 13:06:44.185207 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:06:44.185588 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:06:44.185593 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:06:44.185618 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:06:44.186079 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:44.186088 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:44.187165 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:44.187170 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:44.189318 (+ 2148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:06:44.189332 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:06:44.191377 (+ 2045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:06:44.191384 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:06:44.191574 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:44.191609 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 13:06:44.191700 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 13:06:44.191842 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2164,"mutex_wait_us":33,"thread_start_us":4952,"threads_started":1}
I20260809 13:06:44.192191 21910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ae4dd3947c4955b4f0a2853fe8526d" candidate_uuid: "068b996951764080a3ba7a22c4c37878" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1e962f4526b469ca869b7a1f39b1417" is_pre_election: true
I20260809 13:06:44.192751 21910 raft_consensus.cc:2379] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068b996951764080a3ba7a22c4c37878 in current term 1: Already voted for candidate a1e962f4526b469ca869b7a1f39b1417 in this term.
I20260809 13:06:44.192988 22187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:44.183329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:34865 (local address 127.28.155.193:42839)
0809 13:06:44.184101 (+ 772us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:44.184110 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:44.185151 (+ 1041us) server_negotiation.cc:407] Connection header received
0809 13:06:44.185340 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:44.185345 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:44.185447 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:44.185572 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:06:44.186262 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:44.187012 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:44.189517 (+ 2505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:44.190949 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:44.191138 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:44.191222 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:44.192553 (+ 1331us) server_negotiation.cc:299] Negotiation successful
0809 13:06:44.192710 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":648}
I20260809 13:06:44.193712 21726 raft_consensus.cc:2454] T f7ae4dd3947c4955b4f0a2853fe8526d P 32431bad486442a1957c9dbaa6768419 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1e962f4526b469ca869b7a1f39b1417 in term 1.
I20260809 13:06:44.194204 21817 leader_election.cc:302] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32431bad486442a1957c9dbaa6768419, a1e962f4526b469ca869b7a1f39b1417; no voters:
I20260809 13:06:44.194806 22095 raft_consensus.cc:2454] T f7ae4dd3947c4955b4f0a2853fe8526d P 068b996951764080a3ba7a22c4c37878 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1e962f4526b469ca869b7a1f39b1417 in term 1.
I20260809 13:06:44.195653 22207 raft_consensus.cc:2781] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:06:44.195695 21726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ae4dd3947c4955b4f0a2853fe8526d" candidate_uuid: "068b996951764080a3ba7a22c4c37878" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32431bad486442a1957c9dbaa6768419" is_pre_election: true
I20260809 13:06:44.196045 21726 raft_consensus.cc:2379] T f7ae4dd3947c4955b4f0a2853fe8526d P 32431bad486442a1957c9dbaa6768419 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 068b996951764080a3ba7a22c4c37878 in current term 1: Already voted for candidate a1e962f4526b469ca869b7a1f39b1417 in this term.
I20260809 13:06:44.196208 22207 raft_consensus.cc:686] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417 [term 1 LEADER]: Becoming Leader. State: Replica: a1e962f4526b469ca869b7a1f39b1417, State: Running, Role: LEADER
I20260809 13:06:44.196796 22001 leader_election.cc:302] T f7ae4dd3947c4955b4f0a2853fe8526d P 068b996951764080a3ba7a22c4c37878 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 068b996951764080a3ba7a22c4c37878; no voters: 32431bad486442a1957c9dbaa6768419, a1e962f4526b469ca869b7a1f39b1417
I20260809 13:06:44.196777 22207 consensus_queue.cc:237] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e962f4526b469ca869b7a1f39b1417" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35147 } } peers { permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 } } peers { permanent_uuid: "068b996951764080a3ba7a22c4c37878" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36419 } }
I20260809 13:06:44.197197 22206 raft_consensus.cc:2726] T f7ae4dd3947c4955b4f0a2853fe8526d P 068b996951764080a3ba7a22c4c37878 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260809 13:06:44.201692 21523 catalog_manager.cc:5495] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1e962f4526b469ca869b7a1f39b1417 (127.28.155.194). New cstate: current_term: 1 leader_uuid: "a1e962f4526b469ca869b7a1f39b1417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e962f4526b469ca869b7a1f39b1417" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "068b996951764080a3ba7a22c4c37878" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36419 } health_report { overall_health: UNKNOWN } } }
W20260809 13:06:44.251601 21974 tablet.cc:2369] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:06:44.266124 22186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:44.260285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43152 (local address 127.28.155.194:35147)
0809 13:06:44.260516 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:44.260526 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:44.260616 (+ 90us) server_negotiation.cc:407] Connection header received
0809 13:06:44.260825 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:44.260828 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:44.260917 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:44.261048 (+ 131us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:06:44.261481 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:44.262285 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:44.263802 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:44.264197 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:44.264296 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:44.264937 (+ 641us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:06:44.265438 (+ 501us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:06:44.265568 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:44.265715 (+ 147us) server_negotiation.cc:299] Negotiation successful
0809 13:06:44.265787 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 13:06:44.274968 21726 raft_consensus.cc:1261] T f7ae4dd3947c4955b4f0a2853fe8526d P 32431bad486442a1957c9dbaa6768419 [term 1 FOLLOWER]: Refusing update from remote peer a1e962f4526b469ca869b7a1f39b1417: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:06:44.275038 22095 raft_consensus.cc:1261] T f7ae4dd3947c4955b4f0a2853fe8526d P 068b996951764080a3ba7a22c4c37878 [term 1 FOLLOWER]: Refusing update from remote peer a1e962f4526b469ca869b7a1f39b1417: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:06:44.275969 22214 consensus_queue.cc:1035] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:06:44.276336 22207 consensus_queue.cc:1035] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068b996951764080a3ba7a22c4c37878" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:06:44.310477 21523 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45336:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:06:44.310842 21523 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45336:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:06:44.314821 21523 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf: Sending DeleteTablet for 3 replicas of tablet f7ae4dd3947c4955b4f0a2853fe8526d
I20260809 13:06:44.316174 21693 tablet_service.cc:1514] Processing DeleteTablet for tablet f7ae4dd3947c4955b4f0a2853fe8526d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:06:44 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:39662
I20260809 13:06:44.316164 21885 tablet_service.cc:1514] Processing DeleteTablet for tablet f7ae4dd3947c4955b4f0a2853fe8526d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:06:44 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:43138
I20260809 13:06:44.316892 22066 tablet_service.cc:1514] Processing DeleteTablet for tablet f7ae4dd3947c4955b4f0a2853fe8526d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:06:44 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:36174
I20260809 13:06:44.317412 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 21600
I20260809 13:06:44.345767 22234 tablet_replica.cc:330] T f7ae4dd3947c4955b4f0a2853fe8526d P 32431bad486442a1957c9dbaa6768419: stopping tablet replica
I20260809 13:06:44.346683 22234 raft_consensus.cc:2229] T f7ae4dd3947c4955b4f0a2853fe8526d P 32431bad486442a1957c9dbaa6768419 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:06:44.347600 22234 raft_consensus.cc:2258] T f7ae4dd3947c4955b4f0a2853fe8526d P 32431bad486442a1957c9dbaa6768419 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:06:44.357493 22234 ts_tablet_manager.cc:1905] T f7ae4dd3947c4955b4f0a2853fe8526d P 32431bad486442a1957c9dbaa6768419: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:06:44.358376 22232 tablet_replica.cc:330] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417: stopping tablet replica
I20260809 13:06:44.358835 22232 raft_consensus.cc:2229] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417 [term 1 LEADER]: Raft consensus shutting down.
I20260809 13:06:44.359520 22232 raft_consensus.cc:2258] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:06:44.360436 22235 tablet_replica.cc:330] T f7ae4dd3947c4955b4f0a2853fe8526d P 068b996951764080a3ba7a22c4c37878: stopping tablet replica
I20260809 13:06:44.360908 22235 raft_consensus.cc:2229] T f7ae4dd3947c4955b4f0a2853fe8526d P 068b996951764080a3ba7a22c4c37878 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:06:44.361511 22235 raft_consensus.cc:2258] T f7ae4dd3947c4955b4f0a2853fe8526d P 068b996951764080a3ba7a22c4c37878 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:06:44.362371 22232 ts_tablet_manager.cc:1905] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 09 13:06:44 dist-test-slave-jq4t krb5kdc[21457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280801, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.193@KRBTEST.COM
I20260809 13:06:44.367861 22234 ts_tablet_manager.cc:1918] T f7ae4dd3947c4955b4f0a2853fe8526d P 32431bad486442a1957c9dbaa6768419: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:06:44.368083 22234 log.cc:1196] T f7ae4dd3947c4955b4f0a2853fe8526d P 32431bad486442a1957c9dbaa6768419: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/wal/wals/f7ae4dd3947c4955b4f0a2853fe8526d
I20260809 13:06:44.368242 22235 ts_tablet_manager.cc:1905] T f7ae4dd3947c4955b4f0a2853fe8526d P 068b996951764080a3ba7a22c4c37878: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:06:44.368702 22234 ts_tablet_manager.cc:1939] T f7ae4dd3947c4955b4f0a2853fe8526d P 32431bad486442a1957c9dbaa6768419: Deleting consensus metadata
I20260809 13:06:44.370977 21501 catalog_manager.cc:4841] TS 32431bad486442a1957c9dbaa6768419 (127.28.155.193:42839): tablet f7ae4dd3947c4955b4f0a2853fe8526d (table test-table [id=7cb2e4525e5c4724b62d9f3c7f181e48]) successfully deleted
I20260809 13:06:44.371119 22232 ts_tablet_manager.cc:1918] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:06:44.371433 22232 log.cc:1196] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/wal/wals/f7ae4dd3947c4955b4f0a2853fe8526d
I20260809 13:06:44.372113 22232 ts_tablet_manager.cc:1939] T f7ae4dd3947c4955b4f0a2853fe8526d P a1e962f4526b469ca869b7a1f39b1417: Deleting consensus metadata
I20260809 13:06:44.374223 21500 catalog_manager.cc:4841] TS a1e962f4526b469ca869b7a1f39b1417 (127.28.155.194:35147): tablet f7ae4dd3947c4955b4f0a2853fe8526d (table test-table [id=7cb2e4525e5c4724b62d9f3c7f181e48]) successfully deleted
I20260809 13:06:44.376032 22235 ts_tablet_manager.cc:1918] T f7ae4dd3947c4955b4f0a2853fe8526d P 068b996951764080a3ba7a22c4c37878: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:06:44.376240 22235 log.cc:1196] T f7ae4dd3947c4955b4f0a2853fe8526d P 068b996951764080a3ba7a22c4c37878: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/wal/wals/f7ae4dd3947c4955b4f0a2853fe8526d
I20260809 13:06:44.376780 22235 ts_tablet_manager.cc:1939] T f7ae4dd3947c4955b4f0a2853fe8526d P 068b996951764080a3ba7a22c4c37878: Deleting consensus metadata
I20260809 13:06:44.378676 21507 catalog_manager.cc:4841] TS 068b996951764080a3ba7a22c4c37878 (127.28.155.195:36419): tablet f7ae4dd3947c4955b4f0a2853fe8526d (table test-table [id=7cb2e4525e5c4724b62d9f3c7f181e48]) successfully deleted
I20260809 13:06:44.381742 22187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:44.319044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39668 (local address 127.28.155.193:42839)
0809 13:06:44.319292 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:44.319301 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:44.341287 (+ 21986us) server_negotiation.cc:407] Connection header received
0809 13:06:44.341964 (+ 677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:44.341974 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:44.342113 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:44.342212 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:44.347910 (+ 5698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:44.349489 (+ 1579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:44.352915 (+ 3426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:44.353907 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:44.354052 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:44.372892 (+ 18840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:44.372914 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:44.372939 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:44.373009 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:44.377734 (+ 4725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:44.379128 (+ 1394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:44.379141 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:44.379145 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:44.379349 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:44.379840 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:44.379846 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:44.379850 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:44.380382 (+ 532us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:44.380740 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:44.381079 (+ 339us) server_negotiation.cc:299] Negotiation successful
0809 13:06:44.381340 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 13:06:44.382568 21776 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:06:44.476775 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 21600
I20260809 13:06:44.507740 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 21792
Aug 09 13:06:44 dist-test-slave-jq4t krb5kdc[21457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280801, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.194@KRBTEST.COM
I20260809 13:06:44.527449 22186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:44.508612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43162 (local address 127.28.155.194:35147)
0809 13:06:44.508847 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:44.508851 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:44.508991 (+ 140us) server_negotiation.cc:407] Connection header received
0809 13:06:44.509153 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:44.509157 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:44.509225 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:44.509312 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:44.511302 (+ 1990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:44.512083 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:44.514239 (+ 2156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:44.514717 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:44.514847 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:44.520627 (+ 5780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:44.520645 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:44.520663 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:44.520710 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:44.524069 (+ 3359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:44.525149 (+ 1080us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:44.525157 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:44.525160 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:44.525334 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:44.525858 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:44.525862 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:44.525864 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:44.526273 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:44.526524 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:44.526919 (+ 395us) server_negotiation.cc:299] Negotiation successful
0809 13:06:44.527137 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 13:06:44.528227 21965 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:06:44.651808 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 21792
I20260809 13:06:44.680708 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 21979
Aug 09 13:06:44 dist-test-slave-jq4t krb5kdc[21457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280801, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.195@KRBTEST.COM
I20260809 13:06:44.698102 22188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:06:44.681520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36178 (local address 127.28.155.195:36419)
0809 13:06:44.681722 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 13:06:44.681729 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:06:44.681828 (+ 99us) server_negotiation.cc:407] Connection header received
0809 13:06:44.682082 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:06:44.682086 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:06:44.682170 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:06:44.682278 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:06:44.683838 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:44.684787 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:44.686218 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:06:44.686634 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:06:44.686780 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:06:44.691859 (+ 5079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:06:44.691878 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:06:44.691896 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:06:44.691934 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:06:44.695036 (+ 3102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:44.695800 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:44.695808 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:44.695810 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:44.695951 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:06:44.696360 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:06:44.696366 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:06:44.696369 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:06:44.696821 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:06:44.697139 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0809 13:06:44.697480 (+ 341us) server_negotiation.cc:299] Negotiation successful
0809 13:06:44.697707 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 13:06:44.698890 22161 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:06:44.795130 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 21979
I20260809 13:06:44.822582 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 21474
I20260809 13:06:44.823777 21560 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:06:44.941638 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 21474
I20260809 13:07:04.974368 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:41979
--webserver_interface=127.28.155.254
--webserver_port=38855
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:34587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:41979
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:07:05.347338 22242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:07:05.347661 22242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:07:05.347867 22242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:07:05.355681 22242 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 13:07:05.355808 22242 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 13:07:05.355890 22242 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 13:07:05.355995 22242 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:07:05.356084 22242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:07:05.356206 22242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:07:05.356307 22242 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:07:05.356395 22242 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:07:05.367295 22242 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:34587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:41979
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:41979
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=38855
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:07:05.368989 22242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:07:05.370482 22242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:07:05.402019 22251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:05.401971 22254 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:05.402100 22252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:07:05.403169 22242 server_base.cc:1034] running on GCE node
I20260809 13:07:05.404284 22242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:07:05.406231 22242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:07:05.407547 22242 hybrid_clock.cc:648] HybridClock initialized: now 1786280825407483 us; error 67 us; skew 500 ppm
I20260809 13:07:05.408038 22242 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:07:05 dist-test-slave-jq4t krb5kdc[21457](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280825, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:07:05.412248 22242 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:07:05.414148 22242 webserver.cc:460] Webserver started at http://127.28.155.254:38855/ using document root <none> and password file <none>
I20260809 13:07:05.415046 22242 fs_manager.cc:359] Metadata directory not provided
I20260809 13:07:05.415208 22242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:07:05.421950 22242 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 13:07:05.425239 22261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:05.426762 22242 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:07:05.427013 22242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "c799bc54783c4ae6b655d1a28f08a4bf"
format_stamp: "Formatted at 2026-08-09 13:06:41 on dist-test-slave-jq4t"
server_key: "8dd543171a6313c5ab2793d91d12086e"
server_key_iv: "567baabfd040ed5c32ea3c0f3aadfa93"
server_key_version: "encryptionkey@0"
I20260809 13:07:05.428193 22242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:07:05.452661 22242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:07:05.458012 22242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:07:05.458371 22242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:07:05.479638 22242 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:41979
I20260809 13:07:05.479641 22332 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:41979 every 8 connection(s)
I20260809 13:07:05.481494 22242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:07:05.489794 22335 sys_catalog.cc:263] Verifying existing consensus state
I20260809 13:07:05.490324 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 22242
I20260809 13:07:05.491256 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:42839
--local_ip_for_outbound_sockets=127.28.155.193
--tserver_master_addrs=127.28.155.254:41979
--webserver_port=39083
--webserver_interface=127.28.155.193
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:34587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 13:07:05.493853 22335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf: Bootstrap starting.
I20260809 13:07:05.516463 22335 log.cc:824] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf: Log is configured to *not* fsync() on all Append() calls
I20260809 13:07:05.529548 22335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 13:07:05.530162 22335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf: Bootstrap complete.
I20260809 13:07:05.540261 22335 raft_consensus.cc:348] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c799bc54783c4ae6b655d1a28f08a4bf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 41979 } }
I20260809 13:07:05.541244 22335 raft_consensus.cc:729] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c799bc54783c4ae6b655d1a28f08a4bf, State: Initialized, Role: FOLLOWER
I20260809 13:07:05.541947 22335 consensus_queue.cc:260] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c799bc54783c4ae6b655d1a28f08a4bf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 41979 } }
I20260809 13:07:05.542227 22335 raft_consensus.cc:388] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:07:05.542378 22335 raft_consensus.cc:482] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:07:05.542586 22335 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [term 1 FOLLOWER]: Advancing to term 2
I20260809 13:07:05.546706 22335 raft_consensus.cc:504] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c799bc54783c4ae6b655d1a28f08a4bf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 41979 } }
I20260809 13:07:05.547297 22335 leader_election.cc:302] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c799bc54783c4ae6b655d1a28f08a4bf; no voters:
I20260809 13:07:05.548043 22335 leader_election.cc:288] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 13:07:05.548195 22341 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [term 2 FOLLOWER]: Leader election won for term 2
I20260809 13:07:05.549463 22341 raft_consensus.cc:686] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [term 2 LEADER]: Becoming Leader. State: Replica: c799bc54783c4ae6b655d1a28f08a4bf, State: Running, Role: LEADER
I20260809 13:07:05.550073 22341 consensus_queue.cc:237] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c799bc54783c4ae6b655d1a28f08a4bf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 41979 } }
I20260809 13:07:05.550635 22335 sys_catalog.cc:564] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:07:05.553040 22343 sys_catalog.cc:455] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader c799bc54783c4ae6b655d1a28f08a4bf. Latest consensus state: current_term: 2 leader_uuid: "c799bc54783c4ae6b655d1a28f08a4bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c799bc54783c4ae6b655d1a28f08a4bf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 41979 } } }
I20260809 13:07:05.553423 22343 sys_catalog.cc:458] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [sys.catalog]: This master's current role is: LEADER
I20260809 13:07:05.553946 22342 sys_catalog.cc:455] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c799bc54783c4ae6b655d1a28f08a4bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c799bc54783c4ae6b655d1a28f08a4bf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 41979 } } }
I20260809 13:07:05.554358 22342 sys_catalog.cc:458] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [sys.catalog]: This master's current role is: LEADER
I20260809 13:07:05.565557 22347 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:07:05.574651 22347 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:07:05.576172 22347 catalog_manager.cc:1259] Loaded cluster ID: 49058844f6cd4c12a08cee075201d50d
I20260809 13:07:05.576282 22347 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:07:05.580536 22347 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:07:05.582181 22347 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf: Loaded TSK: 0
I20260809 13:07:05.627337 22347 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf: Generated new TSK 1
I20260809 13:07:05.627915 22347 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 13:07:05.912055 22338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:07:05.912377 22338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:07:05.912565 22338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:07:05.920167 22338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:07:05.920286 22338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:07:05.920514 22338 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:07:05.931077 22338 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:34587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:42839
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=39083
--tserver_master_addrs=127.28.155.254:41979
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:07:05.932641 22338 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:07:05.934149 22338 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:07:05.949983 22373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:05.950057 22375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:05.950099 22372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:07:05.951159 22338 server_base.cc:1034] running on GCE node
I20260809 13:07:05.951941 22338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:07:05.953150 22338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:07:05.954399 22338 hybrid_clock.cc:648] HybridClock initialized: now 1786280825954340 us; error 55 us; skew 500 ppm
I20260809 13:07:05.954771 22338 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:07:05 dist-test-slave-jq4t krb5kdc[21457](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280825, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:07:05.958416 22338 init.cc:377] Logged in from keytab as kudu/127.28.155.193@KRBTEST.COM (short username kudu)
I20260809 13:07:05.960180 22338 webserver.cc:460] Webserver started at http://127.28.155.193:39083/ using document root <none> and password file <none>
I20260809 13:07:05.961037 22338 fs_manager.cc:359] Metadata directory not provided
I20260809 13:07:05.961210 22338 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:07:05.967940 22338 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 13:07:05.971174 22384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:05.972729 22338 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 13:07:05.972934 22338 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "32431bad486442a1957c9dbaa6768419"
format_stamp: "Formatted at 2026-08-09 13:06:42 on dist-test-slave-jq4t"
server_key: "a7d222713ac126e6a00e5bc9e894a855"
server_key_iv: "3161193cdd1e469ffe00d5eb21cbdf97"
server_key_version: "encryptionkey@0"
I20260809 13:07:05.974012 22338 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:07:05.990753 22338 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:07:05.995247 22338 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:07:05.995591 22338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:07:05.996785 22338 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:07:05.998284 22338 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:07:05.998420 22338 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:05.998574 22338 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:07:05.998677 22338 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:06.034662 22338 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:42839
I20260809 13:07:06.034762 22534 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:42839 every 8 connection(s)
I20260809 13:07:06.036263 22338 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:07:06.037173 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 22338
I20260809 13:07:06.037992 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:35147
--local_ip_for_outbound_sockets=127.28.155.194
--tserver_master_addrs=127.28.155.254:41979
--webserver_port=43511
--webserver_interface=127.28.155.194
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:34587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 13:07:06 dist-test-slave-jq4t krb5kdc[21457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280825, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:07:06.063613 22537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:06.039983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:36807 (local address 127.28.155.254:41979)
0809 13:07:06.040685 (+ 702us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:06.040703 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:06.041422 (+ 719us) server_negotiation.cc:407] Connection header received
0809 13:07:06.043641 (+ 2219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:06.043663 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:06.044115 (+ 452us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:06.044564 (+ 449us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:06.046053 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:06.048061 (+ 2008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:06.049826 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:06.050917 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:06.051194 (+ 277us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:06.055017 (+ 3823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:06.055025 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:06.055039 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:07:06.055078 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:06.058130 (+ 3052us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:06.059212 (+ 1082us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:06.059224 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:06.059234 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:06.059481 (+ 247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:06.060114 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:06.060119 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:06.060122 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:06.060889 (+ 767us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:06.061121 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:06.062202 (+ 1081us) server_negotiation.cc:299] Negotiation successful
0809 13:07:06.062598 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":277,"threads_started":1}
I20260809 13:07:06.064653 22539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:06.040266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.193:36807)
0809 13:07:06.041228 (+ 962us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:06.041275 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:06.043058 (+ 1783us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:06.044704 (+ 1646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:06.044712 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:06.045250 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:07:06.045791 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:06.045808 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:06.048349 (+ 2541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:06.048353 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:06.049669 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:06.049683 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:06.051209 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:06.051218 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:06.051519 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:06.052319 (+ 800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:07:06.052342 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:07:06.054706 (+ 2364us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:07:06.058292 (+ 3586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:07:06.058301 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:07:06.058316 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:07:06.059013 (+ 697us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:07:06.059656 (+ 643us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:07:06.059663 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:07:06.059670 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:07:06.059935 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:07:06.061047 (+ 1112us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:07:06.061058 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:07:06.061563 (+ 505us) client_negotiation.cc:769] Sending connection context
0809 13:07:06.061910 (+ 347us) client_negotiation.cc:240] Negotiation successful
0809 13:07:06.062618 (+ 708us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":652,"thread_start_us":421,"threads_started":1}
I20260809 13:07:06.067619 22535 heartbeater.cc:347] Connected to a master server at 127.28.155.254:41979
I20260809 13:07:06.067951 22535 heartbeater.cc:464] Registering TS with master...
I20260809 13:07:06.068854 22535 heartbeater.cc:511] Master 127.28.155.254:41979 requested a full tablet report, sending...
I20260809 13:07:06.071154 22287 ts_manager.cc:194] Registered new tserver with Master: 32431bad486442a1957c9dbaa6768419 (127.28.155.193:42839)
I20260809 13:07:06.072749 22287 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.193@KRBTEST.COM'} at 127.28.155.193:36807
W20260809 13:07:06.408593 22540 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:07:06.408952 22540 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:07:06.409111 22540 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:07:06.416942 22540 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:07:06.417084 22540 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:07:06.417279 22540 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:07:06.427657 22540 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:34587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:35147
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=43511
--tserver_master_addrs=127.28.155.254:41979
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:07:06.429179 22540 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:07:06.430644 22540 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:07:06.444777 22550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:06.445094 22547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:06.444801 22552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:07:06.446432 22540 server_base.cc:1034] running on GCE node
I20260809 13:07:06.447142 22540 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:07:06.448235 22540 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:07:06.449478 22540 hybrid_clock.cc:648] HybridClock initialized: now 1786280826449426 us; error 47 us; skew 500 ppm
I20260809 13:07:06.449823 22540 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:07:06 dist-test-slave-jq4t krb5kdc[21457](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280826, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:07:06.453267 22540 init.cc:377] Logged in from keytab as kudu/127.28.155.194@KRBTEST.COM (short username kudu)
I20260809 13:07:06.454995 22540 webserver.cc:460] Webserver started at http://127.28.155.194:43511/ using document root <none> and password file <none>
I20260809 13:07:06.455757 22540 fs_manager.cc:359] Metadata directory not provided
I20260809 13:07:06.455935 22540 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:07:06.461853 22540 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 13:07:06.465169 22563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:06.466583 22540 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 13:07:06.466777 22540 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "a1e962f4526b469ca869b7a1f39b1417"
format_stamp: "Formatted at 2026-08-09 13:06:43 on dist-test-slave-jq4t"
server_key: "9eba38b9a8f026cc275e94993e44f540"
server_key_iv: "3ca5f7dfc8df45729e4a779d4e603302"
server_key_version: "encryptionkey@0"
I20260809 13:07:06.467939 22540 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:07:06.483454 22540 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:07:06.488557 22540 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:07:06.488868 22540 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:07:06.490057 22540 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:07:06.491603 22540 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:07:06.491734 22540 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:06.491875 22540 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:07:06.491976 22540 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:06.528970 22540 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:35147
I20260809 13:07:06.529019 22708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:35147 every 8 connection(s)
I20260809 13:07:06.530551 22540 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:07:06.536553 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 22540
I20260809 13:07:06.537401 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:36419
--local_ip_for_outbound_sockets=127.28.155.195
--tserver_master_addrs=127.28.155.254:41979
--webserver_port=43387
--webserver_interface=127.28.155.195
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:34587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 13:07:06 dist-test-slave-jq4t krb5kdc[21457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280826, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:07:06.555545 22537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:06.533596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:44319 (local address 127.28.155.254:41979)
0809 13:07:06.533827 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:06.533833 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:06.535037 (+ 1204us) server_negotiation.cc:407] Connection header received
0809 13:07:06.537509 (+ 2472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:06.537536 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:06.537694 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:06.537788 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:06.540161 (+ 2373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:06.540979 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:06.543593 (+ 2614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:06.544108 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:06.544223 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:06.549200 (+ 4977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:06.549205 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:06.549208 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:07:06.549245 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:06.552201 (+ 2956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:06.553044 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:06.553051 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:06.553056 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:06.553188 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:06.553674 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:06.553678 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:06.553681 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:06.553974 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:06.554150 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:06.554918 (+ 768us) server_negotiation.cc:299] Negotiation successful
0809 13:07:06.555192 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 13:07:06.556689 22712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:06.534116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.194:44319)
0809 13:07:06.534857 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:06.534905 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:06.537142 (+ 2237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:06.538136 (+ 994us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:06.538150 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:06.539031 (+ 881us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:07:06.539955 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:06.539984 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:06.541156 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:06.541164 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:06.543409 (+ 2245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:06.543429 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:06.544367 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:06.544377 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:06.544744 (+ 367us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:06.545630 (+ 886us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:07:06.545667 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:07:06.548923 (+ 3256us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:07:06.552356 (+ 3433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:07:06.552372 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:07:06.552385 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:07:06.552909 (+ 524us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:07:06.553313 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:07:06.553318 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:07:06.553323 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:07:06.553531 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:07:06.554126 (+ 595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:07:06.554134 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:07:06.554513 (+ 379us) client_negotiation.cc:769] Sending connection context
0809 13:07:06.554802 (+ 289us) client_negotiation.cc:240] Negotiation successful
0809 13:07:06.555399 (+ 597us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":292,"threads_started":1}
I20260809 13:07:06.558395 22710 heartbeater.cc:347] Connected to a master server at 127.28.155.254:41979
I20260809 13:07:06.558740 22710 heartbeater.cc:464] Registering TS with master...
I20260809 13:07:06.559542 22710 heartbeater.cc:511] Master 127.28.155.254:41979 requested a full tablet report, sending...
I20260809 13:07:06.561206 22287 ts_manager.cc:194] Registered new tserver with Master: a1e962f4526b469ca869b7a1f39b1417 (127.28.155.194:35147)
I20260809 13:07:06.562075 22287 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.194@KRBTEST.COM'} at 127.28.155.194:44319
W20260809 13:07:06.904511 22713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:07:06.904866 22713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:07:06.905053 22713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:07:06.913048 22713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:07:06.913232 22713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:07:06.913419 22713 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:07:06.924088 22713 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:34587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:36419
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=43387
--tserver_master_addrs=127.28.155.254:41979
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:07:06.925637 22713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:07:06.927063 22713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:07:06.941521 22720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:06.941555 22726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:06.941424 22723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:07:06.942509 22713 server_base.cc:1034] running on GCE node
I20260809 13:07:06.943243 22713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:07:06.944255 22713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:07:06.945535 22713 hybrid_clock.cc:648] HybridClock initialized: now 1786280826945466 us; error 66 us; skew 500 ppm
I20260809 13:07:06.945948 22713 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:07:06 dist-test-slave-jq4t krb5kdc[21457](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280826, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:07:06.949431 22713 init.cc:377] Logged in from keytab as kudu/127.28.155.195@KRBTEST.COM (short username kudu)
I20260809 13:07:06.951166 22713 webserver.cc:460] Webserver started at http://127.28.155.195:43387/ using document root <none> and password file <none>
I20260809 13:07:06.952076 22713 fs_manager.cc:359] Metadata directory not provided
I20260809 13:07:06.952251 22713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:07:06.958482 22713 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.004s
I20260809 13:07:06.961503 22737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:06.963024 22713 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 13:07:06.963251 22713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "068b996951764080a3ba7a22c4c37878"
format_stamp: "Formatted at 2026-08-09 13:06:43 on dist-test-slave-jq4t"
server_key: "5fff6486a033b52506a8d3a2d083bdc8"
server_key_iv: "c722ecba876d7e0bad7db53fb5e458dd"
server_key_version: "encryptionkey@0"
I20260809 13:07:06.964406 22713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:07:06.979169 22713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:07:06.983587 22713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:07:06.983911 22713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:07:06.985036 22713 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:07:06.986464 22713 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:07:06.986603 22713 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:06.986735 22713 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:07:06.986828 22713 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:07.022538 22713 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:36419
I20260809 13:07:07.022636 22894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:36419 every 8 connection(s)
I20260809 13:07:07.024113 22713 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:07:07.025199 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 22713
I20260809 13:07:07.045894 22537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:07.026389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51330 (local address 127.28.155.254:41979)
0809 13:07:07.026642 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:07.026652 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:07.027133 (+ 481us) server_negotiation.cc:407] Connection header received
0809 13:07:07.027377 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:07.027386 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:07.027497 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:07.027641 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:07.030275 (+ 2634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.031874 (+ 1599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.033765 (+ 1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.034432 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.034586 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:07.038490 (+ 3904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:07.038497 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:07.038502 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:07:07.038543 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:07.042529 (+ 3986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:07.043456 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:07.043460 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:07.043463 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:07.043632 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:07.044140 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:07.044145 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:07.044148 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:07.044594 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:07.044902 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:07.045276 (+ 374us) server_negotiation.cc:299] Negotiation successful
0809 13:07:07.045528 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
Aug 09 13:07:07 dist-test-slave-jq4t krb5kdc[21457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280826, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:07:07.054821 22899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:07.027133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:54675 (local address 127.28.155.254:41979)
0809 13:07:07.034203 (+ 7070us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:07.034209 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:07.034232 (+ 23us) server_negotiation.cc:407] Connection header received
0809 13:07:07.036971 (+ 2739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:07.036976 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:07.037086 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:07.037209 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:07.039083 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.040334 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.042907 (+ 2573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.043597 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.043703 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:07.048287 (+ 4584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:07.048293 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:07.048296 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:07:07.048331 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:07.051410 (+ 3079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:07.052394 (+ 984us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:07.052399 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:07.052402 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:07.052618 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:07.053103 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:07.053107 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:07.053109 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:07.053415 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:07.053539 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:07.054314 (+ 775us) server_negotiation.cc:299] Negotiation successful
0809 13:07:07.054516 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6949,"thread_start_us":6809,"threads_started":1}
I20260809 13:07:07.055902 22901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:07.027782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.195:54675)
0809 13:07:07.033030 (+ 5248us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:07.033096 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:07.036681 (+ 3585us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:07.037489 (+ 808us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:07.037498 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:07.038062 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:07:07.038841 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:07.038881 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.040569 (+ 1688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.040574 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:07.042747 (+ 2173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:07.042760 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.043882 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.043888 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:07.044166 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:07.044957 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:07:07.044993 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:07:07.048026 (+ 3033us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:07:07.051590 (+ 3564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:07:07.051599 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:07:07.051615 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:07:07.052241 (+ 626us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:07:07.052728 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:07:07.052732 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:07:07.052734 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:07:07.052941 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:07:07.053534 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:07:07.053540 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:07:07.053916 (+ 376us) client_negotiation.cc:769] Sending connection context
0809 13:07:07.054195 (+ 279us) client_negotiation.cc:240] Negotiation successful
0809 13:07:07.054639 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4805,"thread_start_us":3966,"threads_started":1}
I20260809 13:07:07.057425 22895 heartbeater.cc:347] Connected to a master server at 127.28.155.254:41979
I20260809 13:07:07.057781 22895 heartbeater.cc:464] Registering TS with master...
I20260809 13:07:07.058590 22895 heartbeater.cc:511] Master 127.28.155.254:41979 requested a full tablet report, sending...
I20260809 13:07:07.060441 22285 ts_manager.cc:194] Registered new tserver with Master: 068b996951764080a3ba7a22c4c37878 (127.28.155.195:36419)
I20260809 13:07:07.061630 29295 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 13:07:07.061679 22285 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.195@KRBTEST.COM'} at 127.28.155.195:54675
I20260809 13:07:07.070325 22899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:07.063488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51346 (local address 127.28.155.254:41979)
0809 13:07:07.063674 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:07.063681 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:07.063700 (+ 19us) server_negotiation.cc:407] Connection header received
0809 13:07:07.063914 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:07.063921 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:07.064143 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:07.064314 (+ 171us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:07:07.065405 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.066348 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.068076 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.068601 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.068747 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:07.069320 (+ 573us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:07:07.069608 (+ 288us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0809 13:07:07.070031 (+ 423us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51346: token expired
Metrics: {"server-negotiator.queue_time_us":61}
W20260809 13:07:07.070482 22899 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51346: token expired
W20260809 13:07:07.071055 22175 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.28.155.254:41979)
I20260809 13:07:07.076043 22535 heartbeater.cc:503] Master 127.28.155.254:41979 was elected leader, sending a full tablet report...
I20260809 13:07:07.085034 22899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:07.071649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51348 (local address 127.28.155.254:41979)
0809 13:07:07.071884 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:07.071888 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:07.071908 (+ 20us) server_negotiation.cc:407] Connection header received
0809 13:07:07.072072 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:07.072075 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:07.072132 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:07.072209 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:07.073916 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.074630 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.076234 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.076800 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.076942 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:07.079952 (+ 3010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:07.079957 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:07.079961 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:07:07.079994 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:07.082579 (+ 2585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:07.083262 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:07.083266 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:07.083269 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:07.083396 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:07.083727 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:07.083730 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:07.083732 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:07.084055 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:07.084257 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:07.084588 (+ 331us) server_negotiation.cc:299] Negotiation successful
0809 13:07:07.084765 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260809 13:07:07.088781 22285 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51348:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 13:07:07.096300 22285 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:07:07.143281 22912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:07.109803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:42839 (local address 127.0.0.1:37628)
0809 13:07:07.133209 (+ 23406us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:07.133228 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:07.133347 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:07.135577 (+ 2230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:07.135584 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:07.135620 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:07:07.136078 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:07.136092 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.138344 (+ 2252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.138351 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:07.140650 (+ 2299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:07.140668 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.142185 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.142194 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:07.142368 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:07.142458 (+ 90us) client_negotiation.cc:769] Sending connection context
0809 13:07:07.142573 (+ 115us) client_negotiation.cc:240] Negotiation successful
0809 13:07:07.142777 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23270,"mutex_wait_us":36,"thread_start_us":23117,"threads_started":1}
I20260809 13:07:07.143836 22914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:07.109540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:35147 (local address 127.0.0.1:40596)
0809 13:07:07.131201 (+ 21661us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:07.131276 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:07.132403 (+ 1127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:07.134791 (+ 2388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:07.134801 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:07.134840 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:07:07.135398 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:07.135416 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.137866 (+ 2450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.137874 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:07.140665 (+ 2791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:07.140681 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.142952 (+ 2271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.142960 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:07.143162 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:07.143196 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 13:07:07.143274 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 13:07:07.143412 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21248,"mutex_wait_us":34,"thread_start_us":24693,"threads_started":1}
I20260809 13:07:07.144243 22915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:07.110615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37628 (local address 127.28.155.193:42839)
0809 13:07:07.134518 (+ 23903us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:07.134525 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:07.134551 (+ 26us) server_negotiation.cc:407] Connection header received
0809 13:07:07.134699 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:07.134708 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:07.134939 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:07.135173 (+ 234us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:07:07.136343 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.138144 (+ 1801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.140830 (+ 2686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.141839 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.143369 (+ 1530us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:07.143585 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:07.143656 (+ 71us) server_negotiation.cc:299] Negotiation successful
0809 13:07:07.143850 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23700,"thread_start_us":24762,"threads_started":1}
I20260809 13:07:07.145047 22910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:07.110072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:36419 (local address 127.0.0.1:48210)
0809 13:07:07.135886 (+ 25814us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:07.135912 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:07.136156 (+ 244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:07.137166 (+ 1010us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:07.137171 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:07.137197 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:07:07.137576 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:07.137586 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.139668 (+ 2082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.139673 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:07.141927 (+ 2254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:07.141943 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.144196 (+ 2253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.144203 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:07.144368 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:07.144399 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 13:07:07.144595 (+ 196us) client_negotiation.cc:240] Negotiation successful
0809 13:07:07.144724 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25644,"thread_start_us":21472,"threads_started":1}
I20260809 13:07:07.145370 22916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:07.110738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48210 (local address 127.28.155.195:36419)
0809 13:07:07.130518 (+ 19780us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:07.130533 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:07.136028 (+ 5495us) server_negotiation.cc:407] Connection header received
0809 13:07:07.136360 (+ 332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:07.136369 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:07.136645 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:07.136804 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:07:07.137792 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.139472 (+ 1680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.142128 (+ 2656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.143605 (+ 1477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.143776 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:07.143979 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:07.144683 (+ 704us) server_negotiation.cc:299] Negotiation successful
0809 13:07:07.144862 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19548,"thread_start_us":19352,"threads_started":1}
I20260809 13:07:07.145884 22911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:07.109741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40596 (local address 127.28.155.194:35147)
0809 13:07:07.133973 (+ 24232us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:07.133983 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:07.134014 (+ 31us) server_negotiation.cc:407] Connection header received
0809 13:07:07.134135 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:07.134145 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:07.134453 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:07.135720 (+ 1267us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:07:07.135998 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.137703 (+ 1705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.140877 (+ 3174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.142680 (+ 1803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.144644 (+ 1964us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:07.145266 (+ 622us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:07.145341 (+ 75us) server_negotiation.cc:299] Negotiation successful
0809 13:07:07.145530 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24030,"thread_start_us":23907,"threads_started":1}
I20260809 13:07:07.148933 22800 tablet_service.cc:1467] Processing CreateTablet for tablet 82c024c9864744c081460d98dc58e0fd (DEFAULT_TABLE table=test-table [id=ea23ef96e10c483195da558d9872f203]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:07:07.148962 22447 tablet_service.cc:1467] Processing CreateTablet for tablet 82c024c9864744c081460d98dc58e0fd (DEFAULT_TABLE table=test-table [id=ea23ef96e10c483195da558d9872f203]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:07:07.149327 22621 tablet_service.cc:1467] Processing CreateTablet for tablet 82c024c9864744c081460d98dc58e0fd (DEFAULT_TABLE table=test-table [id=ea23ef96e10c483195da558d9872f203]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:07:07.150355 22800 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82c024c9864744c081460d98dc58e0fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:07:07.150524 22621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82c024c9864744c081460d98dc58e0fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:07:07.150513 22447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82c024c9864744c081460d98dc58e0fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:07:07.164671 22917 tablet_bootstrap.cc:492] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878: Bootstrap starting.
I20260809 13:07:07.168654 22917 tablet_bootstrap.cc:654] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878: Neither blocks nor log segments found. Creating new log.
I20260809 13:07:07.170070 22917 log.cc:824] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878: Log is configured to *not* fsync() on all Append() calls
I20260809 13:07:07.172341 22918 tablet_bootstrap.cc:492] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419: Bootstrap starting.
I20260809 13:07:07.174603 22917 tablet_bootstrap.cc:492] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878: No bootstrap required, opened a new log
I20260809 13:07:07.172757 22920 tablet_bootstrap.cc:492] T 82c024c9864744c081460d98dc58e0fd P a1e962f4526b469ca869b7a1f39b1417: Bootstrap starting.
I20260809 13:07:07.174916 22917 ts_tablet_manager.cc:1397] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.005s
I20260809 13:07:07.176599 22918 tablet_bootstrap.cc:654] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419: Neither blocks nor log segments found. Creating new log.
I20260809 13:07:07.177943 22918 log.cc:824] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419: Log is configured to *not* fsync() on all Append() calls
I20260809 13:07:07.178485 22920 tablet_bootstrap.cc:654] T 82c024c9864744c081460d98dc58e0fd P a1e962f4526b469ca869b7a1f39b1417: Neither blocks nor log segments found. Creating new log.
I20260809 13:07:07.180317 22920 log.cc:824] T 82c024c9864744c081460d98dc58e0fd P a1e962f4526b469ca869b7a1f39b1417: Log is configured to *not* fsync() on all Append() calls
I20260809 13:07:07.181983 22918 tablet_bootstrap.cc:492] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419: No bootstrap required, opened a new log
I20260809 13:07:07.182345 22918 ts_tablet_manager.cc:1397] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.006s
I20260809 13:07:07.184092 22920 tablet_bootstrap.cc:492] T 82c024c9864744c081460d98dc58e0fd P a1e962f4526b469ca869b7a1f39b1417: No bootstrap required, opened a new log
I20260809 13:07:07.184396 22920 ts_tablet_manager.cc:1397] T 82c024c9864744c081460d98dc58e0fd P a1e962f4526b469ca869b7a1f39b1417: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.000s
I20260809 13:07:07.185022 22917 raft_consensus.cc:348] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e962f4526b469ca869b7a1f39b1417" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35147 } } peers { permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 } } peers { permanent_uuid: "068b996951764080a3ba7a22c4c37878" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36419 } }
I20260809 13:07:07.185459 22917 raft_consensus.cc:374] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:07:07.185609 22917 raft_consensus.cc:729] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 068b996951764080a3ba7a22c4c37878, State: Initialized, Role: FOLLOWER
I20260809 13:07:07.186328 22917 consensus_queue.cc:260] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e962f4526b469ca869b7a1f39b1417" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35147 } } peers { permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 } } peers { permanent_uuid: "068b996951764080a3ba7a22c4c37878" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36419 } }
I20260809 13:07:07.187673 22895 heartbeater.cc:503] Master 127.28.155.254:41979 was elected leader, sending a full tablet report...
I20260809 13:07:07.188405 22917 ts_tablet_manager.cc:1428] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260809 13:07:07.188644 22925 raft_consensus.cc:482] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:07:07.189026 22925 raft_consensus.cc:504] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e962f4526b469ca869b7a1f39b1417" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35147 } } peers { permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 } } peers { permanent_uuid: "068b996951764080a3ba7a22c4c37878" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36419 } }
I20260809 13:07:07.196868 22925 leader_election.cc:288] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1e962f4526b469ca869b7a1f39b1417 (127.28.155.194:35147), 32431bad486442a1957c9dbaa6768419 (127.28.155.193:42839)
I20260809 13:07:07.197140 22918 raft_consensus.cc:348] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e962f4526b469ca869b7a1f39b1417" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35147 } } peers { permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 } } peers { permanent_uuid: "068b996951764080a3ba7a22c4c37878" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36419 } }
I20260809 13:07:07.197839 22918 raft_consensus.cc:374] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:07:07.198043 22918 raft_consensus.cc:729] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32431bad486442a1957c9dbaa6768419, State: Initialized, Role: FOLLOWER
I20260809 13:07:07.199013 22918 consensus_queue.cc:260] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e962f4526b469ca869b7a1f39b1417" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35147 } } peers { permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 } } peers { permanent_uuid: "068b996951764080a3ba7a22c4c37878" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36419 } }
I20260809 13:07:07.199355 22901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:07.191439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:35147 (local address 127.28.155.195:37575)
0809 13:07:07.191670 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:07.191693 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:07.191812 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:07.192647 (+ 835us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:07.192652 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:07.192679 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:07:07.192887 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:07.192902 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.194536 (+ 1634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.194541 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:07.196674 (+ 2133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:07.196695 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.198575 (+ 1880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.198581 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:07.198791 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:07.198829 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 13:07:07.198923 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 13:07:07.199068 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 13:07:07.199999 22911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:07.191396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:37575 (local address 127.28.155.194:35147)
0809 13:07:07.192310 (+ 914us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:07.192316 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:07.192336 (+ 20us) server_negotiation.cc:407] Connection header received
0809 13:07:07.192411 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:07.192416 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:07.192513 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:07.192616 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:07:07.193265 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.194354 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.196889 (+ 2535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.198229 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.198378 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:07.198477 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:07.199579 (+ 1102us) server_negotiation.cc:299] Negotiation successful
0809 13:07:07.199733 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":751}
I20260809 13:07:07.201228 22920 raft_consensus.cc:348] T 82c024c9864744c081460d98dc58e0fd P a1e962f4526b469ca869b7a1f39b1417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e962f4526b469ca869b7a1f39b1417" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35147 } } peers { permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 } } peers { permanent_uuid: "068b996951764080a3ba7a22c4c37878" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36419 } }
I20260809 13:07:07.201785 22920 raft_consensus.cc:374] T 82c024c9864744c081460d98dc58e0fd P a1e962f4526b469ca869b7a1f39b1417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:07:07.201622 22650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c024c9864744c081460d98dc58e0fd" candidate_uuid: "068b996951764080a3ba7a22c4c37878" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1e962f4526b469ca869b7a1f39b1417" is_pre_election: true
I20260809 13:07:07.201925 22920 raft_consensus.cc:729] T 82c024c9864744c081460d98dc58e0fd P a1e962f4526b469ca869b7a1f39b1417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1e962f4526b469ca869b7a1f39b1417, State: Initialized, Role: FOLLOWER
I20260809 13:07:07.202612 22920 consensus_queue.cc:260] T 82c024c9864744c081460d98dc58e0fd P a1e962f4526b469ca869b7a1f39b1417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e962f4526b469ca869b7a1f39b1417" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35147 } } peers { permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 } } peers { permanent_uuid: "068b996951764080a3ba7a22c4c37878" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36419 } }
I20260809 13:07:07.203228 22650 raft_consensus.cc:2454] T 82c024c9864744c081460d98dc58e0fd P a1e962f4526b469ca869b7a1f39b1417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068b996951764080a3ba7a22c4c37878 in term 0.
I20260809 13:07:07.204286 22918 ts_tablet_manager.cc:1428] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419: Time spent starting tablet: real 0.022s user 0.020s sys 0.000s
I20260809 13:07:07.205506 22738 leader_election.cc:302] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068b996951764080a3ba7a22c4c37878, a1e962f4526b469ca869b7a1f39b1417; no voters:
I20260809 13:07:07.206425 22915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:07.192722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:46707 (local address 127.28.155.193:42839)
0809 13:07:07.192958 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:07.192968 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:07.197057 (+ 4089us) server_negotiation.cc:407] Connection header received
0809 13:07:07.197331 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:07.197338 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:07.197438 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:07.197548 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:07:07.198849 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.200192 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.203552 (+ 3360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.205051 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.205200 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:07.205275 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:07.205977 (+ 702us) server_negotiation.cc:299] Negotiation successful
0809 13:07:07.206133 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 13:07:07.206399 22925 raft_consensus.cc:2781] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:07:07.206604 22925 raft_consensus.cc:482] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:07:07.206769 22925 raft_consensus.cc:3037] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:07:07.207504 22926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:07.192117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:42839 (local address 127.28.155.195:46707)
0809 13:07:07.196947 (+ 4830us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:07.196976 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:07.197159 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:07.197736 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:07.197741 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:07.197770 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:07:07.198224 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:07.198239 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.200466 (+ 2227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.200473 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:07.203332 (+ 2859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:07.203361 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.205525 (+ 2164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.205535 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:07.205756 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:07.205791 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 13:07:07.206849 (+ 1058us) client_negotiation.cc:240] Negotiation successful
0809 13:07:07.207009 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4666,"thread_start_us":4443,"threads_started":1}
I20260809 13:07:07.208951 22471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c024c9864744c081460d98dc58e0fd" candidate_uuid: "068b996951764080a3ba7a22c4c37878" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32431bad486442a1957c9dbaa6768419" is_pre_election: true
I20260809 13:07:07.209378 22710 heartbeater.cc:503] Master 127.28.155.254:41979 was elected leader, sending a full tablet report...
I20260809 13:07:07.209543 22471 raft_consensus.cc:2454] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068b996951764080a3ba7a22c4c37878 in term 0.
I20260809 13:07:07.210543 22925 raft_consensus.cc:504] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e962f4526b469ca869b7a1f39b1417" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35147 } } peers { permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 } } peers { permanent_uuid: "068b996951764080a3ba7a22c4c37878" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36419 } }
I20260809 13:07:07.211807 22925 leader_election.cc:288] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878 [CANDIDATE]: Term 1 election: Requested vote from peers a1e962f4526b469ca869b7a1f39b1417 (127.28.155.194:35147), 32431bad486442a1957c9dbaa6768419 (127.28.155.193:42839)
I20260809 13:07:07.212215 22650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c024c9864744c081460d98dc58e0fd" candidate_uuid: "068b996951764080a3ba7a22c4c37878" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1e962f4526b469ca869b7a1f39b1417"
I20260809 13:07:07.212316 22471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c024c9864744c081460d98dc58e0fd" candidate_uuid: "068b996951764080a3ba7a22c4c37878" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32431bad486442a1957c9dbaa6768419"
I20260809 13:07:07.212500 22650 raft_consensus.cc:3037] T 82c024c9864744c081460d98dc58e0fd P a1e962f4526b469ca869b7a1f39b1417 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:07:07.212548 22471 raft_consensus.cc:3037] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:07:07.213117 22920 ts_tablet_manager.cc:1428] T 82c024c9864744c081460d98dc58e0fd P a1e962f4526b469ca869b7a1f39b1417: Time spent starting tablet: real 0.029s user 0.015s sys 0.004s
I20260809 13:07:07.216027 22471 raft_consensus.cc:2454] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068b996951764080a3ba7a22c4c37878 in term 1.
I20260809 13:07:07.216027 22650 raft_consensus.cc:2454] T 82c024c9864744c081460d98dc58e0fd P a1e962f4526b469ca869b7a1f39b1417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068b996951764080a3ba7a22c4c37878 in term 1.
I20260809 13:07:07.216574 22738 leader_election.cc:302] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 068b996951764080a3ba7a22c4c37878, a1e962f4526b469ca869b7a1f39b1417; no voters:
I20260809 13:07:07.216993 22925 raft_consensus.cc:2781] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:07:07.217598 22925 raft_consensus.cc:686] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878 [term 1 LEADER]: Becoming Leader. State: Replica: 068b996951764080a3ba7a22c4c37878, State: Running, Role: LEADER
I20260809 13:07:07.218168 22925 consensus_queue.cc:237] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e962f4526b469ca869b7a1f39b1417" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35147 } } peers { permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 } } peers { permanent_uuid: "068b996951764080a3ba7a22c4c37878" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36419 } }
I20260809 13:07:07.222916 22287 catalog_manager.cc:5495] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878 reported cstate change: term changed from 0 to 1, leader changed from <none> to 068b996951764080a3ba7a22c4c37878 (127.28.155.195). New cstate: current_term: 1 leader_uuid: "068b996951764080a3ba7a22c4c37878" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e962f4526b469ca869b7a1f39b1417" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "068b996951764080a3ba7a22c4c37878" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36419 } health_report { overall_health: HEALTHY } } }
I20260809 13:07:07.239457 22916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:07.234184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48218 (local address 127.28.155.195:36419)
0809 13:07:07.234375 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:07.234380 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:07.234575 (+ 195us) server_negotiation.cc:407] Connection header received
0809 13:07:07.234753 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:07.234757 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:07.234838 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:07.234968 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:07:07.235313 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.236041 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.237456 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.237854 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.237951 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:07.238445 (+ 494us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:07:07.238960 (+ 515us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:07:07.239087 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:07.239178 (+ 91us) server_negotiation.cc:299] Negotiation successful
0809 13:07:07.239247 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 13:07:07.248837 22471 raft_consensus.cc:1261] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [term 1 FOLLOWER]: Refusing update from remote peer 068b996951764080a3ba7a22c4c37878: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:07:07.248837 22650 raft_consensus.cc:1261] T 82c024c9864744c081460d98dc58e0fd P a1e962f4526b469ca869b7a1f39b1417 [term 1 FOLLOWER]: Refusing update from remote peer 068b996951764080a3ba7a22c4c37878: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:07:07.250213 22931 consensus_queue.cc:1035] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1e962f4526b469ca869b7a1f39b1417" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:07:07.250728 22925 consensus_queue.cc:1035] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:07:07.278589 22285 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51348:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:07:07.278903 22285 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51348:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:07:07.283634 22285 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf: Sending DeleteTablet for 3 replicas of tablet 82c024c9864744c081460d98dc58e0fd
I20260809 13:07:07.284927 22621 tablet_service.cc:1514] Processing DeleteTablet for tablet 82c024c9864744c081460d98dc58e0fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:07:07 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:40596
I20260809 13:07:07.285064 22447 tablet_service.cc:1514] Processing DeleteTablet for tablet 82c024c9864744c081460d98dc58e0fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:07:07 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:37628
I20260809 13:07:07.285496 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 22338
I20260809 13:07:07.286079 22800 tablet_service.cc:1514] Processing DeleteTablet for tablet 82c024c9864744c081460d98dc58e0fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:07:07 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:48210
I20260809 13:07:07.298691 22950 tablet_replica.cc:330] T 82c024c9864744c081460d98dc58e0fd P a1e962f4526b469ca869b7a1f39b1417: stopping tablet replica
I20260809 13:07:07.299393 22953 tablet_replica.cc:330] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878: stopping tablet replica
I20260809 13:07:07.300081 22951 tablet_replica.cc:330] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419: stopping tablet replica
I20260809 13:07:07.300420 22950 raft_consensus.cc:2229] T 82c024c9864744c081460d98dc58e0fd P a1e962f4526b469ca869b7a1f39b1417 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:07:07.301017 22953 raft_consensus.cc:2229] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878 [term 1 LEADER]: Raft consensus shutting down.
I20260809 13:07:07.301110 22950 raft_consensus.cc:2258] T 82c024c9864744c081460d98dc58e0fd P a1e962f4526b469ca869b7a1f39b1417 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:07:07.301307 22951 raft_consensus.cc:2229] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:07:07.302116 22953 raft_consensus.cc:2258] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:07:07.302723 22951 raft_consensus.cc:2258] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:07:07.303469 22950 ts_tablet_manager.cc:1905] T 82c024c9864744c081460d98dc58e0fd P a1e962f4526b469ca869b7a1f39b1417: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:07:07.305254 22953 ts_tablet_manager.cc:1905] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:07:07.306866 22951 ts_tablet_manager.cc:1905] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:07:07.309844 22915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:07.287278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37636 (local address 127.28.155.193:42839)
0809 13:07:07.287512 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:07.287521 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:07.287545 (+ 24us) server_negotiation.cc:407] Connection header received
0809 13:07:07.287616 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:07.287625 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:07.287740 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:07.287857 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:07.290313 (+ 2456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.291914 (+ 1601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.294554 (+ 2640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.295484 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.295657 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:07.300128 (+ 4471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:07.300144 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:07.300193 (+ 49us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:07:07.300236 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:07.304879 (+ 4643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:07.305924 (+ 1045us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:07.305933 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:07.305937 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:07.306231 (+ 294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:07.306816 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:07.306858 (+ 42us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:07.306862 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:07.307358 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:07.307698 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:07.309154 (+ 1456us) server_negotiation.cc:299] Negotiation successful
0809 13:07:07.309418 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 13:07:07.310739 22529 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:07:07.310992 22950 ts_tablet_manager.cc:1918] T 82c024c9864744c081460d98dc58e0fd P a1e962f4526b469ca869b7a1f39b1417: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:07:07.311225 22950 log.cc:1196] T 82c024c9864744c081460d98dc58e0fd P a1e962f4526b469ca869b7a1f39b1417: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/wal/wals/82c024c9864744c081460d98dc58e0fd
I20260809 13:07:07.311846 22950 ts_tablet_manager.cc:1939] T 82c024c9864744c081460d98dc58e0fd P a1e962f4526b469ca869b7a1f39b1417: Deleting consensus metadata
I20260809 13:07:07.314124 22262 catalog_manager.cc:4841] TS a1e962f4526b469ca869b7a1f39b1417 (127.28.155.194:35147): tablet 82c024c9864744c081460d98dc58e0fd (table test-table [id=ea23ef96e10c483195da558d9872f203]) successfully deleted
I20260809 13:07:07.318693 22953 ts_tablet_manager.cc:1918] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:07:07.318933 22953 log.cc:1196] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/wal/wals/82c024c9864744c081460d98dc58e0fd
I20260809 13:07:07.319548 22953 ts_tablet_manager.cc:1939] T 82c024c9864744c081460d98dc58e0fd P 068b996951764080a3ba7a22c4c37878: Deleting consensus metadata
I20260809 13:07:07.321545 22268 catalog_manager.cc:4841] TS 068b996951764080a3ba7a22c4c37878 (127.28.155.195:36419): tablet 82c024c9864744c081460d98dc58e0fd (table test-table [id=ea23ef96e10c483195da558d9872f203]) successfully deleted
I20260809 13:07:07.413703 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 22338
W20260809 13:07:07.438295 22265 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.155.193:42839 (error 108)
I20260809 13:07:07.438730 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 22540
I20260809 13:07:07.440692 22910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:07.440135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:42839 (local address 127.0.0.1:37642)
0809 13:07:07.440361 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:07.440522 (+ 161us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:42839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 13:07:07.441035 22265 catalog_manager.cc:4584] TS 32431bad486442a1957c9dbaa6768419 (127.28.155.193:42839): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 82c024c9864744c081460d98dc58e0fd: Network error: Client connection negotiation failed: client connection to 127.28.155.193:42839: connect: Connection refused (error 111)
I20260809 13:07:07.455173 22911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:07.439777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40612 (local address 127.28.155.194:35147)
0809 13:07:07.440007 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:07.440013 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:07.440036 (+ 23us) server_negotiation.cc:407] Connection header received
0809 13:07:07.440924 (+ 888us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:07.440932 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:07.441029 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:07.441160 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:07.442533 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.443326 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.444715 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.445121 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.445267 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:07.448263 (+ 2996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:07.448281 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:07.448298 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:07:07.448334 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:07.451980 (+ 3646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:07.452889 (+ 909us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:07.452901 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:07.452909 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:07.453045 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:07.453464 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:07.453469 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:07.453473 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:07.453898 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:07.454230 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:07.454568 (+ 338us) server_negotiation.cc:299] Negotiation successful
0809 13:07:07.454806 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260809 13:07:07.455907 22702 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:07:07.494882 22910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:07.494327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:42839 (local address 127.0.0.1:37652)
0809 13:07:07.494534 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:07.494647 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:42839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260809 13:07:07.496389 22910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:07.495954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:42839 (local address 127.0.0.1:37658)
0809 13:07:07.496117 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:07.496204 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:42839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260809 13:07:07.557615 22910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:07.557014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:42839 (local address 127.0.0.1:37662)
0809 13:07:07.557279 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:07.557411 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:42839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260809 13:07:07.558976 22910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:07.558507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:42839 (local address 127.0.0.1:37674)
0809 13:07:07.558691 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:07.558794 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:42839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 13:07:07.566341 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 22540
I20260809 13:07:07.601812 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 22713
I20260809 13:07:07.619328 22916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:07.602838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48232 (local address 127.28.155.195:36419)
0809 13:07:07.603018 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:07.603023 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:07.603042 (+ 19us) server_negotiation.cc:407] Connection header received
0809 13:07:07.603107 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:07.603111 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:07.603178 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:07.603265 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:07.605226 (+ 1961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.606087 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.608066 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:07.608706 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:07.608814 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:07.612565 (+ 3751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:07.612595 (+ 30us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:07.612613 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:07:07.612657 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:07.615973 (+ 3316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:07.617109 (+ 1136us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:07.617117 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:07.617119 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:07.617285 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:07.617759 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:07.617763 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:07.617765 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:07.618143 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:07.618381 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:07.618807 (+ 426us) server_negotiation.cc:299] Negotiation successful
0809 13:07:07.618983 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 13:07:07.620193 22890 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:07:07.639564 22910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:07.639028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:42839 (local address 127.0.0.1:37678)
0809 13:07:07.639271 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:07.639367 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:42839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260809 13:07:07.640714 22910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:07.640284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:42839 (local address 127.0.0.1:37682)
0809 13:07:07.640525 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:07.640601 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:42839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260809 13:07:07.751806 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 22713
I20260809 13:07:07.778350 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 22242
I20260809 13:07:07.779769 22327 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:07:07.901120 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 22242
I20260809 13:07:07.901207 22910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:07.900403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:42839 (local address 127.0.0.1:37692)
0809 13:07:07.900835 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:07.900951 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:42839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":244}
I20260809 13:07:27.931619 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:41979
--webserver_interface=127.28.155.254
--webserver_port=38855
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:34587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:41979
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:07:28.299476 22961 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:07:28.299856 22961 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:07:28.300045 22961 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:07:28.307607 22961 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 13:07:28.307763 22961 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 13:07:28.307861 22961 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 13:07:28.307974 22961 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:07:28.308082 22961 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:07:28.308208 22961 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:07:28.308300 22961 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:07:28.308387 22961 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:07:28.318853 22961 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:34587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:41979
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:41979
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=38855
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:07:28.320374 22961 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:07:28.321842 22961 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:07:28.335770 22967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:28.335743 22970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:28.335700 22968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:07:28.336927 22961 server_base.cc:1034] running on GCE node
I20260809 13:07:28.337790 22961 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:07:28.339318 22961 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:07:28.340602 22961 hybrid_clock.cc:648] HybridClock initialized: now 1786280848340534 us; error 40 us; skew 500 ppm
I20260809 13:07:28.340981 22961 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:07:28 dist-test-slave-jq4t krb5kdc[21457](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280848, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:07:28.348820 22961 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:07:28.350558 22961 webserver.cc:460] Webserver started at http://127.28.155.254:38855/ using document root <none> and password file <none>
I20260809 13:07:28.351374 22961 fs_manager.cc:359] Metadata directory not provided
I20260809 13:07:28.351531 22961 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:07:28.357420 22961 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 13:07:28.360414 22983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:28.361893 22961 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 13:07:28.362110 22961 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "c799bc54783c4ae6b655d1a28f08a4bf"
format_stamp: "Formatted at 2026-08-09 13:06:41 on dist-test-slave-jq4t"
server_key: "8dd543171a6313c5ab2793d91d12086e"
server_key_iv: "567baabfd040ed5c32ea3c0f3aadfa93"
server_key_version: "encryptionkey@0"
I20260809 13:07:28.363180 22961 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:07:28.379118 22961 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:07:28.384214 22961 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:07:28.384604 22961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:07:28.405817 22961 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:41979
I20260809 13:07:28.405838 23050 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:41979 every 8 connection(s)
I20260809 13:07:28.407639 22961 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:07:28.415613 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 22961
I20260809 13:07:28.415654 23051 sys_catalog.cc:263] Verifying existing consensus state
I20260809 13:07:28.416618 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:42839
--local_ip_for_outbound_sockets=127.28.155.193
--tserver_master_addrs=127.28.155.254:41979
--webserver_port=39083
--webserver_interface=127.28.155.193
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:34587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 13:07:28.419430 23051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf: Bootstrap starting.
I20260809 13:07:28.442193 23051 log.cc:824] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf: Log is configured to *not* fsync() on all Append() calls
I20260809 13:07:28.459586 23051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 13:07:28.460228 23051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf: Bootstrap complete.
I20260809 13:07:28.470358 23051 raft_consensus.cc:348] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c799bc54783c4ae6b655d1a28f08a4bf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 41979 } }
I20260809 13:07:28.471349 23051 raft_consensus.cc:729] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: c799bc54783c4ae6b655d1a28f08a4bf, State: Initialized, Role: FOLLOWER
I20260809 13:07:28.472034 23051 consensus_queue.cc:260] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c799bc54783c4ae6b655d1a28f08a4bf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 41979 } }
I20260809 13:07:28.472301 23051 raft_consensus.cc:388] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:07:28.472437 23051 raft_consensus.cc:482] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:07:28.472673 23051 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [term 2 FOLLOWER]: Advancing to term 3
I20260809 13:07:28.476783 23051 raft_consensus.cc:504] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c799bc54783c4ae6b655d1a28f08a4bf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 41979 } }
I20260809 13:07:28.477352 23051 leader_election.cc:302] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c799bc54783c4ae6b655d1a28f08a4bf; no voters:
I20260809 13:07:28.478157 23051 leader_election.cc:288] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 13:07:28.478318 23060 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [term 3 FOLLOWER]: Leader election won for term 3
I20260809 13:07:28.479876 23060 raft_consensus.cc:686] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [term 3 LEADER]: Becoming Leader. State: Replica: c799bc54783c4ae6b655d1a28f08a4bf, State: Running, Role: LEADER
I20260809 13:07:28.480800 23051 sys_catalog.cc:564] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:07:28.480674 23060 consensus_queue.cc:237] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c799bc54783c4ae6b655d1a28f08a4bf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 41979 } }
I20260809 13:07:28.483969 23062 sys_catalog.cc:455] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader c799bc54783c4ae6b655d1a28f08a4bf. Latest consensus state: current_term: 3 leader_uuid: "c799bc54783c4ae6b655d1a28f08a4bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c799bc54783c4ae6b655d1a28f08a4bf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 41979 } } }
I20260809 13:07:28.484061 23061 sys_catalog.cc:455] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "c799bc54783c4ae6b655d1a28f08a4bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c799bc54783c4ae6b655d1a28f08a4bf" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 41979 } } }
I20260809 13:07:28.484513 23062 sys_catalog.cc:458] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [sys.catalog]: This master's current role is: LEADER
I20260809 13:07:28.484601 23061 sys_catalog.cc:458] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf [sys.catalog]: This master's current role is: LEADER
I20260809 13:07:28.485596 23066 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:07:28.504153 23066 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:07:28.505911 23066 catalog_manager.cc:1259] Loaded cluster ID: 49058844f6cd4c12a08cee075201d50d
I20260809 13:07:28.506932 23066 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:07:28.511454 23066 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:07:28.513496 23066 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf: Loaded TSK: 0
I20260809 13:07:28.513789 23066 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c799bc54783c4ae6b655d1a28f08a4bf: Loaded TSK: 1
F20260809 13:07:28.514994 23066 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f7d916789ad google::LogMessage::Fail() at ??:0
@ 0x7f7d9167b88a google::LogMessage::SendToLog() at ??:0
@ 0x7f7d916784de google::LogMessage::Flush() at ??:0
@ 0x7f7d91679a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f7d953dc7d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f7d953cb73e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f7da70a71c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f7da70a6783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f7da71322a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f7da71320c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f7da717c5e9 std::function<>::operator()() at ??:0
@ 0x7f7da70aacdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f7da70a8c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f7da7130610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f7da7130439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f7d942c4345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f7d942c791c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f7d942c7799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f7d942a2eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f7d9757c6db start_thread at ??:0
@ 0x7f7d9051261f clone at ??:0
W20260809 13:07:28.875267 23057 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:07:28.875566 23057 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:07:28.875742 23057 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:07:28.883157 23057 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:07:28.883284 23057 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:07:28.883487 23057 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:07:28.893949 23057 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:34587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:42839
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=39083
--tserver_master_addrs=127.28.155.254:41979
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:07:28.895385 23057 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:07:28.896813 23057 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:07:28.910876 23115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:28.910789 23110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:28.910912 23111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:07:28.911772 23057 server_base.cc:1034] running on GCE node
I20260809 13:07:28.912472 23057 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:07:28.913600 23057 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:07:28.914851 23057 hybrid_clock.cc:648] HybridClock initialized: now 1786280848914805 us; error 54 us; skew 500 ppm
I20260809 13:07:28.915223 23057 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:07:28 dist-test-slave-jq4t krb5kdc[21457](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280848, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:07:28.918664 23057 init.cc:377] Logged in from keytab as kudu/127.28.155.193@KRBTEST.COM (short username kudu)
I20260809 13:07:28.920234 23057 webserver.cc:460] Webserver started at http://127.28.155.193:39083/ using document root <none> and password file <none>
I20260809 13:07:28.921064 23057 fs_manager.cc:359] Metadata directory not provided
I20260809 13:07:28.921226 23057 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:07:28.927139 23057 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.003s
I20260809 13:07:28.930496 23125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:28.932031 23057 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 13:07:28.932232 23057 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "32431bad486442a1957c9dbaa6768419"
format_stamp: "Formatted at 2026-08-09 13:06:42 on dist-test-slave-jq4t"
server_key: "a7d222713ac126e6a00e5bc9e894a855"
server_key_iv: "3161193cdd1e469ffe00d5eb21cbdf97"
server_key_version: "encryptionkey@0"
I20260809 13:07:28.933350 23057 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:07:28.957293 23057 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:07:28.961696 23057 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:07:28.962028 23057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:07:28.963155 23057 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:07:28.965247 23137 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260809 13:07:28.971491 23057 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 13:07:28.971616 23057 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20260809 13:07:28.971779 23057 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 13:07:28.975136 23057 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 13:07:28.975219 23057 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.001s sys 0.000s
I20260809 13:07:28.975643 23137 tablet_bootstrap.cc:492] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419: Bootstrap starting.
I20260809 13:07:28.985569 23137 log.cc:824] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419: Log is configured to *not* fsync() on all Append() calls
I20260809 13:07:29.002841 23137 tablet_bootstrap.cc:492] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 13:07:29.003981 23137 tablet_bootstrap.cc:492] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419: Bootstrap complete.
I20260809 13:07:29.004856 23137 ts_tablet_manager.cc:1397] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419: Time spent bootstrapping tablet: real 0.030s user 0.024s sys 0.004s
I20260809 13:07:29.017994 23137 raft_consensus.cc:348] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e962f4526b469ca869b7a1f39b1417" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35147 } } peers { permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 } } peers { permanent_uuid: "068b996951764080a3ba7a22c4c37878" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36419 } }
I20260809 13:07:29.019133 23137 raft_consensus.cc:729] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32431bad486442a1957c9dbaa6768419, State: Initialized, Role: FOLLOWER
I20260809 13:07:29.020390 23137 consensus_queue.cc:260] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e962f4526b469ca869b7a1f39b1417" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35147 } } peers { permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 } } peers { permanent_uuid: "068b996951764080a3ba7a22c4c37878" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36419 } }
I20260809 13:07:29.022508 23137 ts_tablet_manager.cc:1428] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419: Time spent starting tablet: real 0.017s user 0.009s sys 0.004s
I20260809 13:07:29.028034 23057 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:42839
I20260809 13:07:29.028077 23286 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:42839 every 8 connection(s)
I20260809 13:07:29.029477 23057 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:07:29.033465 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 23057
I20260809 13:07:29.034410 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:35147
--local_ip_for_outbound_sockets=127.28.155.194
--tserver_master_addrs=127.28.155.254:41979
--webserver_port=43511
--webserver_interface=127.28.155.194
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:34587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 13:07:29.035524 23292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:29.032838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.193:46407)
0809 13:07:29.033868 (+ 1030us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:29.034199 (+ 331us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":674,"thread_start_us":382,"threads_started":1}
W20260809 13:07:29.036317 23288 heartbeater.cc:644] Failed to heartbeat to 127.28.155.254:41979 (0 consecutive failures): Network error: Failed to ping master at 127.28.155.254:41979: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
I20260809 13:07:29.037489 23292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:29.036982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.193:47709)
0809 13:07:29.037219 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:29.037324 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260809 13:07:29.038686 23292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:29.038188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.193:35845)
0809 13:07:29.038385 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:29.038493 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260809 13:07:29.038997 23288 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 13:07:29.406817 23293 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:07:29.407151 23293 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:07:29.407321 23293 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:07:29.415218 23293 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:07:29.415357 23293 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:07:29.415544 23293 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:07:29.426328 23293 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:34587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:35147
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=43511
--tserver_master_addrs=127.28.155.254:41979
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:07:29.427762 23293 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:07:29.429232 23293 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:07:29.443704 23303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:29.443684 23301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:29.443712 23300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:07:29.444710 23293 server_base.cc:1034] running on GCE node
I20260809 13:07:29.445443 23293 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:07:29.446570 23293 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:07:29.447799 23293 hybrid_clock.cc:648] HybridClock initialized: now 1786280849447746 us; error 51 us; skew 500 ppm
I20260809 13:07:29.448184 23293 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:07:29 dist-test-slave-jq4t krb5kdc[21457](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280849, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:07:29.451737 23293 init.cc:377] Logged in from keytab as kudu/127.28.155.194@KRBTEST.COM (short username kudu)
I20260809 13:07:29.453645 23293 webserver.cc:460] Webserver started at http://127.28.155.194:43511/ using document root <none> and password file <none>
I20260809 13:07:29.454700 23293 fs_manager.cc:359] Metadata directory not provided
I20260809 13:07:29.454818 23293 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:07:29.460539 23293 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260809 13:07:29.463466 23312 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:29.465019 23293 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:07:29.465168 23293 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "a1e962f4526b469ca869b7a1f39b1417"
format_stamp: "Formatted at 2026-08-09 13:06:43 on dist-test-slave-jq4t"
server_key: "9eba38b9a8f026cc275e94993e44f540"
server_key_iv: "3ca5f7dfc8df45729e4a779d4e603302"
server_key_version: "encryptionkey@0"
I20260809 13:07:29.466185 23293 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:07:29.483870 23293 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:07:29.488682 23293 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:07:29.488940 23293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:07:29.490077 23293 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:07:29.491544 23293 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:07:29.491636 23293 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:29.491716 23293 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:07:29.491778 23293 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:29.529139 23293 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:35147
I20260809 13:07:29.529227 23462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:35147 every 8 connection(s)
I20260809 13:07:29.530894 23293 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:07:29.536367 23466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:29.534295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.194:52019)
0809 13:07:29.535133 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:29.535423 (+ 290us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":324,"threads_started":1}
W20260809 13:07:29.537274 23463 heartbeater.cc:644] Failed to heartbeat to 127.28.155.254:41979 (0 consecutive failures): Network error: Failed to ping master at 127.28.155.254:41979: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
I20260809 13:07:29.538412 23466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:29.537874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.194:46045)
0809 13:07:29.538114 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:29.538220 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260809 13:07:29.539381 23466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:29.538973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.194:48283)
0809 13:07:29.539155 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:29.539258 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260809 13:07:29.539647 23463 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 13:07:29.540580 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 23293
I20260809 13:07:29.541210 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:36419
--local_ip_for_outbound_sockets=127.28.155.195
--tserver_master_addrs=127.28.155.254:41979
--webserver_port=43387
--webserver_interface=127.28.155.195
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:34587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:07:29.908231 23467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:07:29.908613 23467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:07:29.908793 23467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:07:29.916396 23467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:07:29.916600 23467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:07:29.916801 23467 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:07:29.927014 23467 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:34587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:36419
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=43387
--tserver_master_addrs=127.28.155.254:41979
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:07:29.928553 23467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:07:29.929942 23467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:07:29.944144 23474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:29.944229 23479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:29.944180 23476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:07:29.945147 23467 server_base.cc:1034] running on GCE node
I20260809 13:07:29.945819 23467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:07:29.946740 23467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:07:29.947942 23467 hybrid_clock.cc:648] HybridClock initialized: now 1786280849947890 us; error 51 us; skew 500 ppm
I20260809 13:07:29.948280 23467 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:07:29 dist-test-slave-jq4t krb5kdc[21457](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280849, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:07:29.951556 23467 init.cc:377] Logged in from keytab as kudu/127.28.155.195@KRBTEST.COM (short username kudu)
I20260809 13:07:29.953102 23467 webserver.cc:460] Webserver started at http://127.28.155.195:43387/ using document root <none> and password file <none>
I20260809 13:07:29.953820 23467 fs_manager.cc:359] Metadata directory not provided
I20260809 13:07:29.953975 23467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:07:29.959468 23467 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 13:07:29.962460 23491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:29.963961 23467 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 13:07:29.964160 23467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "068b996951764080a3ba7a22c4c37878"
format_stamp: "Formatted at 2026-08-09 13:06:43 on dist-test-slave-jq4t"
server_key: "5fff6486a033b52506a8d3a2d083bdc8"
server_key_iv: "c722ecba876d7e0bad7db53fb5e458dd"
server_key_version: "encryptionkey@0"
I20260809 13:07:29.965307 23467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:07:29.983309 23467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:07:29.988106 23467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:07:29.988431 23467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:07:29.989791 23467 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:07:29.991384 23467 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:07:29.991490 23467 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:29.991572 23467 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:07:29.991626 23467 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:30.028932 23467 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:36419
I20260809 13:07:30.029078 23637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:36419 every 8 connection(s)
I20260809 13:07:30.030550 23467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:07:30.035904 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 23467
I20260809 13:07:30.036664 23642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:30.034189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.195:53301)
0809 13:07:30.035092 (+ 903us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:30.035419 (+ 327us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":323,"threads_started":1}
W20260809 13:07:30.037545 23639 heartbeater.cc:644] Failed to heartbeat to 127.28.155.254:41979 (0 consecutive failures): Network error: Failed to ping master at 127.28.155.254:41979: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
I20260809 13:07:30.038781 23642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:30.038322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.195:38241)
0809 13:07:30.038532 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:30.038623 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260809 13:07:30.039909 23642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:30.039417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.195:46523)
0809 13:07:30.039602 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:30.039725 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260809 13:07:30.040197 23639 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 13:07:30.040457 23644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:30.039475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.193:46095)
0809 13:07:30.040067 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:30.040171 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":296,"threads_started":1}
I20260809 13:07:30.299054 23646 raft_consensus.cc:482] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:07:30.299451 23646 raft_consensus.cc:504] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e962f4526b469ca869b7a1f39b1417" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35147 } } peers { permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 } } peers { permanent_uuid: "068b996951764080a3ba7a22c4c37878" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36419 } }
I20260809 13:07:30.301436 23646 leader_election.cc:288] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1e962f4526b469ca869b7a1f39b1417 (127.28.155.194:35147), 068b996951764080a3ba7a22c4c37878 (127.28.155.195:36419)
Aug 09 13:07:30 dist-test-slave-jq4t krb5kdc[21457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280848, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for kudu/127.28.155.195@KRBTEST.COM
Aug 09 13:07:30 dist-test-slave-jq4t krb5kdc[21457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280848, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for kudu/127.28.155.194@KRBTEST.COM
I20260809 13:07:30.329770 23650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:30.302117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:39903 (local address 127.28.155.195:36419)
0809 13:07:30.304131 (+ 2014us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:30.304146 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:30.304198 (+ 52us) server_negotiation.cc:407] Connection header received
0809 13:07:30.306599 (+ 2401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:30.306613 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:30.307116 (+ 503us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:30.307506 (+ 390us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:30.310126 (+ 2620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:30.312099 (+ 1973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:30.315144 (+ 3045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:30.316196 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:30.316411 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:30.321937 (+ 5526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:30.321951 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:30.321972 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:07:30.322025 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:30.325309 (+ 3284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:30.326330 (+ 1021us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:30.326340 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:30.326348 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:30.326574 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:30.327115 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:30.327120 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:30.327122 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:30.327749 (+ 627us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:30.327899 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:30.328952 (+ 1053us) server_negotiation.cc:299] Negotiation successful
0809 13:07:30.329340 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1757,"thread_start_us":1524,"threads_started":1}
I20260809 13:07:30.329780 23651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:30.302141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:60919 (local address 127.28.155.194:35147)
0809 13:07:30.304783 (+ 2642us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:30.304797 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:30.304838 (+ 41us) server_negotiation.cc:407] Connection header received
0809 13:07:30.307020 (+ 2182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:30.307032 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:30.307443 (+ 411us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:30.307780 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:30.310126 (+ 2346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:30.312160 (+ 2034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:30.315144 (+ 2984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:30.316196 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:30.316398 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:30.322216 (+ 5818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:30.322227 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:30.322242 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:07:30.322291 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:30.325857 (+ 3566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:30.326720 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:30.326728 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:30.326736 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:30.326949 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:30.327409 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:30.327412 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:30.327414 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:30.327967 (+ 553us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:30.328166 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:30.328936 (+ 770us) server_negotiation.cc:299] Negotiation successful
0809 13:07:30.329350 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2461,"thread_start_us":2322,"threads_started":1}
I20260809 13:07:30.329777 23644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:30.301900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:36419 (local address 127.28.155.193:39903)
0809 13:07:30.302266 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:30.302313 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:30.303059 (+ 746us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:30.307665 (+ 4606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:30.307680 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:30.308692 (+ 1012us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:07:30.309889 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:30.309920 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:30.312378 (+ 2458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:30.312382 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:30.314937 (+ 2555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:30.314962 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:30.316529 (+ 1567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:30.316535 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:30.316913 (+ 378us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:30.318000 (+ 1087us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:07:30.318040 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:07:30.321541 (+ 3501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:07:30.325472 (+ 3931us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:07:30.325482 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:07:30.325500 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:07:30.326171 (+ 671us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:07:30.326698 (+ 527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:07:30.326704 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:07:30.326707 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:07:30.326990 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:07:30.327920 (+ 930us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:07:30.327929 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:07:30.328331 (+ 402us) client_negotiation.cc:769] Sending connection context
0809 13:07:30.328696 (+ 365us) client_negotiation.cc:240] Negotiation successful
0809 13:07:30.329312 (+ 616us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"mutex_wait_us":341,"spinlock_wait_cycles":34688}
I20260809 13:07:30.330245 23649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:30.301905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:35147 (local address 127.28.155.193:60919)
0809 13:07:30.304512 (+ 2607us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:30.304533 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:30.304663 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:30.307988 (+ 3325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:30.307992 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:30.308692 (+ 700us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:07:30.309889 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:30.309920 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:30.312375 (+ 2455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:30.312382 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:30.314937 (+ 2555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:30.314962 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:30.316516 (+ 1554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:30.316524 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:30.316917 (+ 393us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:30.318000 (+ 1083us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:07:30.318043 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:07:30.321869 (+ 3826us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:07:30.326025 (+ 4156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:07:30.326029 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:07:30.326031 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:07:30.326544 (+ 513us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:07:30.327099 (+ 555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:07:30.327104 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:07:30.327107 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:07:30.327282 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:07:30.328104 (+ 822us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:07:30.328107 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:07:30.328357 (+ 250us) client_negotiation.cc:769] Sending connection context
0809 13:07:30.328695 (+ 338us) client_negotiation.cc:240] Negotiation successful
0809 13:07:30.329494 (+ 799us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2399,"mutex_wait_us":757,"spinlock_wait_cycles":38912,"thread_start_us":2124,"threads_started":1}
W20260809 13:07:30.333429 23127 leader_election.cc:341] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a1e962f4526b469ca869b7a1f39b1417 (127.28.155.194:35147): Not found: Tablet not found: 82c024c9864744c081460d98dc58e0fd
W20260809 13:07:30.333783 23133 leader_election.cc:341] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 068b996951764080a3ba7a22c4c37878 (127.28.155.195:36419): Not found: Tablet not found: 82c024c9864744c081460d98dc58e0fd
I20260809 13:07:30.333979 23133 leader_election.cc:302] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32431bad486442a1957c9dbaa6768419; no voters: 068b996951764080a3ba7a22c4c37878, a1e962f4526b469ca869b7a1f39b1417
I20260809 13:07:30.334434 23646 raft_consensus.cc:2726] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 13:07:30.541273 23652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:30.540324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.194:39963)
0809 13:07:30.540878 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:30.541029 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":298,"threads_started":1}
I20260809 13:07:31.041850 23653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:31.040793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.195:35083)
0809 13:07:31.041472 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:31.041635 (+ 163us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":415,"threads_started":1}
I20260809 13:07:31.042706 23654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:31.041462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.193:44665)
0809 13:07:31.042475 (+ 1013us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:31.042555 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":890,"thread_start_us":776,"threads_started":1}
I20260809 13:07:31.543154 23655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:31.542302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.194:44675)
0809 13:07:31.542773 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:31.542896 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":224,"threads_started":1}
I20260809 13:07:32.043982 23656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:32.042952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.195:60509)
0809 13:07:32.043548 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:32.043669 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":296,"threads_started":1}
I20260809 13:07:32.044721 23657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:32.043734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.193:48913)
0809 13:07:32.044404 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:32.044548 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":316,"threads_started":1}
I20260809 13:07:32.102945 23658 raft_consensus.cc:482] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:07:32.103173 23658 raft_consensus.cc:504] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e962f4526b469ca869b7a1f39b1417" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35147 } } peers { permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 } } peers { permanent_uuid: "068b996951764080a3ba7a22c4c37878" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36419 } }
I20260809 13:07:32.103977 23658 leader_election.cc:288] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1e962f4526b469ca869b7a1f39b1417 (127.28.155.194:35147), 068b996951764080a3ba7a22c4c37878 (127.28.155.195:36419)
W20260809 13:07:32.105258 23127 leader_election.cc:341] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a1e962f4526b469ca869b7a1f39b1417 (127.28.155.194:35147): Not found: Tablet not found: 82c024c9864744c081460d98dc58e0fd
W20260809 13:07:32.105458 23133 leader_election.cc:341] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 068b996951764080a3ba7a22c4c37878 (127.28.155.195:36419): Not found: Tablet not found: 82c024c9864744c081460d98dc58e0fd
I20260809 13:07:32.105638 23133 leader_election.cc:302] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32431bad486442a1957c9dbaa6768419; no voters: 068b996951764080a3ba7a22c4c37878, a1e962f4526b469ca869b7a1f39b1417
I20260809 13:07:32.105934 23658 raft_consensus.cc:2726] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 13:07:32.545157 23659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:32.544236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.194:34201)
0809 13:07:32.544858 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:32.544973 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":357,"threads_started":1}
I20260809 13:07:33.045938 23661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:33.045109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.195:33775)
0809 13:07:33.045673 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:33.045767 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":319,"threads_started":1}
I20260809 13:07:33.046375 23662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:33.045624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.193:56993)
0809 13:07:33.046116 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:33.046220 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":263,"threads_started":1}
I20260809 13:07:33.547155 23663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:33.546259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.194:58587)
0809 13:07:33.546871 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:33.546962 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":346,"threads_started":1}
I20260809 13:07:34.047967 23665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:34.046924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.195:49575)
0809 13:07:34.047543 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:34.047681 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":327,"threads_started":1}
I20260809 13:07:34.048599 23666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:34.047332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.193:53819)
0809 13:07:34.048229 (+ 897us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:34.048340 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":752,"thread_start_us":568,"threads_started":1}
I20260809 13:07:34.549522 23669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:34.548376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.194:37941)
0809 13:07:34.549095 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:34.549240 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":338,"threads_started":1}
I20260809 13:07:34.981891 23670 raft_consensus.cc:482] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:07:34.982127 23670 raft_consensus.cc:504] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e962f4526b469ca869b7a1f39b1417" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35147 } } peers { permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 } } peers { permanent_uuid: "068b996951764080a3ba7a22c4c37878" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36419 } }
I20260809 13:07:34.982942 23670 leader_election.cc:288] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1e962f4526b469ca869b7a1f39b1417 (127.28.155.194:35147), 068b996951764080a3ba7a22c4c37878 (127.28.155.195:36419)
W20260809 13:07:34.984069 23133 leader_election.cc:341] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 068b996951764080a3ba7a22c4c37878 (127.28.155.195:36419): Not found: Tablet not found: 82c024c9864744c081460d98dc58e0fd
W20260809 13:07:34.984309 23127 leader_election.cc:341] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a1e962f4526b469ca869b7a1f39b1417 (127.28.155.194:35147): Not found: Tablet not found: 82c024c9864744c081460d98dc58e0fd
I20260809 13:07:34.984478 23127 leader_election.cc:302] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32431bad486442a1957c9dbaa6768419; no voters: 068b996951764080a3ba7a22c4c37878, a1e962f4526b469ca869b7a1f39b1417
I20260809 13:07:34.984809 23670 raft_consensus.cc:2726] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 13:07:35.050366 23671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:35.049268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.195:33733)
0809 13:07:35.049970 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:35.050110 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":302,"threads_started":1}
I20260809 13:07:35.050668 23673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:35.049609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.193:49731)
0809 13:07:35.050281 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:35.050423 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":393,"threads_started":1}
I20260809 13:07:35.551681 23675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:35.550693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.194:56057)
0809 13:07:35.551320 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:35.551449 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":312,"threads_started":1}
I20260809 13:07:36.052811 23676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:36.051573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.195:40693)
0809 13:07:36.052208 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:36.052336 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":348,"threads_started":1}
I20260809 13:07:36.052874 23677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:36.051712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.193:50197)
0809 13:07:36.052539 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:36.052648 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":670,"thread_start_us":550,"threads_started":1}
I20260809 13:07:36.553830 23678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:36.552801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.194:40435)
0809 13:07:36.553524 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:36.553621 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":343,"threads_started":1}
I20260809 13:07:36.754534 23679 raft_consensus.cc:482] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:07:36.754736 23679 raft_consensus.cc:504] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e962f4526b469ca869b7a1f39b1417" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35147 } } peers { permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 } } peers { permanent_uuid: "068b996951764080a3ba7a22c4c37878" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36419 } }
I20260809 13:07:36.755476 23679 leader_election.cc:288] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1e962f4526b469ca869b7a1f39b1417 (127.28.155.194:35147), 068b996951764080a3ba7a22c4c37878 (127.28.155.195:36419)
W20260809 13:07:36.756464 23133 leader_election.cc:341] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 068b996951764080a3ba7a22c4c37878 (127.28.155.195:36419): Not found: Tablet not found: 82c024c9864744c081460d98dc58e0fd
W20260809 13:07:36.756723 23127 leader_election.cc:341] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a1e962f4526b469ca869b7a1f39b1417 (127.28.155.194:35147): Not found: Tablet not found: 82c024c9864744c081460d98dc58e0fd
I20260809 13:07:36.756841 23127 leader_election.cc:302] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32431bad486442a1957c9dbaa6768419; no voters: 068b996951764080a3ba7a22c4c37878, a1e962f4526b469ca869b7a1f39b1417
I20260809 13:07:36.757139 23679 raft_consensus.cc:2726] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 13:07:37.055253 23681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:37.054019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.193:57985)
0809 13:07:37.054803 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:37.054939 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":647,"thread_start_us":402,"threads_started":1}
I20260809 13:07:37.056392 23680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:37.053974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.195:48819)
0809 13:07:37.056046 (+ 2072us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:37.056158 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1947,"thread_start_us":1675,"threads_started":1}
I20260809 13:07:37.555943 23682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:37.555082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.194:47531)
0809 13:07:37.555631 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:37.555728 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":288,"threads_started":1}
I20260809 13:07:38.058091 23683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:38.056996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.193:39671)
0809 13:07:38.057614 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:38.057772 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":313,"threads_started":1}
I20260809 13:07:38.058414 23687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:38.057432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.195:59431)
0809 13:07:38.057927 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:38.058023 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":256,"threads_started":1}
I20260809 13:07:38.557960 23688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:38.557094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.194:54003)
0809 13:07:38.557690 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:38.557787 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":273,"threads_started":1}
I20260809 13:07:39.060361 23689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:39.059270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.193:51793)
0809 13:07:39.059904 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:39.060031 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":301,"threads_started":1}
I20260809 13:07:39.060560 23691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:39.059461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.195:41201)
0809 13:07:39.060204 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:39.060330 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":591,"thread_start_us":455,"threads_started":1}
I20260809 13:07:39.559899 23692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:39.559028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.194:39959)
0809 13:07:39.559592 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:39.559684 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":337,"threads_started":1}
I20260809 13:07:40.062345 23693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:40.061480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.193:44559)
0809 13:07:40.062011 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:40.062136 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":296,"threads_started":1}
I20260809 13:07:40.062779 23695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:40.061598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.195:41709)
0809 13:07:40.062420 (+ 822us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:40.062554 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":706,"thread_start_us":591,"threads_started":1}
I20260809 13:07:40.283447 23696 raft_consensus.cc:482] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:07:40.283666 23696 raft_consensus.cc:504] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e962f4526b469ca869b7a1f39b1417" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35147 } } peers { permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 } } peers { permanent_uuid: "068b996951764080a3ba7a22c4c37878" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36419 } }
I20260809 13:07:40.284387 23696 leader_election.cc:288] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1e962f4526b469ca869b7a1f39b1417 (127.28.155.194:35147), 068b996951764080a3ba7a22c4c37878 (127.28.155.195:36419)
W20260809 13:07:40.285490 23133 leader_election.cc:341] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 068b996951764080a3ba7a22c4c37878 (127.28.155.195:36419): Not found: Tablet not found: 82c024c9864744c081460d98dc58e0fd
W20260809 13:07:40.285702 23127 leader_election.cc:341] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a1e962f4526b469ca869b7a1f39b1417 (127.28.155.194:35147): Not found: Tablet not found: 82c024c9864744c081460d98dc58e0fd
I20260809 13:07:40.285871 23127 leader_election.cc:302] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32431bad486442a1957c9dbaa6768419; no voters: 068b996951764080a3ba7a22c4c37878, a1e962f4526b469ca869b7a1f39b1417
I20260809 13:07:40.286188 23696 raft_consensus.cc:2726] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 13:07:40.561946 23697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:40.561080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.194:41061)
0809 13:07:40.561641 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:40.561741 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":277,"threads_started":1}
I20260809 13:07:41.064352 23698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:41.063498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.193:58965)
0809 13:07:41.064068 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:41.064165 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":308,"threads_started":1}
I20260809 13:07:41.064785 23700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:41.063827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.195:58885)
0809 13:07:41.064437 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:41.064590 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":326,"threads_started":1}
I20260809 13:07:41.563921 23702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:41.563082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.194:57375)
0809 13:07:41.563646 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:41.563733 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":324,"threads_started":1}
I20260809 13:07:42.066219 23703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:42.065397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.193:53827)
0809 13:07:42.065931 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:42.066041 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":269,"threads_started":1}
I20260809 13:07:42.066622 23705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:42.065771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.195:34373)
0809 13:07:42.066323 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:42.066441 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":288,"threads_started":1}
I20260809 13:07:42.566026 23706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:42.565192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.194:36119)
0809 13:07:42.565729 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:42.565841 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":275,"threads_started":1}
I20260809 13:07:43.035859 23707 raft_consensus.cc:482] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:07:43.036092 23707 raft_consensus.cc:504] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1e962f4526b469ca869b7a1f39b1417" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35147 } } peers { permanent_uuid: "32431bad486442a1957c9dbaa6768419" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 42839 } } peers { permanent_uuid: "068b996951764080a3ba7a22c4c37878" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36419 } }
I20260809 13:07:43.036969 23707 leader_election.cc:288] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1e962f4526b469ca869b7a1f39b1417 (127.28.155.194:35147), 068b996951764080a3ba7a22c4c37878 (127.28.155.195:36419)
W20260809 13:07:43.038012 23133 leader_election.cc:341] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 068b996951764080a3ba7a22c4c37878 (127.28.155.195:36419): Not found: Tablet not found: 82c024c9864744c081460d98dc58e0fd
W20260809 13:07:43.038241 23127 leader_election.cc:341] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a1e962f4526b469ca869b7a1f39b1417 (127.28.155.194:35147): Not found: Tablet not found: 82c024c9864744c081460d98dc58e0fd
I20260809 13:07:43.038362 23127 leader_election.cc:302] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32431bad486442a1957c9dbaa6768419; no voters: 068b996951764080a3ba7a22c4c37878, a1e962f4526b469ca869b7a1f39b1417
I20260809 13:07:43.038681 23707 raft_consensus.cc:2726] T 82c024c9864744c081460d98dc58e0fd P 32431bad486442a1957c9dbaa6768419 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 13:07:43.068192 23708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:43.067221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.193:34303)
0809 13:07:43.067820 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:43.067957 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":301,"threads_started":1}
I20260809 13:07:43.068655 23709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:43.067628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.195:56427)
0809 13:07:43.068222 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:43.068398 (+ 176us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":330,"threads_started":1}
I20260809 13:07:43.567859 23710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:43.567030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.194:60663)
0809 13:07:43.567547 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:43.567645 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":251,"threads_started":1}
I20260809 13:07:44.070657 23711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:44.069679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.195:41789)
0809 13:07:44.070224 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:44.070315 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":280,"threads_started":1}
I20260809 13:07:44.071209 23712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:44.069710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.193:55723)
0809 13:07:44.070834 (+ 1124us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:44.070977 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":954,"thread_start_us":822,"threads_started":1}
I20260809 13:07:44.570179 23714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:44.569112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.194:33053)
0809 13:07:44.569789 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:44.569938 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":467,"threads_started":1}
I20260809 13:07:45.045471 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 23057
I20260809 13:07:45.063453 23715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:45.047281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50396 (local address 127.28.155.193:42839)
0809 13:07:45.048020 (+ 739us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:45.048028 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:45.048056 (+ 28us) server_negotiation.cc:407] Connection header received
0809 13:07:45.048121 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:45.048128 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:45.048348 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:45.048566 (+ 218us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:45.050181 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:45.051183 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:45.052535 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:45.053162 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:45.053344 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:45.056653 (+ 3309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:45.056671 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:45.056688 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:07:45.056732 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:45.059992 (+ 3260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:45.060967 (+ 975us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:45.060976 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:45.060978 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:45.061131 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:45.061574 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:45.061580 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:45.061583 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:45.062036 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:45.062392 (+ 356us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:45.062763 (+ 371us) server_negotiation.cc:299] Negotiation successful
0809 13:07:45.063087 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":551,"thread_start_us":413,"threads_started":1}
I20260809 13:07:45.064882 23281 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:07:45.073006 23719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:45.072122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41979 (local address 127.28.155.195:52487)
0809 13:07:45.072697 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:45.072815 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.254:41979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":285,"threads_started":1}
I20260809 13:07:45.158128 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 23057
I20260809 13:07:45.187150 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 23293
I20260809 13:07:45.201526 23721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:45.188011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59550 (local address 127.28.155.194:35147)
0809 13:07:45.188591 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:45.188595 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:45.188613 (+ 18us) server_negotiation.cc:407] Connection header received
0809 13:07:45.188674 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:45.188677 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:45.188743 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:45.188838 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:45.190333 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:45.191124 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:45.192415 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:45.193146 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:45.193249 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:45.195979 (+ 2730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:45.195985 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:45.195988 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:07:45.196028 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:45.198859 (+ 2831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:45.199556 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:45.199561 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:45.199563 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:45.199711 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:45.200077 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:45.200080 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:45.200082 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:45.200396 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:45.200696 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:45.201021 (+ 325us) server_negotiation.cc:299] Negotiation successful
0809 13:07:45.201210 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":305,"threads_started":1}
I20260809 13:07:45.202329 23456 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:07:45.289268 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 23293
I20260809 13:07:45.315618 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 23467
I20260809 13:07:45.330914 23723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:45.316622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44338 (local address 127.28.155.195:36419)
0809 13:07:45.317271 (+ 649us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:45.317277 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:45.317295 (+ 18us) server_negotiation.cc:407] Connection header received
0809 13:07:45.317355 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:45.317359 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:45.317431 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:45.317565 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:45.319138 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:45.319977 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:45.321493 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:45.321966 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:45.322110 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:45.325162 (+ 3052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:45.325168 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:45.325172 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:07:45.325208 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:45.327953 (+ 2745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:45.328731 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:45.328736 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:45.328738 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:45.328891 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:45.329316 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:45.329321 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:45.329324 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:45.329613 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:45.329971 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:45.330242 (+ 271us) server_negotiation.cc:299] Negotiation successful
0809 13:07:45.330484 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":358,"threads_started":1}
I20260809 13:07:45.331732 23633 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:07:45.424532 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 23467
2026-08-09T13:07:45Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (65665 ms)
[----------] 30 tests from SecurityITest (316777 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:07:45 dist-test-slave-jq4t krb5kdc[23728](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:07:45 dist-test-slave-jq4t krb5kdc[23728](info): set up 2 sockets
Aug 09 13:07:45 dist-test-slave-jq4t krb5kdc[23728](info): commencing operation
krb5kdc: starting...
W20260809 13:07:46.790287 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.313s user 0.003s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:07:47 dist-test-slave-jq4t krb5kdc[23728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280867, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:07:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:07:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
I20260809 13:07:47.134253 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:41785
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:42497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:41785
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:07:47.507571 23748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:07:47.507997 23748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:07:47.508175 23748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:07:47.515884 23748 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:07:47.516083 23748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:07:47.516214 23748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:07:47.516321 23748 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:07:47.516419 23748 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:07:47.527285 23748 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:42497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:41785
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:41785
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:07:47.528877 23748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:07:47.530313 23748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:07:47.543491 23753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:47.543535 23754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:47.543577 23757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:07:47.544637 23748 server_base.cc:1034] running on GCE node
I20260809 13:07:47.545590 23748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:07:47.547273 23748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:07:47.548627 23748 hybrid_clock.cc:648] HybridClock initialized: now 1786280867548547 us; error 55 us; skew 500 ppm
I20260809 13:07:47.549055 23748 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:07:47 dist-test-slave-jq4t krb5kdc[23728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280867, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:07:47.552760 23748 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:07:47.554531 23748 webserver.cc:460] Webserver started at http://127.28.155.254:45341/ using document root <none> and password file <none>
I20260809 13:07:47.555325 23748 fs_manager.cc:359] Metadata directory not provided
I20260809 13:07:47.555497 23748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:07:47.555843 23748 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:07:47.559433 23748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "19c8d6747e594bd1a5dc3553ea1388f7"
format_stamp: "Formatted at 2026-08-09 13:07:47 on dist-test-slave-jq4t"
server_key: "3bf3278549fad9653cc90de2dea52c9e"
server_key_iv: "40b8baf159aba47159092aab36a33423"
server_key_version: "encryptionkey@0"
I20260809 13:07:47.560305 23748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "19c8d6747e594bd1a5dc3553ea1388f7"
format_stamp: "Formatted at 2026-08-09 13:07:47 on dist-test-slave-jq4t"
server_key: "3bf3278549fad9653cc90de2dea52c9e"
server_key_iv: "40b8baf159aba47159092aab36a33423"
server_key_version: "encryptionkey@0"
I20260809 13:07:47.566483 23748 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260809 13:07:47.570595 23767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:47.572062 23748 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 13:07:47.572283 23748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "19c8d6747e594bd1a5dc3553ea1388f7"
format_stamp: "Formatted at 2026-08-09 13:07:47 on dist-test-slave-jq4t"
server_key: "3bf3278549fad9653cc90de2dea52c9e"
server_key_iv: "40b8baf159aba47159092aab36a33423"
server_key_version: "encryptionkey@0"
I20260809 13:07:47.572546 23748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:07:47.622192 23748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:07:47.627370 23748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:07:47.627718 23748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:07:47.648895 23748 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:41785
I20260809 13:07:47.648931 23843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:41785 every 8 connection(s)
I20260809 13:07:47.650381 23748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:07:47.654593 23844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:07:47.660099 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 23748
I20260809 13:07:47.660357 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:07:47.661202 29295 external_mini_cluster.cc:1428] Setting key 11d90daf63d0f34f16e327c8f48f06b4
I20260809 13:07:47.667219 23844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19c8d6747e594bd1a5dc3553ea1388f7: Bootstrap starting.
I20260809 13:07:47.671556 23844 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 19c8d6747e594bd1a5dc3553ea1388f7: Neither blocks nor log segments found. Creating new log.
I20260809 13:07:47.673043 23844 log.cc:824] T 00000000000000000000000000000000 P 19c8d6747e594bd1a5dc3553ea1388f7: Log is configured to *not* fsync() on all Append() calls
I20260809 13:07:47.676764 23844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19c8d6747e594bd1a5dc3553ea1388f7: No bootstrap required, opened a new log
Aug 09 13:07:47 dist-test-slave-jq4t krb5kdc[23728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280867, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:07:47.685685 23844 raft_consensus.cc:348] T 00000000000000000000000000000000 P 19c8d6747e594bd1a5dc3553ea1388f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19c8d6747e594bd1a5dc3553ea1388f7" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 41785 } }
I20260809 13:07:47.686187 23844 raft_consensus.cc:374] T 00000000000000000000000000000000 P 19c8d6747e594bd1a5dc3553ea1388f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:07:47.686336 23844 raft_consensus.cc:729] T 00000000000000000000000000000000 P 19c8d6747e594bd1a5dc3553ea1388f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19c8d6747e594bd1a5dc3553ea1388f7, State: Initialized, Role: FOLLOWER
I20260809 13:07:47.687170 23844 consensus_queue.cc:260] T 00000000000000000000000000000000 P 19c8d6747e594bd1a5dc3553ea1388f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19c8d6747e594bd1a5dc3553ea1388f7" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 41785 } }
I20260809 13:07:47.687500 23844 raft_consensus.cc:388] T 00000000000000000000000000000000 P 19c8d6747e594bd1a5dc3553ea1388f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:07:47.687662 23844 raft_consensus.cc:482] T 00000000000000000000000000000000 P 19c8d6747e594bd1a5dc3553ea1388f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:07:47.687881 23844 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 19c8d6747e594bd1a5dc3553ea1388f7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:07:47.688890 23847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:47.663605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55656 (local address 127.28.155.254:41785)
0809 13:07:47.664635 (+ 1030us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:47.664649 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:47.664696 (+ 47us) server_negotiation.cc:407] Connection header received
0809 13:07:47.666556 (+ 1860us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:47.666583 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:47.666996 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:47.667394 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:47.669425 (+ 2031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:47.670852 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:47.673042 (+ 2190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:47.674213 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:47.674452 (+ 239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:47.679629 (+ 5177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:47.679640 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:47.679656 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:07:47.679717 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:47.683504 (+ 3787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:47.684417 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:47.684425 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:47.684433 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:47.684705 (+ 272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:47.685172 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:47.685176 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:47.685178 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:47.685818 (+ 640us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:47.686219 (+ 401us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:47.686734 (+ 515us) server_negotiation.cc:299] Negotiation successful
0809 13:07:47.687256 (+ 522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":717,"thread_start_us":446,"threads_started":1}
I20260809 13:07:47.691263 23844 raft_consensus.cc:504] T 00000000000000000000000000000000 P 19c8d6747e594bd1a5dc3553ea1388f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19c8d6747e594bd1a5dc3553ea1388f7" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 41785 } }
I20260809 13:07:47.691823 23844 leader_election.cc:302] T 00000000000000000000000000000000 P 19c8d6747e594bd1a5dc3553ea1388f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 19c8d6747e594bd1a5dc3553ea1388f7; no voters:
I20260809 13:07:47.692665 23844 leader_election.cc:288] T 00000000000000000000000000000000 P 19c8d6747e594bd1a5dc3553ea1388f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:07:47.692833 23850 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 19c8d6747e594bd1a5dc3553ea1388f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:07:47.693576 23850 raft_consensus.cc:686] T 00000000000000000000000000000000 P 19c8d6747e594bd1a5dc3553ea1388f7 [term 1 LEADER]: Becoming Leader. State: Replica: 19c8d6747e594bd1a5dc3553ea1388f7, State: Running, Role: LEADER
I20260809 13:07:47.694182 23850 consensus_queue.cc:237] T 00000000000000000000000000000000 P 19c8d6747e594bd1a5dc3553ea1388f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19c8d6747e594bd1a5dc3553ea1388f7" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 41785 } }
I20260809 13:07:47.694856 23844 sys_catalog.cc:564] T 00000000000000000000000000000000 P 19c8d6747e594bd1a5dc3553ea1388f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:07:47.698035 23851 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19c8d6747e594bd1a5dc3553ea1388f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "19c8d6747e594bd1a5dc3553ea1388f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19c8d6747e594bd1a5dc3553ea1388f7" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 41785 } } }
I20260809 13:07:47.698879 23852 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19c8d6747e594bd1a5dc3553ea1388f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19c8d6747e594bd1a5dc3553ea1388f7. Latest consensus state: current_term: 1 leader_uuid: "19c8d6747e594bd1a5dc3553ea1388f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19c8d6747e594bd1a5dc3553ea1388f7" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 41785 } } }
I20260809 13:07:47.699575 23851 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19c8d6747e594bd1a5dc3553ea1388f7 [sys.catalog]: This master's current role is: LEADER
I20260809 13:07:47.699738 23852 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19c8d6747e594bd1a5dc3553ea1388f7 [sys.catalog]: This master's current role is: LEADER
I20260809 13:07:47.701288 23859 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:07:47.706825 23859 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:07:47.717200 23859 catalog_manager.cc:1347] Generated new cluster ID: 33efc3b9ae534dd38344f73a6aa3928e
I20260809 13:07:47.717435 23859 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:07:47.757688 23859 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:07:47.759733 23859 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:07:47.770653 23859 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 19c8d6747e594bd1a5dc3553ea1388f7: Generated new TSK 0
I20260809 13:07:47.771920 23859 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
I20260809 13:07:47.864945 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:0
--local_ip_for_outbound_sockets=127.28.155.193
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:41785
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:42497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:07:48.241398 23880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:07:48.241696 23880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:07:48.241796 23880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:07:48.249408 23880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:07:48.249533 23880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:07:48.249655 23880 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:07:48.259986 23880 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:42497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:41785
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:07:48.261387 23880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:07:48.262742 23880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:07:48.277097 23886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:48.277115 23887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:48.277444 23890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:07:48.278463 23880 server_base.cc:1034] running on GCE node
I20260809 13:07:48.279204 23880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:07:48.280241 23880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:07:48.281451 23880 hybrid_clock.cc:648] HybridClock initialized: now 1786280868281398 us; error 41 us; skew 500 ppm
I20260809 13:07:48.281751 23880 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:07:48 dist-test-slave-jq4t krb5kdc[23728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280868, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:07:48.285006 23880 init.cc:377] Logged in from keytab as kudu/127.28.155.193@KRBTEST.COM (short username kudu)
I20260809 13:07:48.286571 23880 webserver.cc:460] Webserver started at http://127.28.155.193:38423/ using document root <none> and password file <none>
I20260809 13:07:48.287338 23880 fs_manager.cc:359] Metadata directory not provided
I20260809 13:07:48.287503 23880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:07:48.287868 23880 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:07:48.291123 23880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-0/data/instance:
uuid: "51c0583c75014f2e90c0e029b46772dd"
format_stamp: "Formatted at 2026-08-09 13:07:48 on dist-test-slave-jq4t"
server_key: "e49e25fb28a1b7c132d18479b9307942"
server_key_iv: "03492b841daf82bc951cb69f92397fc9"
server_key_version: "encryptionkey@0"
I20260809 13:07:48.291949 23880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance:
uuid: "51c0583c75014f2e90c0e029b46772dd"
format_stamp: "Formatted at 2026-08-09 13:07:48 on dist-test-slave-jq4t"
server_key: "e49e25fb28a1b7c132d18479b9307942"
server_key_iv: "03492b841daf82bc951cb69f92397fc9"
server_key_version: "encryptionkey@0"
I20260809 13:07:48.297747 23880 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260809 13:07:48.301426 23899 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:48.302768 23880 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:07:48.302960 23880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "51c0583c75014f2e90c0e029b46772dd"
format_stamp: "Formatted at 2026-08-09 13:07:48 on dist-test-slave-jq4t"
server_key: "e49e25fb28a1b7c132d18479b9307942"
server_key_iv: "03492b841daf82bc951cb69f92397fc9"
server_key_version: "encryptionkey@0"
I20260809 13:07:48.303184 23880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:07:48.318491 23880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:07:48.322988 23880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:07:48.323331 23880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:07:48.324493 23880 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:07:48.325968 23880 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:07:48.326082 23880 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:48.326248 23880 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:07:48.326333 23880 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:48.361866 23880 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:34489
I20260809 13:07:48.361927 24049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:34489 every 8 connection(s)
I20260809 13:07:48.363345 23880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:07:48.370841 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 23880
I20260809 13:07:48.371120 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance
I20260809 13:07:48.372079 29295 external_mini_cluster.cc:1428] Setting key ceb40fd1028b9deb18fbae53931a5368
Aug 09 13:07:48 dist-test-slave-jq4t krb5kdc[23728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280868, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:07:48.386783 24054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:48.366299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:33691 (local address 127.28.155.254:41785)
0809 13:07:48.366851 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:48.366858 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:48.367841 (+ 983us) server_negotiation.cc:407] Connection header received
0809 13:07:48.369838 (+ 1997us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:48.369843 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:48.369929 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:48.370038 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:48.372349 (+ 2311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:48.373312 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:48.375487 (+ 2175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:48.376047 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:48.376195 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:48.380348 (+ 4153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:48.380354 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:48.380357 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:07:48.380392 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:48.383317 (+ 2925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:48.384185 (+ 868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:48.384192 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:48.384195 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:48.384331 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:48.384845 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:48.384851 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:48.384854 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:48.385145 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:48.385317 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:48.386116 (+ 799us) server_negotiation.cc:299] Negotiation successful
0809 13:07:48.386378 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":258,"threads_started":1}
I20260809 13:07:48.387864 24055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:48.366871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41785 (local address 127.28.155.193:33691)
0809 13:07:48.367661 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:48.367710 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:48.369566 (+ 1856us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:48.370301 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:48.370313 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:48.371191 (+ 878us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:07:48.372123 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:48.372155 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:48.373519 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:48.373525 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:48.375305 (+ 1780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:48.375319 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:48.376302 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:48.376312 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:48.376677 (+ 365us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:48.377567 (+ 890us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:07:48.377593 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:07:48.380090 (+ 2497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:07:48.383537 (+ 3447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:07:48.383547 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:07:48.383569 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:07:48.384050 (+ 481us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:07:48.384460 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:07:48.384465 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:07:48.384468 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:07:48.384723 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:07:48.385291 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:07:48.385300 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:07:48.385706 (+ 406us) client_negotiation.cc:769] Sending connection context
0809 13:07:48.386002 (+ 296us) client_negotiation.cc:240] Negotiation successful
0809 13:07:48.386601 (+ 599us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":297,"threads_started":1}
I20260809 13:07:48.389772 24051 heartbeater.cc:347] Connected to a master server at 127.28.155.254:41785
I20260809 13:07:48.390134 24051 heartbeater.cc:464] Registering TS with master...
I20260809 13:07:48.390954 24051 heartbeater.cc:511] Master 127.28.155.254:41785 requested a full tablet report, sending...
I20260809 13:07:48.393278 23790 ts_manager.cc:194] Registered new tserver with Master: 51c0583c75014f2e90c0e029b46772dd (127.28.155.193:34489)
I20260809 13:07:48.394868 23790 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.193@KRBTEST.COM'} at 127.28.155.193:33691
WARNING: no policy specified for kudu/127.28.155.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
I20260809 13:07:48.448793 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:0
--local_ip_for_outbound_sockets=127.28.155.194
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:41785
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:42497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:07:48.809895 24061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:07:48.810209 24061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:07:48.810310 24061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:07:48.817943 24061 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:07:48.818079 24061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:07:48.818202 24061 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:07:48.828368 24061 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:42497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:41785
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:07:48.829747 24061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:07:48.831121 24061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:07:48.845728 24071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:48.845796 24067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:48.846021 24066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:07:48.846993 24061 server_base.cc:1034] running on GCE node
I20260809 13:07:48.847646 24061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:07:48.848613 24061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:07:48.849853 24061 hybrid_clock.cc:648] HybridClock initialized: now 1786280868849805 us; error 51 us; skew 500 ppm
I20260809 13:07:48.850195 24061 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:07:48 dist-test-slave-jq4t krb5kdc[23728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280868, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:07:48.857290 24061 init.cc:377] Logged in from keytab as kudu/127.28.155.194@KRBTEST.COM (short username kudu)
I20260809 13:07:48.858991 24061 webserver.cc:460] Webserver started at http://127.28.155.194:44483/ using document root <none> and password file <none>
I20260809 13:07:48.859670 24061 fs_manager.cc:359] Metadata directory not provided
I20260809 13:07:48.859778 24061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:07:48.860081 24061 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:07:48.863301 24061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-1/data/instance:
uuid: "9e5ac976fc41439c8b5929dcce53e4de"
format_stamp: "Formatted at 2026-08-09 13:07:48 on dist-test-slave-jq4t"
server_key: "6802520d74a0e65140e1522806bd8717"
server_key_iv: "da091b86611cb191d01fa12d25a0019a"
server_key_version: "encryptionkey@0"
I20260809 13:07:48.864061 24061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance:
uuid: "9e5ac976fc41439c8b5929dcce53e4de"
format_stamp: "Formatted at 2026-08-09 13:07:48 on dist-test-slave-jq4t"
server_key: "6802520d74a0e65140e1522806bd8717"
server_key_iv: "da091b86611cb191d01fa12d25a0019a"
server_key_version: "encryptionkey@0"
I20260809 13:07:48.869470 24061 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 13:07:48.873373 24081 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:48.874863 24061 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260809 13:07:48.875092 24061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "9e5ac976fc41439c8b5929dcce53e4de"
format_stamp: "Formatted at 2026-08-09 13:07:48 on dist-test-slave-jq4t"
server_key: "6802520d74a0e65140e1522806bd8717"
server_key_iv: "da091b86611cb191d01fa12d25a0019a"
server_key_version: "encryptionkey@0"
I20260809 13:07:48.875304 24061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:07:48.917935 24061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:07:48.922633 24061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:07:48.922911 24061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:07:48.923904 24061 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:07:48.925287 24061 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:07:48.925365 24061 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:48.925452 24061 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:07:48.925498 24061 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:48.960043 24061 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:43939
I20260809 13:07:48.960139 24224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:43939 every 8 connection(s)
I20260809 13:07:48.961483 24061 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:07:48.964373 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 24061
I20260809 13:07:48.964628 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance
I20260809 13:07:48.965229 29295 external_mini_cluster.cc:1428] Setting key 422878275e8acc7b6acb78022c97ad3d
Aug 09 13:07:48 dist-test-slave-jq4t krb5kdc[23728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280868, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:07:48.987277 24227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:48.964358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:38975 (local address 127.28.155.254:41785)
0809 13:07:48.964932 (+ 574us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:48.964939 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:48.966036 (+ 1097us) server_negotiation.cc:407] Connection header received
0809 13:07:48.968539 (+ 2503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:48.968551 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:48.968627 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:48.968713 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:48.970956 (+ 2243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:48.971736 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:48.974308 (+ 2572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:48.974782 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:48.974902 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:48.979780 (+ 4878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:48.979790 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:48.979798 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:07:48.979850 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:48.983290 (+ 3440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:48.984339 (+ 1049us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:48.984347 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:48.984353 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:48.984578 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:48.985072 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:48.985080 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:48.985086 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:48.985522 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:48.985671 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:48.986491 (+ 820us) server_negotiation.cc:299] Negotiation successful
0809 13:07:48.986776 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":434,"thread_start_us":288,"threads_started":1}
I20260809 13:07:48.987975 24230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:48.964952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41785 (local address 127.28.155.194:38975)
0809 13:07:48.965836 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:48.965883 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:48.968164 (+ 2281us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:48.969009 (+ 845us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:48.969025 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:48.969858 (+ 833us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:07:48.970748 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:48.970778 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:48.971906 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:48.971914 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:48.974130 (+ 2216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:48.974150 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:48.975043 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:48.975053 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:48.975389 (+ 336us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:48.976215 (+ 826us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:07:48.976252 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:07:48.979503 (+ 3251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:07:48.983482 (+ 3979us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:07:48.983494 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:07:48.983518 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:07:48.984170 (+ 652us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:07:48.984697 (+ 527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:07:48.984701 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:07:48.984703 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:07:48.984936 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:07:48.985666 (+ 730us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:07:48.985672 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:07:48.986049 (+ 377us) client_negotiation.cc:769] Sending connection context
0809 13:07:48.986300 (+ 251us) client_negotiation.cc:240] Negotiation successful
0809 13:07:48.986723 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":602,"thread_start_us":371,"threads_started":1}
I20260809 13:07:48.989675 24225 heartbeater.cc:347] Connected to a master server at 127.28.155.254:41785
I20260809 13:07:48.990039 24225 heartbeater.cc:464] Registering TS with master...
I20260809 13:07:48.990869 24225 heartbeater.cc:511] Master 127.28.155.254:41785 requested a full tablet report, sending...
I20260809 13:07:48.992599 23790 ts_manager.cc:194] Registered new tserver with Master: 9e5ac976fc41439c8b5929dcce53e4de (127.28.155.194:43939)
I20260809 13:07:48.993494 23790 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.194@KRBTEST.COM'} at 127.28.155.194:38975
WARNING: no policy specified for kudu/127.28.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
I20260809 13:07:49.041801 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:0
--local_ip_for_outbound_sockets=127.28.155.195
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:41785
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:42497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 13:07:49.398102 24051 heartbeater.cc:503] Master 127.28.155.254:41785 was elected leader, sending a full tablet report...
W20260809 13:07:49.420399 24233 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:07:49.420819 24233 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:07:49.420998 24233 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:07:49.428382 24233 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:07:49.428583 24233 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:07:49.428766 24233 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:07:49.438833 24233 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:42497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:41785
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:07:49.440248 24233 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:07:49.441687 24233 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:07:49.455529 24239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:49.455544 24244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:49.455535 24240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:07:49.456346 24233 server_base.cc:1034] running on GCE node
I20260809 13:07:49.457000 24233 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:07:49.457966 24233 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:07:49.459177 24233 hybrid_clock.cc:648] HybridClock initialized: now 1786280869459135 us; error 38 us; skew 500 ppm
I20260809 13:07:49.459509 24233 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:07:49 dist-test-slave-jq4t krb5kdc[23728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280869, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:07:49.462860 24233 init.cc:377] Logged in from keytab as kudu/127.28.155.195@KRBTEST.COM (short username kudu)
I20260809 13:07:49.464330 24233 webserver.cc:460] Webserver started at http://127.28.155.195:34601/ using document root <none> and password file <none>
I20260809 13:07:49.465075 24233 fs_manager.cc:359] Metadata directory not provided
I20260809 13:07:49.465183 24233 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:07:49.465464 24233 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:07:49.468402 24233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-2/data/instance:
uuid: "6696973a533b48cfbc6bec5490a000db"
format_stamp: "Formatted at 2026-08-09 13:07:49 on dist-test-slave-jq4t"
server_key: "4e085ecb98380d15f844e2f7b4863fc4"
server_key_iv: "641aa747e0a76d2d78879826aa0efbb7"
server_key_version: "encryptionkey@0"
I20260809 13:07:49.469213 24233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance:
uuid: "6696973a533b48cfbc6bec5490a000db"
format_stamp: "Formatted at 2026-08-09 13:07:49 on dist-test-slave-jq4t"
server_key: "4e085ecb98380d15f844e2f7b4863fc4"
server_key_iv: "641aa747e0a76d2d78879826aa0efbb7"
server_key_version: "encryptionkey@0"
I20260809 13:07:49.474510 24233 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 13:07:49.478260 24253 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:49.479765 24233 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 13:07:49.479940 24233 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "6696973a533b48cfbc6bec5490a000db"
format_stamp: "Formatted at 2026-08-09 13:07:49 on dist-test-slave-jq4t"
server_key: "4e085ecb98380d15f844e2f7b4863fc4"
server_key_iv: "641aa747e0a76d2d78879826aa0efbb7"
server_key_version: "encryptionkey@0"
I20260809 13:07:49.480162 24233 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:07:49.496542 24233 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:07:49.501283 24233 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:07:49.501611 24233 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:07:49.502643 24233 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:07:49.504103 24233 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:07:49.504181 24233 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:49.504318 24233 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:07:49.504400 24233 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:49.540747 24233 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:35513
I20260809 13:07:49.540802 24417 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:35513 every 8 connection(s)
I20260809 13:07:49.542366 24233 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:07:49.548619 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 24233
I20260809 13:07:49.548841 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance
I20260809 13:07:49.549479 29295 external_mini_cluster.cc:1428] Setting key 642274e1b212273fd26ec8dd9eac15ee
Aug 09 13:07:49 dist-test-slave-jq4t krb5kdc[23728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280869, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:07:49.564531 24421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:49.545153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:59899 (local address 127.28.155.254:41785)
0809 13:07:49.545635 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:49.545641 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:49.546716 (+ 1075us) server_negotiation.cc:407] Connection header received
0809 13:07:49.548878 (+ 2162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:49.548885 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:49.549014 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:49.549121 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:49.551200 (+ 2079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.552003 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.553704 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.554131 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.554275 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:49.558343 (+ 4068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:49.558348 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:49.558351 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:07:49.558394 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:49.561012 (+ 2618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:49.561796 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:49.561800 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:49.561803 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:49.561948 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:49.562440 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:49.562444 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:49.562446 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:49.562725 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:49.562915 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:49.563831 (+ 916us) server_negotiation.cc:299] Negotiation successful
0809 13:07:49.564086 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":225,"threads_started":1}
I20260809 13:07:49.565763 24422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:49.545782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:41785 (local address 127.28.155.195:59899)
0809 13:07:49.546546 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:49.546584 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:49.548458 (+ 1874us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:49.549425 (+ 967us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:49.549437 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:49.550240 (+ 803us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:07:49.551012 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:49.551035 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.552185 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.552189 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:49.553546 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:49.553559 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.554374 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.554382 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:49.554636 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:49.555354 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:07:49.555379 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:07:49.558108 (+ 2729us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:07:49.561162 (+ 3054us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:07:49.561171 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:07:49.561189 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:07:49.561650 (+ 461us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:07:49.562068 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:07:49.562073 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:07:49.562077 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:07:49.562296 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:07:49.562866 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:07:49.562876 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:07:49.563338 (+ 462us) client_negotiation.cc:769] Sending connection context
0809 13:07:49.563694 (+ 356us) client_negotiation.cc:240] Negotiation successful
0809 13:07:49.564277 (+ 583us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":295,"threads_started":1}
I20260809 13:07:49.567257 24419 heartbeater.cc:347] Connected to a master server at 127.28.155.254:41785
I20260809 13:07:49.567633 24419 heartbeater.cc:464] Registering TS with master...
I20260809 13:07:49.568470 24419 heartbeater.cc:511] Master 127.28.155.254:41785 requested a full tablet report, sending...
I20260809 13:07:49.570030 23790 ts_manager.cc:194] Registered new tserver with Master: 6696973a533b48cfbc6bec5490a000db (127.28.155.195:35513)
I20260809 13:07:49.570905 23790 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.195@KRBTEST.COM'} at 127.28.155.195:59899
I20260809 13:07:49.578392 29295 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 13:07:49.597188 24421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:49.583234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55668 (local address 127.28.155.254:41785)
0809 13:07:49.583434 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:49.583441 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:49.583874 (+ 433us) server_negotiation.cc:407] Connection header received
0809 13:07:49.584094 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:49.584099 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:49.584180 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:49.584288 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:49.585942 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.586732 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.588139 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.588639 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.588776 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:49.591349 (+ 2573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:49.591357 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:49.591366 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:07:49.591400 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:49.594075 (+ 2675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:49.594920 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:49.594926 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:49.594930 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:49.595073 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:49.595503 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:49.595508 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:49.595511 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:49.595892 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:49.596183 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:49.596592 (+ 409us) server_negotiation.cc:299] Negotiation successful
0809 13:07:49.596850 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 13:07:49.601328 23790 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55668:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 13:07:49.609184 23790 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:07:49.646746 24446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:49.626795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49210 (local address 127.28.155.195:35513)
0809 13:07:49.637444 (+ 10649us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:49.637453 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:49.638894 (+ 1441us) server_negotiation.cc:407] Connection header received
0809 13:07:49.639213 (+ 319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:49.639223 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:49.639459 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:49.639685 (+ 226us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:07:49.640280 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.641777 (+ 1497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.644303 (+ 2526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.645324 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.645553 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:49.645769 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:49.646075 (+ 306us) server_negotiation.cc:299] Negotiation successful
0809 13:07:49.646391 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10466,"thread_start_us":10297,"threads_started":1}
I20260809 13:07:49.647033 24443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:49.623762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60992 (local address 127.28.155.194:43939)
0809 13:07:49.635573 (+ 11811us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:49.635587 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:49.638155 (+ 2568us) server_negotiation.cc:407] Connection header received
0809 13:07:49.638309 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:49.638321 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:49.638618 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:49.638842 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:07:49.639565 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.641475 (+ 1910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.643736 (+ 2261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.645378 (+ 1642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.646211 (+ 833us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:49.646391 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:49.646468 (+ 77us) server_negotiation.cc:299] Negotiation successful
0809 13:07:49.646669 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11552,"thread_start_us":12230,"threads_started":1}
I20260809 13:07:49.647789 24444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:49.622998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:43939 (local address 127.0.0.1:60992)
0809 13:07:49.637981 (+ 14983us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:49.638004 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:49.638151 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:49.638852 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:49.638857 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:49.638881 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:07:49.639357 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:49.639370 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.641624 (+ 2254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.641629 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:49.643538 (+ 1909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:49.643553 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.645685 (+ 2132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.645693 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:49.645881 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:49.645917 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 13:07:49.646003 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 13:07:49.646624 (+ 621us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14823,"mutex_wait_us":438,"spinlock_wait_cycles":9728,"thread_start_us":8665,"threads_started":1}
I20260809 13:07:49.647887 24440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:49.622883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36160 (local address 127.28.155.193:34489)
0809 13:07:49.636934 (+ 14051us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:49.636945 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:49.636985 (+ 40us) server_negotiation.cc:407] Connection header received
0809 13:07:49.637115 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:49.637125 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:49.637445 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:49.637724 (+ 279us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:07:49.638972 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.640877 (+ 1905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.643965 (+ 3088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.645492 (+ 1527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.645708 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:49.645897 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:49.647316 (+ 1419us) server_negotiation.cc:299] Negotiation successful
0809 13:07:49.647529 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13872,"thread_start_us":13679,"threads_started":1}
I20260809 13:07:49.648379 24439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:49.626067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:35513 (local address 127.0.0.1:49210)
0809 13:07:49.638783 (+ 12716us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:49.638801 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:49.639021 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:49.639671 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:49.639676 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:49.639703 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:07:49.640049 (+ 346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:49.640059 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.641932 (+ 1873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.641938 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:49.644132 (+ 2194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:49.644143 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.645549 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.645555 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:49.645781 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:49.645855 (+ 74us) client_negotiation.cc:769] Sending connection context
0809 13:07:49.646024 (+ 169us) client_negotiation.cc:240] Negotiation successful
0809 13:07:49.646367 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12581,"mutex_wait_us":5,"thread_start_us":11583,"threads_started":1}
I20260809 13:07:49.648887 24441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:49.622573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:34489 (local address 127.0.0.1:36160)
0809 13:07:49.632150 (+ 9577us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:49.632193 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:49.632392 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:49.638081 (+ 5689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:49.638090 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:49.638140 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:07:49.638724 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:49.638738 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.641052 (+ 2314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.641058 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:49.643773 (+ 2715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:49.643789 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.646611 (+ 2822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.646622 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:49.646822 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:49.646854 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 13:07:49.646947 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 13:07:49.647125 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9276,"mutex_wait_us":31,"spinlock_wait_cycles":7296,"thread_start_us":15905,"threads_started":1}
I20260809 13:07:49.652748 24141 tablet_service.cc:1467] Processing CreateTablet for tablet ba404d7a95144b0db8ade5c7dcc1d9c2 (DEFAULT_TABLE table=test-table [id=0bcdba6d2f004eb3be1c8e7e5e35aa6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:07:49.653023 24328 tablet_service.cc:1467] Processing CreateTablet for tablet ba404d7a95144b0db8ade5c7dcc1d9c2 (DEFAULT_TABLE table=test-table [id=0bcdba6d2f004eb3be1c8e7e5e35aa6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:07:49.654592 24328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba404d7a95144b0db8ade5c7dcc1d9c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:07:49.654593 24141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba404d7a95144b0db8ade5c7dcc1d9c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:07:49.655639 23970 tablet_service.cc:1467] Processing CreateTablet for tablet ba404d7a95144b0db8ade5c7dcc1d9c2 (DEFAULT_TABLE table=test-table [id=0bcdba6d2f004eb3be1c8e7e5e35aa6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:07:49.657307 23970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba404d7a95144b0db8ade5c7dcc1d9c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:07:49.673148 24448 tablet_bootstrap.cc:492] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db: Bootstrap starting.
I20260809 13:07:49.675575 24450 tablet_bootstrap.cc:492] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd: Bootstrap starting.
I20260809 13:07:49.676043 24447 tablet_bootstrap.cc:492] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 9e5ac976fc41439c8b5929dcce53e4de: Bootstrap starting.
I20260809 13:07:49.679212 24450 tablet_bootstrap.cc:654] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd: Neither blocks nor log segments found. Creating new log.
I20260809 13:07:49.679811 24448 tablet_bootstrap.cc:654] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db: Neither blocks nor log segments found. Creating new log.
I20260809 13:07:49.679867 24447 tablet_bootstrap.cc:654] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 9e5ac976fc41439c8b5929dcce53e4de: Neither blocks nor log segments found. Creating new log.
I20260809 13:07:49.680604 24450 log.cc:824] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd: Log is configured to *not* fsync() on all Append() calls
I20260809 13:07:49.681241 24447 log.cc:824] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 9e5ac976fc41439c8b5929dcce53e4de: Log is configured to *not* fsync() on all Append() calls
I20260809 13:07:49.681216 24448 log.cc:824] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db: Log is configured to *not* fsync() on all Append() calls
I20260809 13:07:49.687171 24450 tablet_bootstrap.cc:492] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd: No bootstrap required, opened a new log
I20260809 13:07:49.687407 24447 tablet_bootstrap.cc:492] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 9e5ac976fc41439c8b5929dcce53e4de: No bootstrap required, opened a new log
I20260809 13:07:49.687448 24448 tablet_bootstrap.cc:492] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db: No bootstrap required, opened a new log
I20260809 13:07:49.687567 24450 ts_tablet_manager.cc:1397] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.003s
I20260809 13:07:49.687721 24448 ts_tablet_manager.cc:1397] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.006s
I20260809 13:07:49.687769 24447 ts_tablet_manager.cc:1397] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 9e5ac976fc41439c8b5929dcce53e4de: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.004s
I20260809 13:07:49.695658 24450 raft_consensus.cc:348] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c0583c75014f2e90c0e029b46772dd" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34489 } } peers { permanent_uuid: "9e5ac976fc41439c8b5929dcce53e4de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 43939 } } peers { permanent_uuid: "6696973a533b48cfbc6bec5490a000db" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 35513 } }
I20260809 13:07:49.696178 24450 raft_consensus.cc:374] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:07:49.696343 24450 raft_consensus.cc:729] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51c0583c75014f2e90c0e029b46772dd, State: Initialized, Role: FOLLOWER
I20260809 13:07:49.697054 24450 consensus_queue.cc:260] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c0583c75014f2e90c0e029b46772dd" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34489 } } peers { permanent_uuid: "9e5ac976fc41439c8b5929dcce53e4de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 43939 } } peers { permanent_uuid: "6696973a533b48cfbc6bec5490a000db" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 35513 } }
I20260809 13:07:49.699095 24450 ts_tablet_manager.cc:1428] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260809 13:07:49.699277 24448 raft_consensus.cc:348] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c0583c75014f2e90c0e029b46772dd" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34489 } } peers { permanent_uuid: "9e5ac976fc41439c8b5929dcce53e4de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 43939 } } peers { permanent_uuid: "6696973a533b48cfbc6bec5490a000db" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 35513 } }
I20260809 13:07:49.699280 24447 raft_consensus.cc:348] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 9e5ac976fc41439c8b5929dcce53e4de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c0583c75014f2e90c0e029b46772dd" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34489 } } peers { permanent_uuid: "9e5ac976fc41439c8b5929dcce53e4de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 43939 } } peers { permanent_uuid: "6696973a533b48cfbc6bec5490a000db" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 35513 } }
I20260809 13:07:49.699766 24447 raft_consensus.cc:374] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 9e5ac976fc41439c8b5929dcce53e4de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:07:49.699851 24448 raft_consensus.cc:374] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:07:49.699903 24447 raft_consensus.cc:729] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 9e5ac976fc41439c8b5929dcce53e4de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e5ac976fc41439c8b5929dcce53e4de, State: Initialized, Role: FOLLOWER
I20260809 13:07:49.699945 24448 raft_consensus.cc:729] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6696973a533b48cfbc6bec5490a000db, State: Initialized, Role: FOLLOWER
I20260809 13:07:49.700625 24448 consensus_queue.cc:260] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c0583c75014f2e90c0e029b46772dd" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34489 } } peers { permanent_uuid: "9e5ac976fc41439c8b5929dcce53e4de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 43939 } } peers { permanent_uuid: "6696973a533b48cfbc6bec5490a000db" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 35513 } }
I20260809 13:07:49.700634 24447 consensus_queue.cc:260] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 9e5ac976fc41439c8b5929dcce53e4de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c0583c75014f2e90c0e029b46772dd" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34489 } } peers { permanent_uuid: "9e5ac976fc41439c8b5929dcce53e4de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 43939 } } peers { permanent_uuid: "6696973a533b48cfbc6bec5490a000db" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 35513 } }
I20260809 13:07:49.702373 24225 heartbeater.cc:503] Master 127.28.155.254:41785 was elected leader, sending a full tablet report...
I20260809 13:07:49.702425 24419 heartbeater.cc:503] Master 127.28.155.254:41785 was elected leader, sending a full tablet report...
I20260809 13:07:49.703030 24447 ts_tablet_manager.cc:1428] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 9e5ac976fc41439c8b5929dcce53e4de: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
I20260809 13:07:49.703914 24448 ts_tablet_manager.cc:1428] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db: Time spent starting tablet: real 0.016s user 0.005s sys 0.009s
W20260809 13:07:49.713792 24226 tablet.cc:2369] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 9e5ac976fc41439c8b5929dcce53e4de: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:07:49.733153 24455 raft_consensus.cc:482] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:07:49.733547 24455 raft_consensus.cc:504] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c0583c75014f2e90c0e029b46772dd" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34489 } } peers { permanent_uuid: "9e5ac976fc41439c8b5929dcce53e4de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 43939 } } peers { permanent_uuid: "6696973a533b48cfbc6bec5490a000db" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 35513 } }
I20260809 13:07:49.734180 24456 raft_consensus.cc:482] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:07:49.734489 24456 raft_consensus.cc:504] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c0583c75014f2e90c0e029b46772dd" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34489 } } peers { permanent_uuid: "9e5ac976fc41439c8b5929dcce53e4de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 43939 } } peers { permanent_uuid: "6696973a533b48cfbc6bec5490a000db" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 35513 } }
I20260809 13:07:49.736106 24455 leader_election.cc:288] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e5ac976fc41439c8b5929dcce53e4de (127.28.155.194:43939), 6696973a533b48cfbc6bec5490a000db (127.28.155.195:35513)
I20260809 13:07:49.737244 24456 leader_election.cc:288] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51c0583c75014f2e90c0e029b46772dd (127.28.155.193:34489), 9e5ac976fc41439c8b5929dcce53e4de (127.28.155.194:43939)
I20260809 13:07:49.758008 24422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:49.736945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:43939 (local address 127.28.155.195:49859)
0809 13:07:49.737170 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:49.737191 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:49.737349 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:49.749903 (+ 12554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:49.749914 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:49.749986 (+ 72us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:07:49.750292 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:49.750309 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.752951 (+ 2642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.752961 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:49.755202 (+ 2241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:49.755217 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.756995 (+ 1778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.757002 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:49.757400 (+ 398us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:49.757436 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 13:07:49.757522 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 13:07:49.757665 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":154}
I20260809 13:07:49.759490 24463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:49.737785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:49859 (local address 127.28.155.194:43939)
0809 13:07:49.749157 (+ 11372us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:49.749167 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:49.749210 (+ 43us) server_negotiation.cc:407] Connection header received
0809 13:07:49.749331 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:49.749340 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:49.749483 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:49.750517 (+ 1034us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:07:49.750933 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.752683 (+ 1750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.755386 (+ 2703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.756770 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.757325 (+ 555us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:49.757404 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:49.758915 (+ 1511us) server_negotiation.cc:299] Negotiation successful
0809 13:07:49.759081 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11145,"thread_start_us":11830,"threads_started":1}
I20260809 13:07:49.761080 24440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:49.753150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:38425 (local address 127.28.155.193:34489)
0809 13:07:49.753380 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:49.753387 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:49.753406 (+ 19us) server_negotiation.cc:407] Connection header received
0809 13:07:49.753485 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:49.753493 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:49.753576 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:49.753684 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:07:49.754534 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.755796 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.758423 (+ 2627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.759762 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.759969 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:49.760045 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:49.760638 (+ 593us) server_negotiation.cc:299] Negotiation successful
0809 13:07:49.760785 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":62,"server-negotiator.queue_time_us":56}
I20260809 13:07:49.760871 24171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba404d7a95144b0db8ade5c7dcc1d9c2" candidate_uuid: "6696973a533b48cfbc6bec5490a000db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e5ac976fc41439c8b5929dcce53e4de" is_pre_election: true
I20260809 13:07:49.761540 24458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:49.736349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:43939 (local address 127.28.155.193:58327)
0809 13:07:49.751920 (+ 15571us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:49.751979 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:49.753154 (+ 1175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:49.754183 (+ 1029us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:49.754190 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:49.754222 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:07:49.754640 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:49.754657 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.755962 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.755968 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:49.758273 (+ 2305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:49.758289 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.760171 (+ 1882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.760177 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:49.760366 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:49.760403 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 13:07:49.760926 (+ 523us) client_negotiation.cc:240] Negotiation successful
0809 13:07:49.761076 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15343,"mutex_wait_us":4,"thread_start_us":16370,"threads_started":1}
I20260809 13:07:49.761559 24171 raft_consensus.cc:2454] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 9e5ac976fc41439c8b5929dcce53e4de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6696973a533b48cfbc6bec5490a000db in term 0.
I20260809 13:07:49.762118 24443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:49.737736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:58327 (local address 127.28.155.194:43939)
0809 13:07:49.738294 (+ 558us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:49.738304 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:49.752111 (+ 13807us) server_negotiation.cc:407] Connection header received
0809 13:07:49.753351 (+ 1240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:49.753373 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:49.753467 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:49.753537 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:07:49.754809 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.755790 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.758477 (+ 2687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.759781 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.759938 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:49.760011 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:49.760589 (+ 578us) server_negotiation.cc:299] Negotiation successful
0809 13:07:49.760757 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367}
I20260809 13:07:49.762153 24460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:49.737397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:34489 (local address 127.28.155.195:38425)
0809 13:07:49.752758 (+ 15361us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:49.752781 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:49.752930 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:49.753720 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:49.753728 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:49.753763 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:07:49.754281 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:49.754296 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.755992 (+ 1696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.755997 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:49.758233 (+ 2236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:49.758248 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.760198 (+ 1950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.760205 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:49.760405 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:49.760439 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 13:07:49.761542 (+ 1103us) client_negotiation.cc:240] Negotiation successful
0809 13:07:49.761708 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15199,"thread_start_us":14982,"threads_started":1}
I20260809 13:07:49.762585 24446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:49.736847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:51297 (local address 127.28.155.195:35513)
0809 13:07:49.737103 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:49.737111 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:49.753809 (+ 16698us) server_negotiation.cc:407] Connection header received
0809 13:07:49.754124 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:49.754130 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:49.754204 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:49.754302 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:07:49.755978 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.757259 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.760146 (+ 2887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.761437 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.761578 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:49.761667 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:49.762262 (+ 595us) server_negotiation.cc:299] Negotiation successful
0809 13:07:49.762404 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":83}
I20260809 13:07:49.762828 24171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba404d7a95144b0db8ade5c7dcc1d9c2" candidate_uuid: "51c0583c75014f2e90c0e029b46772dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e5ac976fc41439c8b5929dcce53e4de" is_pre_election: true
I20260809 13:07:49.763038 24171 raft_consensus.cc:2454] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 9e5ac976fc41439c8b5929dcce53e4de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51c0583c75014f2e90c0e029b46772dd in term 0.
I20260809 13:07:49.762991 24257 leader_election.cc:302] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6696973a533b48cfbc6bec5490a000db, 9e5ac976fc41439c8b5929dcce53e4de; no voters:
I20260809 13:07:49.763468 24461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:49.736349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:35513 (local address 127.28.155.193:51297)
0809 13:07:49.753715 (+ 17366us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:49.753733 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:49.753930 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:49.754449 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:49.754455 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:49.754483 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:07:49.755792 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:49.755802 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.757545 (+ 1743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.757553 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:49.759956 (+ 2403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:49.759971 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.761870 (+ 1899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.761878 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:49.762065 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:49.762102 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 13:07:49.762868 (+ 766us) client_negotiation.cc:240] Negotiation successful
0809 13:07:49.763014 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17223,"mutex_wait_us":1647,"thread_start_us":15910,"threads_started":1}
I20260809 13:07:49.763273 23995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba404d7a95144b0db8ade5c7dcc1d9c2" candidate_uuid: "6696973a533b48cfbc6bec5490a000db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c0583c75014f2e90c0e029b46772dd" is_pre_election: true
I20260809 13:07:49.763531 24456 raft_consensus.cc:2781] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:07:49.763686 24456 raft_consensus.cc:482] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:07:49.763639 23903 leader_election.cc:302] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51c0583c75014f2e90c0e029b46772dd, 9e5ac976fc41439c8b5929dcce53e4de; no voters:
I20260809 13:07:49.763808 24456 raft_consensus.cc:3037] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:07:49.763792 23995 raft_consensus.cc:2454] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6696973a533b48cfbc6bec5490a000db in term 0.
I20260809 13:07:49.764605 24455 raft_consensus.cc:2781] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:07:49.764508 24352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba404d7a95144b0db8ade5c7dcc1d9c2" candidate_uuid: "51c0583c75014f2e90c0e029b46772dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6696973a533b48cfbc6bec5490a000db" is_pre_election: true
I20260809 13:07:49.764775 24455 raft_consensus.cc:482] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:07:49.764878 24455 raft_consensus.cc:3037] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:07:49.767522 24456 raft_consensus.cc:504] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c0583c75014f2e90c0e029b46772dd" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34489 } } peers { permanent_uuid: "9e5ac976fc41439c8b5929dcce53e4de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 43939 } } peers { permanent_uuid: "6696973a533b48cfbc6bec5490a000db" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 35513 } }
I20260809 13:07:49.768096 24352 raft_consensus.cc:2379] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51c0583c75014f2e90c0e029b46772dd in current term 1: Already voted for candidate 6696973a533b48cfbc6bec5490a000db in this term.
I20260809 13:07:49.768141 24455 raft_consensus.cc:504] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c0583c75014f2e90c0e029b46772dd" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34489 } } peers { permanent_uuid: "9e5ac976fc41439c8b5929dcce53e4de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 43939 } } peers { permanent_uuid: "6696973a533b48cfbc6bec5490a000db" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 35513 } }
I20260809 13:07:49.768641 24456 leader_election.cc:288] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db [CANDIDATE]: Term 1 election: Requested vote from peers 51c0583c75014f2e90c0e029b46772dd (127.28.155.193:34489), 9e5ac976fc41439c8b5929dcce53e4de (127.28.155.194:43939)
I20260809 13:07:49.769212 23995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba404d7a95144b0db8ade5c7dcc1d9c2" candidate_uuid: "6696973a533b48cfbc6bec5490a000db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c0583c75014f2e90c0e029b46772dd"
I20260809 13:07:49.769316 24171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba404d7a95144b0db8ade5c7dcc1d9c2" candidate_uuid: "6696973a533b48cfbc6bec5490a000db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e5ac976fc41439c8b5929dcce53e4de"
I20260809 13:07:49.769559 23995 raft_consensus.cc:2379] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6696973a533b48cfbc6bec5490a000db in current term 1: Already voted for candidate 51c0583c75014f2e90c0e029b46772dd in this term.
I20260809 13:07:49.769563 24171 raft_consensus.cc:3037] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 9e5ac976fc41439c8b5929dcce53e4de [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:07:49.769237 24455 leader_election.cc:288] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd [CANDIDATE]: Term 1 election: Requested vote from peers 9e5ac976fc41439c8b5929dcce53e4de (127.28.155.194:43939), 6696973a533b48cfbc6bec5490a000db (127.28.155.195:35513)
I20260809 13:07:49.770107 24351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba404d7a95144b0db8ade5c7dcc1d9c2" candidate_uuid: "51c0583c75014f2e90c0e029b46772dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6696973a533b48cfbc6bec5490a000db"
I20260809 13:07:49.770437 24351 raft_consensus.cc:2379] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 51c0583c75014f2e90c0e029b46772dd in current term 1: Already voted for candidate 6696973a533b48cfbc6bec5490a000db in this term.
I20260809 13:07:49.770270 24169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba404d7a95144b0db8ade5c7dcc1d9c2" candidate_uuid: "51c0583c75014f2e90c0e029b46772dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e5ac976fc41439c8b5929dcce53e4de"
I20260809 13:07:49.771267 23903 leader_election.cc:302] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51c0583c75014f2e90c0e029b46772dd; no voters: 6696973a533b48cfbc6bec5490a000db, 9e5ac976fc41439c8b5929dcce53e4de
I20260809 13:07:49.771602 24455 raft_consensus.cc:2726] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260809 13:07:49.772825 24171 raft_consensus.cc:2454] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 9e5ac976fc41439c8b5929dcce53e4de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6696973a533b48cfbc6bec5490a000db in term 1.
I20260809 13:07:49.773342 24257 leader_election.cc:302] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6696973a533b48cfbc6bec5490a000db, 9e5ac976fc41439c8b5929dcce53e4de; no voters: 51c0583c75014f2e90c0e029b46772dd
I20260809 13:07:49.773703 24456 raft_consensus.cc:2781] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:07:49.774200 24456 raft_consensus.cc:686] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db [term 1 LEADER]: Becoming Leader. State: Replica: 6696973a533b48cfbc6bec5490a000db, State: Running, Role: LEADER
I20260809 13:07:49.774821 24456 consensus_queue.cc:237] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c0583c75014f2e90c0e029b46772dd" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34489 } } peers { permanent_uuid: "9e5ac976fc41439c8b5929dcce53e4de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 43939 } } peers { permanent_uuid: "6696973a533b48cfbc6bec5490a000db" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 35513 } }
I20260809 13:07:49.779829 23789 catalog_manager.cc:5495] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db reported cstate change: term changed from 0 to 1, leader changed from <none> to 6696973a533b48cfbc6bec5490a000db (127.28.155.195). New cstate: current_term: 1 leader_uuid: "6696973a533b48cfbc6bec5490a000db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c0583c75014f2e90c0e029b46772dd" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e5ac976fc41439c8b5929dcce53e4de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 43939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6696973a533b48cfbc6bec5490a000db" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 35513 } health_report { overall_health: HEALTHY } } }
W20260809 13:07:49.794205 24420 tablet.cc:2369] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:07:49.831471 24446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:49.825809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49214 (local address 127.28.155.195:35513)
0809 13:07:49.826006 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:49.826011 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:49.826031 (+ 20us) server_negotiation.cc:407] Connection header received
0809 13:07:49.826218 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:49.826222 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:49.826320 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:49.826474 (+ 154us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:07:49.826813 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.827639 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.829215 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.829659 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.829766 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:49.830296 (+ 530us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:07:49.830868 (+ 572us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:07:49.830983 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:49.831144 (+ 161us) server_negotiation.cc:299] Negotiation successful
0809 13:07:49.831220 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 13:07:49.840314 24171 raft_consensus.cc:1261] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 9e5ac976fc41439c8b5929dcce53e4de [term 1 FOLLOWER]: Refusing update from remote peer 6696973a533b48cfbc6bec5490a000db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:07:49.840335 23995 raft_consensus.cc:1261] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd [term 1 FOLLOWER]: Refusing update from remote peer 6696973a533b48cfbc6bec5490a000db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:07:49.841280 24464 consensus_queue.cc:1035] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e5ac976fc41439c8b5929dcce53e4de" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 43939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:07:49.841741 24456 consensus_queue.cc:1035] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db [LEADER]: Connected to new peer: Peer: permanent_uuid: "51c0583c75014f2e90c0e029b46772dd" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:07:49.856364 24471 mvcc.cc:205] Tried to move back new op lower bound from 7316606442855161856 to 7316606442602192896. Current Snapshot: MvccSnapshot[applied={T|T < 7316606442855161856}]
I20260809 13:07:49.857120 24470 mvcc.cc:205] Tried to move back new op lower bound from 7316606442855161856 to 7316606442602192896. Current Snapshot: MvccSnapshot[applied={T|T < 7316606442855161856}]
I20260809 13:07:49.867863 23789 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55668:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:07:49.868206 23789 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55668:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:07:49.872274 23789 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 19c8d6747e594bd1a5dc3553ea1388f7: Sending DeleteTablet for 3 replicas of tablet ba404d7a95144b0db8ade5c7dcc1d9c2
I20260809 13:07:49.873629 23970 tablet_service.cc:1514] Processing DeleteTablet for tablet ba404d7a95144b0db8ade5c7dcc1d9c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:07:49 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:36160
I20260809 13:07:49.873629 24328 tablet_service.cc:1514] Processing DeleteTablet for tablet ba404d7a95144b0db8ade5c7dcc1d9c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:07:49 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:49210
I20260809 13:07:49.873634 24141 tablet_service.cc:1514] Processing DeleteTablet for tablet ba404d7a95144b0db8ade5c7dcc1d9c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:07:49 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:60992
I20260809 13:07:49.876610 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 23880
I20260809 13:07:49.878093 24483 tablet_replica.cc:330] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 9e5ac976fc41439c8b5929dcce53e4de: stopping tablet replica
I20260809 13:07:49.878623 24483 raft_consensus.cc:2229] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 9e5ac976fc41439c8b5929dcce53e4de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:07:49.879220 24483 raft_consensus.cc:2258] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 9e5ac976fc41439c8b5929dcce53e4de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:07:49.880173 24481 tablet_replica.cc:330] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db: stopping tablet replica
I20260809 13:07:49.880743 24481 raft_consensus.cc:2229] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db [term 1 LEADER]: Raft consensus shutting down.
I20260809 13:07:49.881596 24481 raft_consensus.cc:2258] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:07:49.882131 24483 ts_tablet_manager.cc:1905] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 9e5ac976fc41439c8b5929dcce53e4de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:07:49.882488 24482 tablet_replica.cc:330] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd: stopping tablet replica
I20260809 13:07:49.882952 24482 raft_consensus.cc:2229] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:07:49.883620 24482 raft_consensus.cc:2258] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:07:49.886559 24482 ts_tablet_manager.cc:1905] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:07:49.888824 24481 ts_tablet_manager.cc:1905] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:07:49.889724 24483 ts_tablet_manager.cc:1918] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 9e5ac976fc41439c8b5929dcce53e4de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:07:49.889974 24483 log.cc:1196] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 9e5ac976fc41439c8b5929dcce53e4de: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-1/wal/wals/ba404d7a95144b0db8ade5c7dcc1d9c2
I20260809 13:07:49.890694 24483 ts_tablet_manager.cc:1939] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 9e5ac976fc41439c8b5929dcce53e4de: Deleting consensus metadata
I20260809 13:07:49.892915 23772 catalog_manager.cc:4841] TS 9e5ac976fc41439c8b5929dcce53e4de (127.28.155.194:43939): tablet ba404d7a95144b0db8ade5c7dcc1d9c2 (table test-table [id=0bcdba6d2f004eb3be1c8e7e5e35aa6e]) successfully deleted
I20260809 13:07:49.893590 24482 ts_tablet_manager.cc:1918] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:07:49.893849 24482 log.cc:1196] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-0/wal/wals/ba404d7a95144b0db8ade5c7dcc1d9c2
I20260809 13:07:49.894526 24482 ts_tablet_manager.cc:1939] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 51c0583c75014f2e90c0e029b46772dd: Deleting consensus metadata
I20260809 13:07:49.896552 23770 catalog_manager.cc:4841] TS 51c0583c75014f2e90c0e029b46772dd (127.28.155.193:34489): tablet ba404d7a95144b0db8ade5c7dcc1d9c2 (table test-table [id=0bcdba6d2f004eb3be1c8e7e5e35aa6e]) successfully deleted
I20260809 13:07:49.896658 24481 ts_tablet_manager.cc:1918] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:07:49.896833 24481 log.cc:1196] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786280548611909-29295-0/minicluster-data/ts-2/wal/wals/ba404d7a95144b0db8ade5c7dcc1d9c2
I20260809 13:07:49.897475 24481 ts_tablet_manager.cc:1939] T ba404d7a95144b0db8ade5c7dcc1d9c2 P 6696973a533b48cfbc6bec5490a000db: Deleting consensus metadata
I20260809 13:07:49.899310 23774 catalog_manager.cc:4841] TS 6696973a533b48cfbc6bec5490a000db (127.28.155.195:35513): tablet ba404d7a95144b0db8ade5c7dcc1d9c2 (table test-table [id=0bcdba6d2f004eb3be1c8e7e5e35aa6e]) successfully deleted
Aug 09 13:07:49 dist-test-slave-jq4t krb5kdc[23728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280867, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.193@KRBTEST.COM
I20260809 13:07:49.910914 24440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:49.879280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36162 (local address 127.28.155.193:34489)
0809 13:07:49.879498 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:49.879504 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:49.886329 (+ 6825us) server_negotiation.cc:407] Connection header received
0809 13:07:49.886606 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:49.886612 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:49.886706 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:49.886817 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:49.893846 (+ 7029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.895134 (+ 1288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.897393 (+ 2259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:49.898070 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:49.898214 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:49.904209 (+ 5995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:49.904223 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:49.904237 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:07:49.904274 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:49.907750 (+ 3476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:49.908701 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:49.908709 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:49.908711 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:49.908842 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:49.909292 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:49.909295 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:49.909297 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:49.909681 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:49.909916 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:49.910328 (+ 412us) server_negotiation.cc:299] Negotiation successful
0809 13:07:49.910531 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 13:07:49.911705 24044 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:07:50.047286 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 23880
I20260809 13:07:50.083729 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 24061
Aug 09 13:07:50 dist-test-slave-jq4t krb5kdc[23728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280867, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.194@KRBTEST.COM
I20260809 13:07:50.102253 24463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:50.084725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32772 (local address 127.28.155.194:43939)
0809 13:07:50.084946 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:50.084953 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:50.084975 (+ 22us) server_negotiation.cc:407] Connection header received
0809 13:07:50.085122 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:50.085129 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:50.085218 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:50.085337 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:50.086691 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:50.087840 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:50.089284 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:50.089929 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:50.090073 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:50.094974 (+ 4901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:50.094998 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:50.095021 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:07:50.095083 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:50.098999 (+ 3916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:50.099786 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:50.099797 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:50.099801 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:50.099964 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:50.100334 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:50.100340 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:50.100343 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:50.100980 (+ 637us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:50.101303 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:50.101611 (+ 308us) server_negotiation.cc:299] Negotiation successful
0809 13:07:50.101870 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 13:07:50.103070 24220 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:07:50.242129 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 24061
I20260809 13:07:50.266223 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 24233
Aug 09 13:07:50 dist-test-slave-jq4t krb5kdc[23728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280867, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.195@KRBTEST.COM
I20260809 13:07:50.286679 24446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:50.267172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49222 (local address 127.28.155.195:35513)
0809 13:07:50.267414 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:50.267422 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:50.267447 (+ 25us) server_negotiation.cc:407] Connection header received
0809 13:07:50.267717 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:50.267722 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:50.267793 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:50.267919 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:50.269452 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:50.270244 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:50.271673 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:50.272139 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:50.272310 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:50.277667 (+ 5357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:50.277694 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:50.277723 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:07:50.277775 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:50.282170 (+ 4395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:50.283193 (+ 1023us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:50.283206 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:50.283209 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:50.283440 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:50.284060 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:50.284066 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:50.284070 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:50.284821 (+ 751us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:50.285202 (+ 381us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:50.285759 (+ 557us) server_negotiation.cc:299] Negotiation successful
0809 13:07:50.286173 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260809 13:07:50.289336 24413 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:07:50.455622 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 24233
I20260809 13:07:50.482028 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 23748
I20260809 13:07:50.483326 23835 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:07:50.600304 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 23748
2026-08-09T13:07:50Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (5180 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-09T13:07:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:07:50Z Disabled control of system clock
I20260809 13:07:50.707062 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:33471
--webserver_interface=127.28.155.254
--webserver_port=0
--builtin_ntp_servers=127.28.155.212:35215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:33471
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 13:07:51.078739 24495 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:07:51.079059 24495 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:07:51.079243 24495 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:07:51.086771 24495 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:07:51.086938 24495 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:07:51.087007 24495 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:07:51.087108 24495 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:07:51.087174 24495 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:07:51.097034 24495 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:35215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:33471
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:33471
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:07:51.098506 24495 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:07:51.100447 24495 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:07:51.113147 24503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:51.113117 24505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:51.113188 24508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:07:51.114785 24495 server_base.cc:1034] running on GCE node
I20260809 13:07:51.115630 24495 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:07:51.117211 24495 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:07:51.118422 24495 hybrid_clock.cc:648] HybridClock initialized: now 1786280871118374 us; error 46 us; skew 500 ppm
I20260809 13:07:51.118821 24495 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 13:07:51.121434 24495 webserver.cc:460] Webserver started at http://127.28.155.254:38035/ using document root <none> and password file <none>
I20260809 13:07:51.122219 24495 fs_manager.cc:359] Metadata directory not provided
I20260809 13:07:51.122319 24495 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:07:51.122696 24495 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:07:51.125949 24495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "87c83de67a3e4f4cb6e162ca030b3a10"
format_stamp: "Formatted at 2026-08-09 13:07:51 on dist-test-slave-jq4t"
server_key: "5784f017a36578bb2e7cf8ccaca6d5a9"
server_key_iv: "d94320b7bf7d01a1dd559269274ed5c8"
server_key_version: "encryptionkey@0"
I20260809 13:07:51.126837 24495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "87c83de67a3e4f4cb6e162ca030b3a10"
format_stamp: "Formatted at 2026-08-09 13:07:51 on dist-test-slave-jq4t"
server_key: "5784f017a36578bb2e7cf8ccaca6d5a9"
server_key_iv: "d94320b7bf7d01a1dd559269274ed5c8"
server_key_version: "encryptionkey@0"
I20260809 13:07:51.132377 24495 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260809 13:07:51.136023 24517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:51.137527 24495 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:07:51.137735 24495 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "87c83de67a3e4f4cb6e162ca030b3a10"
format_stamp: "Formatted at 2026-08-09 13:07:51 on dist-test-slave-jq4t"
server_key: "5784f017a36578bb2e7cf8ccaca6d5a9"
server_key_iv: "d94320b7bf7d01a1dd559269274ed5c8"
server_key_version: "encryptionkey@0"
I20260809 13:07:51.137984 24495 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:07:51.164206 24495 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:07:51.165239 24495 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:07:51.165580 24495 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:07:51.185804 24495 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:33471
I20260809 13:07:51.185824 24588 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:33471 every 8 connection(s)
I20260809 13:07:51.187276 24495 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:07:51.191485 24590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:07:51.193485 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 24495
I20260809 13:07:51.193707 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:07:51.194247 29295 external_mini_cluster.cc:1428] Setting key 7daeda3d894f52910456d2e6868cff83
I20260809 13:07:51.206449 24590 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87c83de67a3e4f4cb6e162ca030b3a10: Bootstrap starting.
I20260809 13:07:51.210747 24590 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 87c83de67a3e4f4cb6e162ca030b3a10: Neither blocks nor log segments found. Creating new log.
I20260809 13:07:51.211920 24593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:51.196548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54888 (local address 127.28.155.254:33471)
0809 13:07:51.197836 (+ 1288us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:51.197852 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:51.197917 (+ 65us) server_negotiation.cc:407] Connection header received
0809 13:07:51.200428 (+ 2511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:51.200461 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:51.201114 (+ 653us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:51.201587 (+ 473us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:51.202165 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:51.204321 (+ 2156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:51.206015 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:51.207143 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:51.207343 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:51.208711 (+ 1368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:51.208723 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:51.208743 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:07:51.209514 (+ 771us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:51.209659 (+ 145us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:07:51.209695 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:51.209826 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:51.210124 (+ 298us) server_negotiation.cc:299] Negotiation successful
0809 13:07:51.210505 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":715,"thread_start_us":419,"threads_started":1}
I20260809 13:07:51.212226 24590 log.cc:824] T 00000000000000000000000000000000 P 87c83de67a3e4f4cb6e162ca030b3a10: Log is configured to *not* fsync() on all Append() calls
I20260809 13:07:51.216022 24590 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87c83de67a3e4f4cb6e162ca030b3a10: No bootstrap required, opened a new log
I20260809 13:07:51.224151 24590 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87c83de67a3e4f4cb6e162ca030b3a10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87c83de67a3e4f4cb6e162ca030b3a10" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 33471 } }
I20260809 13:07:51.224607 24590 raft_consensus.cc:374] T 00000000000000000000000000000000 P 87c83de67a3e4f4cb6e162ca030b3a10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:07:51.224737 24590 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87c83de67a3e4f4cb6e162ca030b3a10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87c83de67a3e4f4cb6e162ca030b3a10, State: Initialized, Role: FOLLOWER
I20260809 13:07:51.225452 24590 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87c83de67a3e4f4cb6e162ca030b3a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87c83de67a3e4f4cb6e162ca030b3a10" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 33471 } }
I20260809 13:07:51.225773 24590 raft_consensus.cc:388] T 00000000000000000000000000000000 P 87c83de67a3e4f4cb6e162ca030b3a10 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:07:51.225921 24590 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87c83de67a3e4f4cb6e162ca030b3a10 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:07:51.226121 24590 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87c83de67a3e4f4cb6e162ca030b3a10 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:07:51.228405 24590 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87c83de67a3e4f4cb6e162ca030b3a10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87c83de67a3e4f4cb6e162ca030b3a10" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 33471 } }
I20260809 13:07:51.229048 24590 leader_election.cc:302] T 00000000000000000000000000000000 P 87c83de67a3e4f4cb6e162ca030b3a10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 87c83de67a3e4f4cb6e162ca030b3a10; no voters:
I20260809 13:07:51.229907 24590 leader_election.cc:288] T 00000000000000000000000000000000 P 87c83de67a3e4f4cb6e162ca030b3a10 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:07:51.230079 24595 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87c83de67a3e4f4cb6e162ca030b3a10 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:07:51.231765 24595 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87c83de67a3e4f4cb6e162ca030b3a10 [term 1 LEADER]: Becoming Leader. State: Replica: 87c83de67a3e4f4cb6e162ca030b3a10, State: Running, Role: LEADER
I20260809 13:07:51.232578 24590 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87c83de67a3e4f4cb6e162ca030b3a10 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:07:51.232527 24595 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87c83de67a3e4f4cb6e162ca030b3a10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87c83de67a3e4f4cb6e162ca030b3a10" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 33471 } }
I20260809 13:07:51.238627 24597 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87c83de67a3e4f4cb6e162ca030b3a10 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "87c83de67a3e4f4cb6e162ca030b3a10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87c83de67a3e4f4cb6e162ca030b3a10" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 33471 } } }
I20260809 13:07:51.239156 24597 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87c83de67a3e4f4cb6e162ca030b3a10 [sys.catalog]: This master's current role is: LEADER
I20260809 13:07:51.238648 24598 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87c83de67a3e4f4cb6e162ca030b3a10 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87c83de67a3e4f4cb6e162ca030b3a10. Latest consensus state: current_term: 1 leader_uuid: "87c83de67a3e4f4cb6e162ca030b3a10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87c83de67a3e4f4cb6e162ca030b3a10" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 33471 } } }
I20260809 13:07:51.239699 24598 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87c83de67a3e4f4cb6e162ca030b3a10 [sys.catalog]: This master's current role is: LEADER
I20260809 13:07:51.240907 24606 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:07:51.246433 24606 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:07:51.256444 24606 catalog_manager.cc:1347] Generated new cluster ID: f5a25f74db5642c0bb5945d71ad21a82
I20260809 13:07:51.256677 24606 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:07:51.291765 24606 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:07:51.293613 24606 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:07:51.301918 24606 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 87c83de67a3e4f4cb6e162ca030b3a10: Generated new TSK 0
I20260809 13:07:51.302933 24606 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 13:07:51.320866 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:0
--local_ip_for_outbound_sockets=127.28.155.193
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:33471
--builtin_ntp_servers=127.28.155.212:35215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 13:07:51.699208 24616 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:07:51.699658 24616 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:07:51.699762 24616 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:07:51.707304 24616 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:07:51.707437 24616 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:07:51.707551 24616 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:07:51.717756 24616 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:35215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:33471
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:07:51.719276 24616 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:07:51.721431 24616 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:07:51.736014 24624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:51.735908 24625 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:51.735962 24629 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:07:51.742074 24616 server_base.cc:1034] running on GCE node
I20260809 13:07:51.742897 24616 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:07:51.744000 24616 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:07:51.745240 24616 hybrid_clock.cc:648] HybridClock initialized: now 1786280871745171 us; error 68 us; skew 500 ppm
I20260809 13:07:51.745589 24616 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 13:07:51.748001 24616 webserver.cc:460] Webserver started at http://127.28.155.193:44617/ using document root <none> and password file <none>
I20260809 13:07:51.748835 24616 fs_manager.cc:359] Metadata directory not provided
I20260809 13:07:51.748991 24616 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:07:51.749334 24616 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:07:51.752565 24616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-0/data/instance:
uuid: "00a5867b4f9042c4accfa6ca9441d1fb"
format_stamp: "Formatted at 2026-08-09 13:07:51 on dist-test-slave-jq4t"
server_key: "8103a254fb12650389533903382a34b5"
server_key_iv: "8ba604ec48bb03c0dd6345f45118e483"
server_key_version: "encryptionkey@0"
I20260809 13:07:51.753417 24616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance:
uuid: "00a5867b4f9042c4accfa6ca9441d1fb"
format_stamp: "Formatted at 2026-08-09 13:07:51 on dist-test-slave-jq4t"
server_key: "8103a254fb12650389533903382a34b5"
server_key_iv: "8ba604ec48bb03c0dd6345f45118e483"
server_key_version: "encryptionkey@0"
I20260809 13:07:51.758843 24616 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 13:07:51.762617 24636 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:51.763998 24616 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 13:07:51.764213 24616 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "00a5867b4f9042c4accfa6ca9441d1fb"
format_stamp: "Formatted at 2026-08-09 13:07:51 on dist-test-slave-jq4t"
server_key: "8103a254fb12650389533903382a34b5"
server_key_iv: "8ba604ec48bb03c0dd6345f45118e483"
server_key_version: "encryptionkey@0"
I20260809 13:07:51.764453 24616 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:07:51.783933 24616 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:07:51.784910 24616 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:07:51.785442 24616 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:07:51.786660 24616 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:07:51.788328 24616 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:07:51.788465 24616 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:51.788664 24616 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:07:51.788766 24616 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:51.824918 24616 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:39913
I20260809 13:07:51.825021 24792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:39913 every 8 connection(s)
I20260809 13:07:51.826391 24616 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:07:51.832332 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 24616
I20260809 13:07:51.832592 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance
I20260809 13:07:51.833153 29295 external_mini_cluster.cc:1428] Setting key ab29887ed1384f29a379132912001e9f
I20260809 13:07:51.836176 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:0
--local_ip_for_outbound_sockets=127.28.155.194
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:33471
--builtin_ntp_servers=127.28.155.212:35215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 13:07:51.840253 24795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:51.829247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:59647 (local address 127.28.155.254:33471)
0809 13:07:51.829756 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:51.829761 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:51.830784 (+ 1023us) server_negotiation.cc:407] Connection header received
0809 13:07:51.832903 (+ 2119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:51.832909 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:51.833028 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:51.833152 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:51.834473 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:51.835430 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:51.837255 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:51.837666 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:51.837804 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:51.839305 (+ 1501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:51.839310 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:51.839314 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:07:51.839332 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:51.839379 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:07:51.839391 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:51.839515 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:51.839745 (+ 230us) server_negotiation.cc:299] Negotiation successful
0809 13:07:51.839863 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":278,"threads_started":1}
I20260809 13:07:51.841298 24797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:51.829695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:33471 (local address 127.28.155.193:59647)
0809 13:07:51.830610 (+ 915us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:51.830647 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:51.832519 (+ 1872us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:51.833417 (+ 898us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:51.833425 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:51.833515 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:07:51.834289 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:51.834309 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:51.835601 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:51.835605 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:51.837099 (+ 1494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:51.837112 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:51.837916 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:51.837924 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:51.838157 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:51.838944 (+ 787us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 13:07:51.838948 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:07:51.839001 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 13:07:51.839097 (+ 96us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:07:51.839517 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:07:51.839532 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:07:51.839542 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 13:07:51.839732 (+ 190us) client_negotiation.cc:240] Negotiation successful
0809 13:07:51.840148 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":281,"threads_started":1}
I20260809 13:07:51.843102 24793 heartbeater.cc:347] Connected to a master server at 127.28.155.254:33471
I20260809 13:07:51.843430 24793 heartbeater.cc:464] Registering TS with master...
I20260809 13:07:51.844235 24793 heartbeater.cc:511] Master 127.28.155.254:33471 requested a full tablet report, sending...
I20260809 13:07:51.846644 24543 ts_manager.cc:194] Registered new tserver with Master: 00a5867b4f9042c4accfa6ca9441d1fb (127.28.155.193:39913)
I20260809 13:07:51.848842 24543 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.155.193:59647
W20260809 13:07:52.200140 24800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:07:52.200555 24800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:07:52.200734 24800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:07:52.208258 24800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:07:52.208431 24800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:07:52.208635 24800 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:07:52.218225 24800 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:35215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:33471
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:07:52.219671 24800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:07:52.221611 24800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:07:52.236966 24807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:52.237390 24806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:52.237636 24809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:07:52.237995 24800 server_base.cc:1034] running on GCE node
I20260809 13:07:52.238677 24800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:07:52.239746 24800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:07:52.240976 24800 hybrid_clock.cc:648] HybridClock initialized: now 1786280872240921 us; error 67 us; skew 500 ppm
I20260809 13:07:52.241315 24800 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 13:07:52.243796 24800 webserver.cc:460] Webserver started at http://127.28.155.194:32843/ using document root <none> and password file <none>
I20260809 13:07:52.244607 24800 fs_manager.cc:359] Metadata directory not provided
I20260809 13:07:52.244745 24800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:07:52.245080 24800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:07:52.248029 24800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-1/data/instance:
uuid: "52f89fb1a2e14a3aa389eed241ddeefd"
format_stamp: "Formatted at 2026-08-09 13:07:52 on dist-test-slave-jq4t"
server_key: "2a17a85df7658354931ae819d16b2b62"
server_key_iv: "a2701641e9d00019f2713065611b3f64"
server_key_version: "encryptionkey@0"
I20260809 13:07:52.248950 24800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance:
uuid: "52f89fb1a2e14a3aa389eed241ddeefd"
format_stamp: "Formatted at 2026-08-09 13:07:52 on dist-test-slave-jq4t"
server_key: "2a17a85df7658354931ae819d16b2b62"
server_key_iv: "a2701641e9d00019f2713065611b3f64"
server_key_version: "encryptionkey@0"
I20260809 13:07:52.254361 24800 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 13:07:52.258239 24819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:52.259593 24800 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 13:07:52.259789 24800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "52f89fb1a2e14a3aa389eed241ddeefd"
format_stamp: "Formatted at 2026-08-09 13:07:52 on dist-test-slave-jq4t"
server_key: "2a17a85df7658354931ae819d16b2b62"
server_key_iv: "a2701641e9d00019f2713065611b3f64"
server_key_version: "encryptionkey@0"
I20260809 13:07:52.260033 24800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:07:52.273650 24800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:07:52.274515 24800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:07:52.274845 24800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:07:52.275851 24800 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:07:52.277406 24800 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:07:52.277534 24800 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:52.277678 24800 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:07:52.277773 24800 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:52.313081 24800 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:42839
I20260809 13:07:52.313174 24980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:42839 every 8 connection(s)
I20260809 13:07:52.314507 24800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:07:52.323266 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 24800
I20260809 13:07:52.323479 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance
I20260809 13:07:52.324013 29295 external_mini_cluster.cc:1428] Setting key 003d8277dd4fa97eb930c233fb410148
I20260809 13:07:52.327419 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:0
--local_ip_for_outbound_sockets=127.28.155.195
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:33471
--builtin_ntp_servers=127.28.155.212:35215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 13:07:52.328053 24795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:52.317161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:40709 (local address 127.28.155.254:33471)
0809 13:07:52.317347 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:52.317351 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:52.318790 (+ 1439us) server_negotiation.cc:407] Connection header received
0809 13:07:52.320714 (+ 1924us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:52.320719 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:52.320796 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:52.320892 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:52.322002 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:52.322870 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:52.324790 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:52.325411 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:52.325600 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:52.327197 (+ 1597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:52.327202 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:52.327206 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:07:52.327223 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:52.327258 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:07:52.327270 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:52.327368 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:52.327609 (+ 241us) server_negotiation.cc:299] Negotiation successful
0809 13:07:52.327714 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":61}
I20260809 13:07:52.329264 24984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:52.317677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:33471 (local address 127.28.155.194:40709)
0809 13:07:52.318639 (+ 962us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:52.318683 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:52.320352 (+ 1669us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:52.321129 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:52.321137 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:52.321225 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:07:52.321810 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:52.321825 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:52.323029 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:52.323033 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:52.324627 (+ 1594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:52.324647 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:52.325665 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:52.325673 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:52.325930 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:52.326841 (+ 911us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 13:07:52.326844 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:07:52.326907 (+ 63us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 13:07:52.326988 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:07:52.327369 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:07:52.327382 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:07:52.327390 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 13:07:52.327597 (+ 207us) client_negotiation.cc:240] Negotiation successful
0809 13:07:52.328030 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":298,"threads_started":1}
I20260809 13:07:52.330739 24981 heartbeater.cc:347] Connected to a master server at 127.28.155.254:33471
I20260809 13:07:52.331079 24981 heartbeater.cc:464] Registering TS with master...
I20260809 13:07:52.331913 24981 heartbeater.cc:511] Master 127.28.155.254:33471 requested a full tablet report, sending...
I20260809 13:07:52.333636 24543 ts_manager.cc:194] Registered new tserver with Master: 52f89fb1a2e14a3aa389eed241ddeefd (127.28.155.194:42839)
I20260809 13:07:52.334656 24543 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.155.194:40709
W20260809 13:07:52.696897 24985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:07:52.697187 24985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:07:52.697347 24985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:07:52.704975 24985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:07:52.705091 24985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:07:52.705288 24985 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:07:52.714851 24985 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:35215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:33471
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:07:52.716310 24985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:07:52.718212 24985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:07:52.732740 24990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:52.732775 24991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:52.732699 24993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:07:52.734014 24985 server_base.cc:1034] running on GCE node
I20260809 13:07:52.734757 24985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:07:52.735853 24985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:07:52.737116 24985 hybrid_clock.cc:648] HybridClock initialized: now 1786280872737072 us; error 53 us; skew 500 ppm
I20260809 13:07:52.737488 24985 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 13:07:52.740245 24985 webserver.cc:460] Webserver started at http://127.28.155.195:36667/ using document root <none> and password file <none>
I20260809 13:07:52.741073 24985 fs_manager.cc:359] Metadata directory not provided
I20260809 13:07:52.741205 24985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:07:52.741572 24985 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:07:52.744891 24985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-2/data/instance:
uuid: "ee4e379fdd57424b84c80b60eacbb429"
format_stamp: "Formatted at 2026-08-09 13:07:52 on dist-test-slave-jq4t"
server_key: "28262fbc7fa556c629a521ae40fa0190"
server_key_iv: "c5d3cc1735cc399c5928724ac0c1971a"
server_key_version: "encryptionkey@0"
I20260809 13:07:52.745831 24985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance:
uuid: "ee4e379fdd57424b84c80b60eacbb429"
format_stamp: "Formatted at 2026-08-09 13:07:52 on dist-test-slave-jq4t"
server_key: "28262fbc7fa556c629a521ae40fa0190"
server_key_iv: "c5d3cc1735cc399c5928724ac0c1971a"
server_key_version: "encryptionkey@0"
I20260809 13:07:52.751391 24985 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 13:07:52.755034 25004 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:52.756425 24985 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 13:07:52.756656 24985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "ee4e379fdd57424b84c80b60eacbb429"
format_stamp: "Formatted at 2026-08-09 13:07:52 on dist-test-slave-jq4t"
server_key: "28262fbc7fa556c629a521ae40fa0190"
server_key_iv: "c5d3cc1735cc399c5928724ac0c1971a"
server_key_version: "encryptionkey@0"
I20260809 13:07:52.756887 24985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:07:52.782820 24985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:07:52.783749 24985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:07:52.784082 24985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:07:52.785182 24985 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:07:52.786744 24985 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:07:52.786867 24985 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:52.787004 24985 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:07:52.787091 24985 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:52.821808 24985 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:44305
I20260809 13:07:52.821882 25164 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:44305 every 8 connection(s)
I20260809 13:07:52.823225 24985 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:07:52.833698 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 24985
I20260809 13:07:52.833901 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance
I20260809 13:07:52.834373 29295 external_mini_cluster.cc:1428] Setting key 020c0596558f7cec038f0b846ad02bba
I20260809 13:07:52.837042 24795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:52.826214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:37645 (local address 127.28.155.254:33471)
0809 13:07:52.826398 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:52.826404 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:52.827940 (+ 1536us) server_negotiation.cc:407] Connection header received
0809 13:07:52.829898 (+ 1958us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:52.829904 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:52.830027 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:52.830146 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:52.831271 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:52.832038 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:52.833882 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:52.834375 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:52.834526 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:52.836105 (+ 1579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:52.836110 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:52.836113 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:07:52.836136 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:52.836178 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:07:52.836190 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:52.836289 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:52.836548 (+ 259us) server_negotiation.cc:299] Negotiation successful
0809 13:07:52.836654 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 13:07:52.838116 25168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:52.826812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:33471 (local address 127.28.155.195:37645)
0809 13:07:52.827756 (+ 944us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:52.827804 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:52.829611 (+ 1807us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:52.830405 (+ 794us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:52.830414 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:52.830501 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:07:52.831094 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:52.831112 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:52.832208 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:52.832212 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:52.833727 (+ 1515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:52.833740 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:52.834642 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:52.834650 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:52.834882 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:52.835748 (+ 866us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 13:07:52.835751 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:07:52.835810 (+ 59us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 13:07:52.835890 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:07:52.836291 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:07:52.836307 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:07:52.836316 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 13:07:52.836538 (+ 222us) client_negotiation.cc:240] Negotiation successful
0809 13:07:52.836983 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":318,"threads_started":1}
I20260809 13:07:52.839406 25165 heartbeater.cc:347] Connected to a master server at 127.28.155.254:33471
I20260809 13:07:52.839722 25165 heartbeater.cc:464] Registering TS with master...
I20260809 13:07:52.840538 25165 heartbeater.cc:511] Master 127.28.155.254:33471 requested a full tablet report, sending...
I20260809 13:07:52.841952 24543 ts_manager.cc:194] Registered new tserver with Master: ee4e379fdd57424b84c80b60eacbb429 (127.28.155.195:44305)
I20260809 13:07:52.842813 24543 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.155.195:37645
I20260809 13:07:52.849733 29295 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 13:07:52.852686 24793 heartbeater.cc:503] Master 127.28.155.254:33471 was elected leader, sending a full tablet report...
I20260809 13:07:52.860729 24795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:52.854215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54894 (local address 127.28.155.254:33471)
0809 13:07:52.854450 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:52.854458 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:52.854902 (+ 444us) server_negotiation.cc:407] Connection header received
0809 13:07:52.855127 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:52.855132 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:52.855210 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:52.855315 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:52.855873 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:52.856683 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:52.858159 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:52.858617 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:52.858755 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:52.859897 (+ 1142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:52.859901 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:52.859905 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:07:52.859925 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:52.859957 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:07:52.859969 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:52.860070 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:52.860246 (+ 176us) server_negotiation.cc:299] Negotiation successful
0809 13:07:52.860346 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 13:07:52.865095 24543 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54894:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 13:07:52.872202 24543 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:07:52.896021 25182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:52.885236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:44305 (local address 127.0.0.1:60382)
0809 13:07:52.887283 (+ 2047us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:52.887314 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:52.887536 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:52.888311 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:52.888318 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:52.888353 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:07:52.888945 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:52.888973 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:52.891214 (+ 2241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:52.891222 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:52.893612 (+ 2390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:52.893625 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:52.894997 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:52.895007 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:52.895211 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:52.895265 (+ 54us) client_negotiation.cc:769] Sending connection context
0809 13:07:52.895448 (+ 183us) client_negotiation.cc:240] Negotiation successful
0809 13:07:52.895661 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1849,"thread_start_us":2607,"threads_started":1}
I20260809 13:07:52.896044 25181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:52.885469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60382 (local address 127.28.155.195:44305)
0809 13:07:52.886159 (+ 690us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:52.886169 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:52.887452 (+ 1283us) server_negotiation.cc:407] Connection header received
0809 13:07:52.887760 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:52.887772 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:52.888051 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:52.888266 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:07:52.889230 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:52.891065 (+ 1835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:52.893811 (+ 2746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:52.894769 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:52.894997 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:52.895232 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:52.895497 (+ 265us) server_negotiation.cc:299] Negotiation successful
0809 13:07:52.895678 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":503,"thread_start_us":330,"threads_started":1}
I20260809 13:07:52.898090 25179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:52.885648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:42839 (local address 127.0.0.1:34446)
0809 13:07:52.888122 (+ 2474us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:52.888141 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:52.888268 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:52.890176 (+ 1908us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:52.890182 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:52.890208 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:07:52.890588 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:52.890603 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:52.892667 (+ 2064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:52.892673 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:52.894935 (+ 2262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:52.894951 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:52.897256 (+ 2305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:52.897262 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:52.897482 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:52.897516 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 13:07:52.897603 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 13:07:52.897763 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2336,"thread_start_us":1275,"threads_started":1}
I20260809 13:07:52.898746 25183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:52.886281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34446 (local address 127.28.155.194:42839)
0809 13:07:52.886827 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:52.886838 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:52.889676 (+ 2838us) server_negotiation.cc:407] Connection header received
0809 13:07:52.889808 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:52.889815 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:52.889993 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:52.890193 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:07:52.890816 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:52.892223 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:52.895181 (+ 2958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:52.896741 (+ 1560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:52.896906 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:52.897122 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:52.897946 (+ 824us) server_negotiation.cc:299] Negotiation successful
0809 13:07:52.898136 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":343,"threads_started":1}
I20260809 13:07:52.899320 25186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:52.888510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:39913 (local address 127.0.0.1:54676)
0809 13:07:52.889122 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:52.889138 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:52.889246 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:52.891463 (+ 2217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:52.891469 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:52.891502 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:07:52.891930 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:52.891943 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:52.893955 (+ 2012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:52.893962 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:52.896129 (+ 2167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:52.896144 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:52.898545 (+ 2401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:52.898552 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:52.898731 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:52.898774 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 13:07:52.898869 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 13:07:52.899027 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":349,"threads_started":1}
I20260809 13:07:52.900074 25185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:52.888304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54676 (local address 127.28.155.193:39913)
0809 13:07:52.890889 (+ 2585us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:52.890920 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:52.890950 (+ 30us) server_negotiation.cc:407] Connection header received
0809 13:07:52.891059 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:52.891067 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:52.891269 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:52.891463 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:07:52.892124 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:52.893765 (+ 1641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:52.896436 (+ 2671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:52.897998 (+ 1562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:52.898192 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:52.898405 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:52.899564 (+ 1159us) server_negotiation.cc:299] Negotiation successful
0809 13:07:52.899741 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2393,"thread_start_us":2250,"threads_started":1}
I20260809 13:07:52.900962 25068 tablet_service.cc:1467] Processing CreateTablet for tablet 574a7ef39be34bcaaf7068e5757b8294 (DEFAULT_TABLE table=test-table [id=cf9c08eaca854d1cb8c0e6d9fd3f1462]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:07:52.902518 24881 tablet_service.cc:1467] Processing CreateTablet for tablet 574a7ef39be34bcaaf7068e5757b8294 (DEFAULT_TABLE table=test-table [id=cf9c08eaca854d1cb8c0e6d9fd3f1462]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:07:52.903115 25068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 574a7ef39be34bcaaf7068e5757b8294. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:07:52.903244 24703 tablet_service.cc:1467] Processing CreateTablet for tablet 574a7ef39be34bcaaf7068e5757b8294 (DEFAULT_TABLE table=test-table [id=cf9c08eaca854d1cb8c0e6d9fd3f1462]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:07:52.903955 24881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 574a7ef39be34bcaaf7068e5757b8294. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:07:52.904464 24703 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 574a7ef39be34bcaaf7068e5757b8294. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:07:52.915886 25187 tablet_bootstrap.cc:492] T 574a7ef39be34bcaaf7068e5757b8294 P 00a5867b4f9042c4accfa6ca9441d1fb: Bootstrap starting.
I20260809 13:07:52.918866 25188 tablet_bootstrap.cc:492] T 574a7ef39be34bcaaf7068e5757b8294 P 52f89fb1a2e14a3aa389eed241ddeefd: Bootstrap starting.
I20260809 13:07:52.920220 25187 tablet_bootstrap.cc:654] T 574a7ef39be34bcaaf7068e5757b8294 P 00a5867b4f9042c4accfa6ca9441d1fb: Neither blocks nor log segments found. Creating new log.
I20260809 13:07:52.920858 25189 tablet_bootstrap.cc:492] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429: Bootstrap starting.
I20260809 13:07:52.921866 25187 log.cc:824] T 574a7ef39be34bcaaf7068e5757b8294 P 00a5867b4f9042c4accfa6ca9441d1fb: Log is configured to *not* fsync() on all Append() calls
I20260809 13:07:52.923079 25188 tablet_bootstrap.cc:654] T 574a7ef39be34bcaaf7068e5757b8294 P 52f89fb1a2e14a3aa389eed241ddeefd: Neither blocks nor log segments found. Creating new log.
I20260809 13:07:52.924321 25189 tablet_bootstrap.cc:654] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429: Neither blocks nor log segments found. Creating new log.
I20260809 13:07:52.924407 25188 log.cc:824] T 574a7ef39be34bcaaf7068e5757b8294 P 52f89fb1a2e14a3aa389eed241ddeefd: Log is configured to *not* fsync() on all Append() calls
I20260809 13:07:52.925581 25189 log.cc:824] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429: Log is configured to *not* fsync() on all Append() calls
I20260809 13:07:52.925710 25187 tablet_bootstrap.cc:492] T 574a7ef39be34bcaaf7068e5757b8294 P 00a5867b4f9042c4accfa6ca9441d1fb: No bootstrap required, opened a new log
I20260809 13:07:52.926086 25187 ts_tablet_manager.cc:1397] T 574a7ef39be34bcaaf7068e5757b8294 P 00a5867b4f9042c4accfa6ca9441d1fb: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260809 13:07:52.935822 25189 tablet_bootstrap.cc:492] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429: No bootstrap required, opened a new log
I20260809 13:07:52.935822 25188 tablet_bootstrap.cc:492] T 574a7ef39be34bcaaf7068e5757b8294 P 52f89fb1a2e14a3aa389eed241ddeefd: No bootstrap required, opened a new log
I20260809 13:07:52.936167 25188 ts_tablet_manager.cc:1397] T 574a7ef39be34bcaaf7068e5757b8294 P 52f89fb1a2e14a3aa389eed241ddeefd: Time spent bootstrapping tablet: real 0.018s user 0.011s sys 0.004s
I20260809 13:07:52.936220 25189 ts_tablet_manager.cc:1397] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.008s
I20260809 13:07:52.937922 25187 raft_consensus.cc:348] T 574a7ef39be34bcaaf7068e5757b8294 P 00a5867b4f9042c4accfa6ca9441d1fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4e379fdd57424b84c80b60eacbb429" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44305 } } peers { permanent_uuid: "52f89fb1a2e14a3aa389eed241ddeefd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 42839 } } peers { permanent_uuid: "00a5867b4f9042c4accfa6ca9441d1fb" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 39913 } }
I20260809 13:07:52.938339 25187 raft_consensus.cc:374] T 574a7ef39be34bcaaf7068e5757b8294 P 00a5867b4f9042c4accfa6ca9441d1fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:07:52.938452 25187 raft_consensus.cc:729] T 574a7ef39be34bcaaf7068e5757b8294 P 00a5867b4f9042c4accfa6ca9441d1fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00a5867b4f9042c4accfa6ca9441d1fb, State: Initialized, Role: FOLLOWER
I20260809 13:07:52.939142 25187 consensus_queue.cc:260] T 574a7ef39be34bcaaf7068e5757b8294 P 00a5867b4f9042c4accfa6ca9441d1fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4e379fdd57424b84c80b60eacbb429" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44305 } } peers { permanent_uuid: "52f89fb1a2e14a3aa389eed241ddeefd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 42839 } } peers { permanent_uuid: "00a5867b4f9042c4accfa6ca9441d1fb" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 39913 } }
I20260809 13:07:52.941224 25187 ts_tablet_manager.cc:1428] T 574a7ef39be34bcaaf7068e5757b8294 P 00a5867b4f9042c4accfa6ca9441d1fb: Time spent starting tablet: real 0.015s user 0.000s sys 0.014s
I20260809 13:07:52.947588 25188 raft_consensus.cc:348] T 574a7ef39be34bcaaf7068e5757b8294 P 52f89fb1a2e14a3aa389eed241ddeefd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4e379fdd57424b84c80b60eacbb429" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44305 } } peers { permanent_uuid: "52f89fb1a2e14a3aa389eed241ddeefd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 42839 } } peers { permanent_uuid: "00a5867b4f9042c4accfa6ca9441d1fb" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 39913 } }
I20260809 13:07:52.947587 25189 raft_consensus.cc:348] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4e379fdd57424b84c80b60eacbb429" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44305 } } peers { permanent_uuid: "52f89fb1a2e14a3aa389eed241ddeefd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 42839 } } peers { permanent_uuid: "00a5867b4f9042c4accfa6ca9441d1fb" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 39913 } }
I20260809 13:07:52.948113 25189 raft_consensus.cc:374] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:07:52.948113 25188 raft_consensus.cc:374] T 574a7ef39be34bcaaf7068e5757b8294 P 52f89fb1a2e14a3aa389eed241ddeefd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:07:52.948227 25188 raft_consensus.cc:729] T 574a7ef39be34bcaaf7068e5757b8294 P 52f89fb1a2e14a3aa389eed241ddeefd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52f89fb1a2e14a3aa389eed241ddeefd, State: Initialized, Role: FOLLOWER
I20260809 13:07:52.948227 25189 raft_consensus.cc:729] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee4e379fdd57424b84c80b60eacbb429, State: Initialized, Role: FOLLOWER
I20260809 13:07:52.948948 25189 consensus_queue.cc:260] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4e379fdd57424b84c80b60eacbb429" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44305 } } peers { permanent_uuid: "52f89fb1a2e14a3aa389eed241ddeefd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 42839 } } peers { permanent_uuid: "00a5867b4f9042c4accfa6ca9441d1fb" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 39913 } }
I20260809 13:07:52.948947 25188 consensus_queue.cc:260] T 574a7ef39be34bcaaf7068e5757b8294 P 52f89fb1a2e14a3aa389eed241ddeefd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4e379fdd57424b84c80b60eacbb429" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44305 } } peers { permanent_uuid: "52f89fb1a2e14a3aa389eed241ddeefd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 42839 } } peers { permanent_uuid: "00a5867b4f9042c4accfa6ca9441d1fb" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 39913 } }
I20260809 13:07:52.950278 24981 heartbeater.cc:503] Master 127.28.155.254:33471 was elected leader, sending a full tablet report...
I20260809 13:07:52.950881 25165 heartbeater.cc:503] Master 127.28.155.254:33471 was elected leader, sending a full tablet report...
I20260809 13:07:52.951227 25188 ts_tablet_manager.cc:1428] T 574a7ef39be34bcaaf7068e5757b8294 P 52f89fb1a2e14a3aa389eed241ddeefd: Time spent starting tablet: real 0.015s user 0.016s sys 0.000s
I20260809 13:07:52.951506 25189 ts_tablet_manager.cc:1428] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429: Time spent starting tablet: real 0.015s user 0.011s sys 0.004s
I20260809 13:07:52.984705 25197 raft_consensus.cc:482] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:07:52.985213 25197 raft_consensus.cc:504] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4e379fdd57424b84c80b60eacbb429" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44305 } } peers { permanent_uuid: "52f89fb1a2e14a3aa389eed241ddeefd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 42839 } } peers { permanent_uuid: "00a5867b4f9042c4accfa6ca9441d1fb" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 39913 } }
I20260809 13:07:52.987195 25197 leader_election.cc:288] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52f89fb1a2e14a3aa389eed241ddeefd (127.28.155.194:42839), 00a5867b4f9042c4accfa6ca9441d1fb (127.28.155.193:39913)
I20260809 13:07:52.993432 25168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:52.987659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:42839 (local address 127.28.155.195:45781)
0809 13:07:52.987907 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:52.987930 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:52.988082 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:52.988626 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:52.988635 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:52.988683 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:07:52.988913 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:52.988923 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:52.990076 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:52.990080 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:52.991445 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:52.991457 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:52.992624 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:52.992632 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:52.992824 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:52.992849 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 13:07:52.992975 (+ 126us) client_negotiation.cc:240] Negotiation successful
0809 13:07:52.993126 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79}
I20260809 13:07:52.993429 25183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:52.987824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:45781 (local address 127.28.155.194:42839)
0809 13:07:52.988076 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:52.988083 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:52.988108 (+ 25us) server_negotiation.cc:407] Connection header received
0809 13:07:52.988263 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:52.988269 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:52.988374 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:52.989059 (+ 685us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:07:52.989183 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:52.989883 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:52.991629 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:52.992408 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:52.992651 (+ 243us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:52.992732 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:52.992999 (+ 267us) server_negotiation.cc:299] Negotiation successful
0809 13:07:52.993141 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260809 13:07:52.994504 25200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:52.988124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:39913 (local address 127.28.155.195:33999)
0809 13:07:52.988920 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:52.988939 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:52.989091 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:52.989455 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:52.989460 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:52.989484 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:07:52.989823 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:52.989832 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:52.990870 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:52.990875 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:52.992370 (+ 1495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:52.992384 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:52.993801 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:52.993808 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:52.994014 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:52.994046 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 13:07:52.994159 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 13:07:52.994280 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":694,"thread_start_us":480,"threads_started":1}
I20260809 13:07:52.994707 25185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:52.988332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:33999 (local address 127.28.155.193:39913)
0809 13:07:52.988614 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:52.988623 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:52.989046 (+ 423us) server_negotiation.cc:407] Connection header received
0809 13:07:52.989246 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:52.989251 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:52.989336 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:52.989440 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:07:52.989994 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:52.990696 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:52.992625 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:52.993457 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:52.993664 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:52.993748 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:52.994299 (+ 551us) server_negotiation.cc:299] Negotiation successful
0809 13:07:52.994464 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 13:07:52.994834 24912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574a7ef39be34bcaaf7068e5757b8294" candidate_uuid: "ee4e379fdd57424b84c80b60eacbb429" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f89fb1a2e14a3aa389eed241ddeefd" is_pre_election: true
I20260809 13:07:52.995462 24912 raft_consensus.cc:2454] T 574a7ef39be34bcaaf7068e5757b8294 P 52f89fb1a2e14a3aa389eed241ddeefd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee4e379fdd57424b84c80b60eacbb429 in term 0.
I20260809 13:07:52.995673 24736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574a7ef39be34bcaaf7068e5757b8294" candidate_uuid: "ee4e379fdd57424b84c80b60eacbb429" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00a5867b4f9042c4accfa6ca9441d1fb" is_pre_election: true
I20260809 13:07:52.996284 24736 raft_consensus.cc:2454] T 574a7ef39be34bcaaf7068e5757b8294 P 00a5867b4f9042c4accfa6ca9441d1fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee4e379fdd57424b84c80b60eacbb429 in term 0.
I20260809 13:07:52.996327 25008 leader_election.cc:302] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52f89fb1a2e14a3aa389eed241ddeefd, ee4e379fdd57424b84c80b60eacbb429; no voters:
I20260809 13:07:52.996850 25197 raft_consensus.cc:2781] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:07:52.997033 25197 raft_consensus.cc:482] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:07:52.997159 25197 raft_consensus.cc:3037] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:07:52.999493 25197 raft_consensus.cc:504] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4e379fdd57424b84c80b60eacbb429" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44305 } } peers { permanent_uuid: "52f89fb1a2e14a3aa389eed241ddeefd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 42839 } } peers { permanent_uuid: "00a5867b4f9042c4accfa6ca9441d1fb" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 39913 } }
I20260809 13:07:53.000242 25197 leader_election.cc:288] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429 [CANDIDATE]: Term 1 election: Requested vote from peers 52f89fb1a2e14a3aa389eed241ddeefd (127.28.155.194:42839), 00a5867b4f9042c4accfa6ca9441d1fb (127.28.155.193:39913)
I20260809 13:07:53.000857 24912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574a7ef39be34bcaaf7068e5757b8294" candidate_uuid: "ee4e379fdd57424b84c80b60eacbb429" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f89fb1a2e14a3aa389eed241ddeefd"
I20260809 13:07:53.000929 24736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574a7ef39be34bcaaf7068e5757b8294" candidate_uuid: "ee4e379fdd57424b84c80b60eacbb429" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00a5867b4f9042c4accfa6ca9441d1fb"
I20260809 13:07:53.001101 24912 raft_consensus.cc:3037] T 574a7ef39be34bcaaf7068e5757b8294 P 52f89fb1a2e14a3aa389eed241ddeefd [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:07:53.001216 24736 raft_consensus.cc:3037] T 574a7ef39be34bcaaf7068e5757b8294 P 00a5867b4f9042c4accfa6ca9441d1fb [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:07:53.003595 24912 raft_consensus.cc:2454] T 574a7ef39be34bcaaf7068e5757b8294 P 52f89fb1a2e14a3aa389eed241ddeefd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4e379fdd57424b84c80b60eacbb429 in term 1.
I20260809 13:07:53.003639 24736 raft_consensus.cc:2454] T 574a7ef39be34bcaaf7068e5757b8294 P 00a5867b4f9042c4accfa6ca9441d1fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee4e379fdd57424b84c80b60eacbb429 in term 1.
I20260809 13:07:53.004065 25008 leader_election.cc:302] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52f89fb1a2e14a3aa389eed241ddeefd, ee4e379fdd57424b84c80b60eacbb429; no voters:
I20260809 13:07:53.004405 25197 raft_consensus.cc:2781] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:07:53.005000 25197 raft_consensus.cc:686] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429 [term 1 LEADER]: Becoming Leader. State: Replica: ee4e379fdd57424b84c80b60eacbb429, State: Running, Role: LEADER
I20260809 13:07:53.005646 25197 consensus_queue.cc:237] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4e379fdd57424b84c80b60eacbb429" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44305 } } peers { permanent_uuid: "52f89fb1a2e14a3aa389eed241ddeefd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 42839 } } peers { permanent_uuid: "00a5867b4f9042c4accfa6ca9441d1fb" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 39913 } }
I20260809 13:07:53.010787 24542 catalog_manager.cc:5495] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee4e379fdd57424b84c80b60eacbb429 (127.28.155.195). New cstate: current_term: 1 leader_uuid: "ee4e379fdd57424b84c80b60eacbb429" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee4e379fdd57424b84c80b60eacbb429" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "52f89fb1a2e14a3aa389eed241ddeefd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 42839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00a5867b4f9042c4accfa6ca9441d1fb" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 39913 } health_report { overall_health: UNKNOWN } } }
I20260809 13:07:53.052902 25181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:53.047444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60386 (local address 127.28.155.195:44305)
0809 13:07:53.047684 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:53.047689 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:53.047708 (+ 19us) server_negotiation.cc:407] Connection header received
0809 13:07:53.047872 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:53.047877 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:53.047968 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:53.048102 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:07:53.048461 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:53.049266 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:53.050697 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:53.051130 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:53.051222 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:53.051704 (+ 482us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:07:53.052277 (+ 573us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:07:53.052391 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:53.052543 (+ 152us) server_negotiation.cc:299] Negotiation successful
0809 13:07:53.052612 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260809 13:07:53.061522 24912 raft_consensus.cc:1261] T 574a7ef39be34bcaaf7068e5757b8294 P 52f89fb1a2e14a3aa389eed241ddeefd [term 1 FOLLOWER]: Refusing update from remote peer ee4e379fdd57424b84c80b60eacbb429: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:07:53.061509 24736 raft_consensus.cc:1261] T 574a7ef39be34bcaaf7068e5757b8294 P 00a5867b4f9042c4accfa6ca9441d1fb [term 1 FOLLOWER]: Refusing update from remote peer ee4e379fdd57424b84c80b60eacbb429: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:07:53.062525 25201 consensus_queue.cc:1035] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00a5867b4f9042c4accfa6ca9441d1fb" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 39913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:07:53.062968 25197 consensus_queue.cc:1035] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52f89fb1a2e14a3aa389eed241ddeefd" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 42839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 13:07:53.066705 24983 tablet.cc:2369] T 574a7ef39be34bcaaf7068e5757b8294 P 52f89fb1a2e14a3aa389eed241ddeefd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 13:07:53.075301 25166 tablet.cc:2369] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 13:07:53.079075 24794 tablet.cc:2369] T 574a7ef39be34bcaaf7068e5757b8294 P 00a5867b4f9042c4accfa6ca9441d1fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:07:53.081799 25208 mvcc.cc:205] Tried to move back new op lower bound from 7316606456048721920 to 7316606455835582464. Current Snapshot: MvccSnapshot[applied={T|T < 7316606456048721920}]
I20260809 13:07:53.084519 25206 mvcc.cc:205] Tried to move back new op lower bound from 7316606456048721920 to 7316606455835582464. Current Snapshot: MvccSnapshot[applied={T|T < 7316606456048721920}]
I20260809 13:07:53.093441 24542 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54894:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:07:53.093735 24542 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54894:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:07:53.097342 24542 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 87c83de67a3e4f4cb6e162ca030b3a10: Sending DeleteTablet for 3 replicas of tablet 574a7ef39be34bcaaf7068e5757b8294
I20260809 13:07:53.098838 25068 tablet_service.cc:1514] Processing DeleteTablet for tablet 574a7ef39be34bcaaf7068e5757b8294 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:07:53 UTC) from {username='slave'} at 127.0.0.1:60382
I20260809 13:07:53.098848 24881 tablet_service.cc:1514] Processing DeleteTablet for tablet 574a7ef39be34bcaaf7068e5757b8294 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:07:53 UTC) from {username='slave'} at 127.0.0.1:34446
I20260809 13:07:53.099634 24703 tablet_service.cc:1514] Processing DeleteTablet for tablet 574a7ef39be34bcaaf7068e5757b8294 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:07:53 UTC) from {username='slave'} at 127.0.0.1:54676
I20260809 13:07:53.099897 25220 tablet_replica.cc:330] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429: stopping tablet replica
I20260809 13:07:53.100422 25220 raft_consensus.cc:2229] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429 [term 1 LEADER]: Raft consensus shutting down.
I20260809 13:07:53.101316 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 24616
I20260809 13:07:53.101291 25220 raft_consensus.cc:2258] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:07:53.107832 25220 ts_tablet_manager.cc:1905] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:07:53.112697 25185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:53.102197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54692 (local address 127.28.155.193:39913)
0809 13:07:53.102376 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:53.102384 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:53.103126 (+ 742us) server_negotiation.cc:407] Connection header received
0809 13:07:53.103435 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:53.103444 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:53.103574 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:53.103667 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:53.104456 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:53.105912 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:53.107923 (+ 2011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:53.108862 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:53.108986 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:53.110610 (+ 1624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:53.110621 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:53.110637 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:07:53.111456 (+ 819us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:53.111523 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:07:53.111550 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:53.111632 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:53.111930 (+ 298us) server_negotiation.cc:299] Negotiation successful
0809 13:07:53.112111 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 13:07:53.114481 24788 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:07:53.120661 25220 ts_tablet_manager.cc:1918] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:07:53.120872 25220 log.cc:1196] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-2/wal/wals/574a7ef39be34bcaaf7068e5757b8294
I20260809 13:07:53.121392 25220 ts_tablet_manager.cc:1939] T 574a7ef39be34bcaaf7068e5757b8294 P ee4e379fdd57424b84c80b60eacbb429: Deleting consensus metadata
I20260809 13:07:53.123266 24523 catalog_manager.cc:4841] TS ee4e379fdd57424b84c80b60eacbb429 (127.28.155.195:44305): tablet 574a7ef39be34bcaaf7068e5757b8294 (table test-table [id=cf9c08eaca854d1cb8c0e6d9fd3f1462]) successfully deleted
I20260809 13:07:53.127933 25221 tablet_replica.cc:330] T 574a7ef39be34bcaaf7068e5757b8294 P 52f89fb1a2e14a3aa389eed241ddeefd: stopping tablet replica
I20260809 13:07:53.128594 25221 raft_consensus.cc:2229] T 574a7ef39be34bcaaf7068e5757b8294 P 52f89fb1a2e14a3aa389eed241ddeefd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:07:53.129261 25221 raft_consensus.cc:2258] T 574a7ef39be34bcaaf7068e5757b8294 P 52f89fb1a2e14a3aa389eed241ddeefd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:07:53.131513 25221 ts_tablet_manager.cc:1905] T 574a7ef39be34bcaaf7068e5757b8294 P 52f89fb1a2e14a3aa389eed241ddeefd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:07:53.138975 25221 ts_tablet_manager.cc:1918] T 574a7ef39be34bcaaf7068e5757b8294 P 52f89fb1a2e14a3aa389eed241ddeefd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:07:53.139180 25221 log.cc:1196] T 574a7ef39be34bcaaf7068e5757b8294 P 52f89fb1a2e14a3aa389eed241ddeefd: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786280548611909-29295-0/minicluster-data/ts-1/wal/wals/574a7ef39be34bcaaf7068e5757b8294
I20260809 13:07:53.139823 25221 ts_tablet_manager.cc:1939] T 574a7ef39be34bcaaf7068e5757b8294 P 52f89fb1a2e14a3aa389eed241ddeefd: Deleting consensus metadata
I20260809 13:07:53.142009 24521 catalog_manager.cc:4841] TS 52f89fb1a2e14a3aa389eed241ddeefd (127.28.155.194:42839): tablet 574a7ef39be34bcaaf7068e5757b8294 (table test-table [id=cf9c08eaca854d1cb8c0e6d9fd3f1462]) successfully deleted
I20260809 13:07:53.227397 25222 tablet_replica.cc:330] T 574a7ef39be34bcaaf7068e5757b8294 P 00a5867b4f9042c4accfa6ca9441d1fb: stopping tablet replica
I20260809 13:07:53.227587 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 24616
I20260809 13:07:53.260418 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 24800
W20260809 13:07:53.260561 24521 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.155.193:39913 (error 108)
I20260809 13:07:53.263060 25186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:53.262558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:39913 (local address 127.0.0.1:54696)
0809 13:07:53.262780 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:53.262914 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:39913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
W20260809 13:07:53.263412 24521 catalog_manager.cc:4584] TS 00a5867b4f9042c4accfa6ca9441d1fb (127.28.155.193:39913): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 574a7ef39be34bcaaf7068e5757b8294: Network error: Client connection negotiation failed: client connection to 127.28.155.193:39913: connect: Connection refused (error 111)
I20260809 13:07:53.269842 25183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:53.262115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34452 (local address 127.28.155.194:42839)
0809 13:07:53.262345 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:53.262352 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:53.262373 (+ 21us) server_negotiation.cc:407] Connection header received
0809 13:07:53.262443 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:53.262447 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:53.262542 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:53.262683 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:53.263399 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:53.264711 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:53.266135 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:53.266829 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:53.266969 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:53.268072 (+ 1103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:53.268084 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:53.268103 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:07:53.268976 (+ 873us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:53.269044 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:07:53.269080 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:53.269202 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:53.269320 (+ 118us) server_negotiation.cc:299] Negotiation successful
0809 13:07:53.269465 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 13:07:53.270643 24975 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:07:53.317348 25186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:53.316720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:39913 (local address 127.0.0.1:54710)
0809 13:07:53.316993 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:53.317118 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:39913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260809 13:07:53.318650 25186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:53.318213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:39913 (local address 127.0.0.1:54714)
0809 13:07:53.318392 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:53.318493 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:39913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260809 13:07:53.363373 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 24800
I20260809 13:07:53.379944 25186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:53.379143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:39913 (local address 127.0.0.1:54728)
0809 13:07:53.379559 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:53.379682 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:39913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":258}
I20260809 13:07:53.382028 25186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:53.381365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:39913 (local address 127.0.0.1:54740)
0809 13:07:53.381674 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:53.381797 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:39913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135}
I20260809 13:07:53.395882 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 24985
I20260809 13:07:53.404659 25181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:53.396966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60398 (local address 127.28.155.195:44305)
0809 13:07:53.397193 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:53.397200 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:53.397230 (+ 30us) server_negotiation.cc:407] Connection header received
0809 13:07:53.397314 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:53.397320 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:53.397449 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:53.397594 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:53.398046 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:53.399317 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:53.400798 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:53.401506 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:53.401677 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:53.402812 (+ 1135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:53.402825 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:53.402852 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:07:53.403772 (+ 920us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:53.403850 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:07:53.403878 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:53.404003 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:53.404097 (+ 94us) server_negotiation.cc:299] Negotiation successful
0809 13:07:53.404210 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 13:07:53.405601 25160 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:07:53.463423 25186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:53.462843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:39913 (local address 127.0.0.1:54746)
0809 13:07:53.463117 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:53.463211 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:39913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260809 13:07:53.464612 25186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:53.464134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:39913 (local address 127.0.0.1:54748)
0809 13:07:53.464350 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:53.464424 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:39913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260809 13:07:53.538837 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 24985
I20260809 13:07:53.575942 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 24495
I20260809 13:07:53.577533 24584 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:07:53.698040 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 24495
2026-08-09T13:07:53Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (3090 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:07:53 dist-test-slave-jq4t krb5kdc[25236](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:07:53 dist-test-slave-jq4t krb5kdc[25236](info): set up 2 sockets
Aug 09 13:07:53 dist-test-slave-jq4t krb5kdc[25236](info): commencing operation
krb5kdc: starting...
W20260809 13:07:55.028214 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.000s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:07:55 dist-test-slave-jq4t krb5kdc[25236](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280875, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:07:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:07:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
I20260809 13:07:55.359755 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:37431
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:45905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:37431
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:07:55.726531 25254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:07:55.726847 25254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:07:55.727041 25254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:07:55.734972 25254 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:07:55.735103 25254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:07:55.735225 25254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:07:55.735334 25254 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:07:55.735425 25254 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:07:55.745905 25254 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:45905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:37431
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:37431
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:07:55.747586 25254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:07:55.749043 25254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:07:55.761745 25262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:55.761785 25271 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:55.761816 25265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:07:55.763039 25254 server_base.cc:1034] running on GCE node
I20260809 13:07:55.763922 25254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:07:55.765511 25254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:07:55.766763 25254 hybrid_clock.cc:648] HybridClock initialized: now 1786280875766707 us; error 58 us; skew 500 ppm
I20260809 13:07:55.767130 25254 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:07:55 dist-test-slave-jq4t krb5kdc[25236](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280875, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:07:55.774282 25254 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:07:55.776023 25254 webserver.cc:460] Webserver started at http://127.28.155.254:36777/ using document root <none> and password file <none>
I20260809 13:07:55.776876 25254 fs_manager.cc:359] Metadata directory not provided
I20260809 13:07:55.776994 25254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:07:55.777267 25254 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:07:55.780526 25254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "9a63ece176a04d419aee517c92905ef8"
format_stamp: "Formatted at 2026-08-09 13:07:55 on dist-test-slave-jq4t"
server_key: "7477383c2503776372bb9f0210453597"
server_key_iv: "1e21b842882d12b74d63a9ae3bb542b4"
server_key_version: "encryptionkey@0"
I20260809 13:07:55.781339 25254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "9a63ece176a04d419aee517c92905ef8"
format_stamp: "Formatted at 2026-08-09 13:07:55 on dist-test-slave-jq4t"
server_key: "7477383c2503776372bb9f0210453597"
server_key_iv: "1e21b842882d12b74d63a9ae3bb542b4"
server_key_version: "encryptionkey@0"
I20260809 13:07:55.786890 25254 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 13:07:55.790593 25280 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:55.791980 25254 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 13:07:55.792191 25254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "9a63ece176a04d419aee517c92905ef8"
format_stamp: "Formatted at 2026-08-09 13:07:55 on dist-test-slave-jq4t"
server_key: "7477383c2503776372bb9f0210453597"
server_key_iv: "1e21b842882d12b74d63a9ae3bb542b4"
server_key_version: "encryptionkey@0"
I20260809 13:07:55.792371 25254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:07:55.814102 25254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:07:55.818629 25254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:07:55.818959 25254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:07:55.839795 25254 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:37431
I20260809 13:07:55.839834 25358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:37431 every 8 connection(s)
I20260809 13:07:55.841284 25254 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:07:55.845137 25359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:07:55.846258 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 25254
I20260809 13:07:55.846484 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:07:55.847105 29295 external_mini_cluster.cc:1428] Setting key 5e5d12160f295d495891b5283a6f1fbd
I20260809 13:07:55.859790 25359 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a63ece176a04d419aee517c92905ef8: Bootstrap starting.
Aug 09 13:07:55 dist-test-slave-jq4t krb5kdc[25236](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280875, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:07:55.864066 25359 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9a63ece176a04d419aee517c92905ef8: Neither blocks nor log segments found. Creating new log.
I20260809 13:07:55.865775 25359 log.cc:824] T 00000000000000000000000000000000 P 9a63ece176a04d419aee517c92905ef8: Log is configured to *not* fsync() on all Append() calls
I20260809 13:07:55.871466 25359 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a63ece176a04d419aee517c92905ef8: No bootstrap required, opened a new log
I20260809 13:07:55.875101 25362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:55.849131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40072 (local address 127.28.155.254:37431)
0809 13:07:55.849950 (+ 819us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:55.849961 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:55.850002 (+ 41us) server_negotiation.cc:407] Connection header received
0809 13:07:55.851740 (+ 1738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:55.851766 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:55.852158 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:55.852556 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:55.854399 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:55.855792 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:55.857754 (+ 1962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:55.858437 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:55.858563 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:55.864887 (+ 6324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:55.864900 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:55.864923 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:07:55.864988 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:55.870215 (+ 5227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:55.871258 (+ 1043us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:55.871267 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:55.871275 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:55.871538 (+ 263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:55.872092 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:55.872097 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:55.872101 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:55.872765 (+ 664us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:55.873024 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:55.873563 (+ 539us) server_negotiation.cc:299] Negotiation successful
0809 13:07:55.873970 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":598,"thread_start_us":385,"threads_started":1}
I20260809 13:07:55.880048 25359 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9a63ece176a04d419aee517c92905ef8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a63ece176a04d419aee517c92905ef8" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 37431 } }
I20260809 13:07:55.880424 25359 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9a63ece176a04d419aee517c92905ef8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:07:55.880548 25359 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9a63ece176a04d419aee517c92905ef8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a63ece176a04d419aee517c92905ef8, State: Initialized, Role: FOLLOWER
I20260809 13:07:55.881122 25359 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9a63ece176a04d419aee517c92905ef8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a63ece176a04d419aee517c92905ef8" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 37431 } }
I20260809 13:07:55.881371 25359 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9a63ece176a04d419aee517c92905ef8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:07:55.881497 25359 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9a63ece176a04d419aee517c92905ef8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:07:55.881654 25359 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9a63ece176a04d419aee517c92905ef8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:07:55.883909 25359 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9a63ece176a04d419aee517c92905ef8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a63ece176a04d419aee517c92905ef8" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 37431 } }
I20260809 13:07:55.884421 25359 leader_election.cc:302] T 00000000000000000000000000000000 P 9a63ece176a04d419aee517c92905ef8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9a63ece176a04d419aee517c92905ef8; no voters:
I20260809 13:07:55.885092 25359 leader_election.cc:288] T 00000000000000000000000000000000 P 9a63ece176a04d419aee517c92905ef8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:07:55.885250 25364 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9a63ece176a04d419aee517c92905ef8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:07:55.886376 25364 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9a63ece176a04d419aee517c92905ef8 [term 1 LEADER]: Becoming Leader. State: Replica: 9a63ece176a04d419aee517c92905ef8, State: Running, Role: LEADER
I20260809 13:07:55.886987 25364 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9a63ece176a04d419aee517c92905ef8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a63ece176a04d419aee517c92905ef8" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 37431 } }
I20260809 13:07:55.887396 25359 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9a63ece176a04d419aee517c92905ef8 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:07:55.890214 25369 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a63ece176a04d419aee517c92905ef8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9a63ece176a04d419aee517c92905ef8. Latest consensus state: current_term: 1 leader_uuid: "9a63ece176a04d419aee517c92905ef8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a63ece176a04d419aee517c92905ef8" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 37431 } } }
I20260809 13:07:55.891037 25369 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a63ece176a04d419aee517c92905ef8 [sys.catalog]: This master's current role is: LEADER
I20260809 13:07:55.890831 25368 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a63ece176a04d419aee517c92905ef8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9a63ece176a04d419aee517c92905ef8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a63ece176a04d419aee517c92905ef8" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 37431 } } }
I20260809 13:07:55.891505 25368 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a63ece176a04d419aee517c92905ef8 [sys.catalog]: This master's current role is: LEADER
I20260809 13:07:55.894361 25378 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:07:55.899233 25378 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:07:55.908582 25378 catalog_manager.cc:1347] Generated new cluster ID: 7cae178a70bb4fcfb7245e67e23775b0
I20260809 13:07:55.908720 25378 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:07:55.945039 25378 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:07:55.947363 25378 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:07:55.955961 25378 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9a63ece176a04d419aee517c92905ef8: Generated new TSK 0
I20260809 13:07:55.957056 25378 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
I20260809 13:07:56.041596 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:0
--local_ip_for_outbound_sockets=127.28.155.193
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:37431
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:45905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:07:56.439828 25400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:07:56.440125 25400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:07:56.440225 25400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:07:56.447582 25400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:07:56.447698 25400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:07:56.447813 25400 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:07:56.457785 25400 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:45905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:37431
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:07:56.459087 25400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:07:56.460412 25400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:07:56.473882 25412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:56.473860 25409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:56.473824 25407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:07:56.474738 25400 server_base.cc:1034] running on GCE node
I20260809 13:07:56.475468 25400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:07:56.476444 25400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:07:56.477705 25400 hybrid_clock.cc:648] HybridClock initialized: now 1786280876477662 us; error 34 us; skew 500 ppm
I20260809 13:07:56.478077 25400 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:07:56 dist-test-slave-jq4t krb5kdc[25236](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280876, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:07:56.481350 25400 init.cc:377] Logged in from keytab as kudu/127.28.155.193@KRBTEST.COM (short username kudu)
I20260809 13:07:56.482829 25400 webserver.cc:460] Webserver started at http://127.28.155.193:39843/ using document root <none> and password file <none>
I20260809 13:07:56.483543 25400 fs_manager.cc:359] Metadata directory not provided
I20260809 13:07:56.483695 25400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:07:56.484040 25400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:07:56.487116 25400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-0/data/instance:
uuid: "80524acc93624e5d841b2143428fef11"
format_stamp: "Formatted at 2026-08-09 13:07:56 on dist-test-slave-jq4t"
server_key: "b05c6eb1cec4031e3b426808d841dcca"
server_key_iv: "7e319ae256cb4cdf9fce32686aa55d0c"
server_key_version: "encryptionkey@0"
I20260809 13:07:56.488051 25400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance:
uuid: "80524acc93624e5d841b2143428fef11"
format_stamp: "Formatted at 2026-08-09 13:07:56 on dist-test-slave-jq4t"
server_key: "b05c6eb1cec4031e3b426808d841dcca"
server_key_iv: "7e319ae256cb4cdf9fce32686aa55d0c"
server_key_version: "encryptionkey@0"
I20260809 13:07:56.493914 25400 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 13:07:56.497906 25423 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:56.499243 25400 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:07:56.499432 25400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "80524acc93624e5d841b2143428fef11"
format_stamp: "Formatted at 2026-08-09 13:07:56 on dist-test-slave-jq4t"
server_key: "b05c6eb1cec4031e3b426808d841dcca"
server_key_iv: "7e319ae256cb4cdf9fce32686aa55d0c"
server_key_version: "encryptionkey@0"
I20260809 13:07:56.499655 25400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:07:56.531215 25400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:07:56.535837 25400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:07:56.536194 25400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:07:56.537329 25400 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:07:56.538848 25400 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:07:56.538968 25400 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:56.539134 25400 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:07:56.539220 25400 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:56.575547 25400 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:38693
I20260809 13:07:56.575603 25585 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:38693 every 8 connection(s)
I20260809 13:07:56.577188 25400 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:07:56.584705 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 25400
I20260809 13:07:56.584923 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance
I20260809 13:07:56.585522 29295 external_mini_cluster.cc:1428] Setting key 9a76449be4ee293411684222f26bf6e0
Aug 09 13:07:56 dist-test-slave-jq4t krb5kdc[25236](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280876, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:07:56.599298 25589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:56.579918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:58705 (local address 127.28.155.254:37431)
0809 13:07:56.580405 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:56.580410 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:56.581452 (+ 1042us) server_negotiation.cc:407] Connection header received
0809 13:07:56.583342 (+ 1890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:56.583348 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:56.583440 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:56.583546 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:56.585319 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:56.586391 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:56.588235 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:56.588711 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:56.588874 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:56.592792 (+ 3918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:56.592798 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:56.592801 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:07:56.592837 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:56.595808 (+ 2971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:56.596763 (+ 955us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:56.596769 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:56.596774 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:56.596939 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:56.597419 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:56.597424 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:56.597427 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:56.597730 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:56.597897 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:56.598668 (+ 771us) server_negotiation.cc:299] Negotiation successful
0809 13:07:56.598913 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":240,"threads_started":1}
I20260809 13:07:56.600373 25590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:56.580559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37431 (local address 127.28.155.193:58705)
0809 13:07:56.581275 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:56.581322 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:56.583069 (+ 1747us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:56.583773 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:56.583782 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:56.584318 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:07:56.585127 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:56.585150 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:56.586592 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:56.586597 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:56.588079 (+ 1482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:56.588093 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:56.589012 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:56.589020 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:56.589385 (+ 365us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:56.590129 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:07:56.590153 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:07:56.592539 (+ 2386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:07:56.595974 (+ 3435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:07:56.595985 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:07:56.596002 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:07:56.596630 (+ 628us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:07:56.597063 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:07:56.597068 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:07:56.597072 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:07:56.597288 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:07:56.597875 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:07:56.597883 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:07:56.598256 (+ 373us) client_negotiation.cc:769] Sending connection context
0809 13:07:56.598532 (+ 276us) client_negotiation.cc:240] Negotiation successful
0809 13:07:56.599127 (+ 595us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":281,"threads_started":1}
I20260809 13:07:56.602293 25586 heartbeater.cc:347] Connected to a master server at 127.28.155.254:37431
I20260809 13:07:56.602648 25586 heartbeater.cc:464] Registering TS with master...
I20260809 13:07:56.603585 25586 heartbeater.cc:511] Master 127.28.155.254:37431 requested a full tablet report, sending...
I20260809 13:07:56.606288 25309 ts_manager.cc:194] Registered new tserver with Master: 80524acc93624e5d841b2143428fef11 (127.28.155.193:38693)
I20260809 13:07:56.608686 25309 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.193@KRBTEST.COM'} at 127.28.155.193:58705
WARNING: no policy specified for kudu/127.28.155.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
I20260809 13:07:56.660316 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:0
--local_ip_for_outbound_sockets=127.28.155.194
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:37431
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:45905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:07:57.028108 25593 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:07:57.028488 25593 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:07:57.028712 25593 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:07:57.036339 25593 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:07:57.036541 25593 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:07:57.036743 25593 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:07:57.046962 25593 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:45905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:37431
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:07:57.048391 25593 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:07:57.049865 25593 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:07:57.063544 25601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:57.063649 25600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:57.063620 25603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:07:57.064785 25593 server_base.cc:1034] running on GCE node
I20260809 13:07:57.065421 25593 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:07:57.066370 25593 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:07:57.067586 25593 hybrid_clock.cc:648] HybridClock initialized: now 1786280877067543 us; error 29 us; skew 500 ppm
I20260809 13:07:57.067880 25593 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:07:57 dist-test-slave-jq4t krb5kdc[25236](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280877, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:07:57.071305 25593 init.cc:377] Logged in from keytab as kudu/127.28.155.194@KRBTEST.COM (short username kudu)
I20260809 13:07:57.074859 25593 webserver.cc:460] Webserver started at http://127.28.155.194:33531/ using document root <none> and password file <none>
I20260809 13:07:57.075667 25593 fs_manager.cc:359] Metadata directory not provided
I20260809 13:07:57.075829 25593 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:07:57.076191 25593 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:07:57.079399 25593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-1/data/instance:
uuid: "8adc934ad7e044a09be4de9c3ff6a72b"
format_stamp: "Formatted at 2026-08-09 13:07:57 on dist-test-slave-jq4t"
server_key: "2f4ae93343afc0dbbd33fba6844829ac"
server_key_iv: "6f9fb25971e986332603ffb73961dc4c"
server_key_version: "encryptionkey@0"
I20260809 13:07:57.080207 25593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance:
uuid: "8adc934ad7e044a09be4de9c3ff6a72b"
format_stamp: "Formatted at 2026-08-09 13:07:57 on dist-test-slave-jq4t"
server_key: "2f4ae93343afc0dbbd33fba6844829ac"
server_key_iv: "6f9fb25971e986332603ffb73961dc4c"
server_key_version: "encryptionkey@0"
I20260809 13:07:57.085597 25593 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260809 13:07:57.089303 25613 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:57.090680 25593 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:07:57.090870 25593 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "8adc934ad7e044a09be4de9c3ff6a72b"
format_stamp: "Formatted at 2026-08-09 13:07:57 on dist-test-slave-jq4t"
server_key: "2f4ae93343afc0dbbd33fba6844829ac"
server_key_iv: "6f9fb25971e986332603ffb73961dc4c"
server_key_version: "encryptionkey@0"
I20260809 13:07:57.091089 25593 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:07:57.106655 25593 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:07:57.110662 25593 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:07:57.111013 25593 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:07:57.112041 25593 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:07:57.113495 25593 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:07:57.113602 25593 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:57.113749 25593 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:07:57.113827 25593 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:57.149649 25593 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:40205
I20260809 13:07:57.149698 25782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:40205 every 8 connection(s)
I20260809 13:07:57.151103 25593 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:07:57.156385 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 25593
I20260809 13:07:57.156633 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance
I20260809 13:07:57.157205 29295 external_mini_cluster.cc:1428] Setting key 0560c3196985eaf19719d18cae620386
Aug 09 13:07:57 dist-test-slave-jq4t krb5kdc[25236](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280877, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:07:57.172566 25785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:57.153805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:44591 (local address 127.28.155.254:37431)
0809 13:07:57.154285 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:57.154290 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:57.155129 (+ 839us) server_negotiation.cc:407] Connection header received
0809 13:07:57.157695 (+ 2566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:57.157701 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:57.157786 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:57.157918 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:57.159611 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.160353 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.161986 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.162431 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.162570 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:57.166576 (+ 4006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:57.166582 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:57.166585 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:07:57.166618 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:57.169380 (+ 2762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:57.170133 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:57.170137 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:57.170139 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:57.170258 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:57.170704 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:57.170708 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:57.170713 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:57.171024 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:57.171184 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:57.171891 (+ 707us) server_negotiation.cc:299] Negotiation successful
0809 13:07:57.172125 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":265,"threads_started":1}
I20260809 13:07:57.173564 25786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:57.154213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37431 (local address 127.28.155.194:44591)
0809 13:07:57.154949 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:57.154988 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:57.157339 (+ 2351us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:57.158185 (+ 846us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:57.158194 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:57.158736 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:07:57.159432 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:57.159453 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.160553 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.160557 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:57.161811 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:57.161824 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.162667 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.162675 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:57.162936 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:57.163702 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:07:57.163727 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:07:57.166325 (+ 2598us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:07:57.169533 (+ 3208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:07:57.169542 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:07:57.169558 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:07:57.169993 (+ 435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:07:57.170370 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:07:57.170378 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:07:57.170381 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:07:57.170582 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:07:57.171169 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:07:57.171177 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:07:57.171523 (+ 346us) client_negotiation.cc:769] Sending connection context
0809 13:07:57.171784 (+ 261us) client_negotiation.cc:240] Negotiation successful
0809 13:07:57.172349 (+ 565us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":290,"threads_started":1}
I20260809 13:07:57.175065 25783 heartbeater.cc:347] Connected to a master server at 127.28.155.254:37431
I20260809 13:07:57.175415 25783 heartbeater.cc:464] Registering TS with master...
I20260809 13:07:57.176396 25783 heartbeater.cc:511] Master 127.28.155.254:37431 requested a full tablet report, sending...
I20260809 13:07:57.178174 25309 ts_manager.cc:194] Registered new tserver with Master: 8adc934ad7e044a09be4de9c3ff6a72b (127.28.155.194:40205)
I20260809 13:07:57.179464 25309 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.194@KRBTEST.COM'} at 127.28.155.194:44591
WARNING: no policy specified for kudu/127.28.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
I20260809 13:07:57.231853 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:0
--local_ip_for_outbound_sockets=127.28.155.195
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:37431
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:45905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:07:57.600998 25792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:07:57.601270 25792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:07:57.601365 25792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:07:57.608608 25792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:07:57.608713 25792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:07:57.608824 25792 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:07:57.612218 25586 heartbeater.cc:503] Master 127.28.155.254:37431 was elected leader, sending a full tablet report...
I20260809 13:07:57.618906 25792 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:45905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:37431
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:07:57.620253 25792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:07:57.621690 25792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:07:57.635504 25798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:57.635730 25801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:57.636034 25799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:07:57.636570 25792 server_base.cc:1034] running on GCE node
I20260809 13:07:57.637209 25792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:07:57.638185 25792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:07:57.639380 25792 hybrid_clock.cc:648] HybridClock initialized: now 1786280877639332 us; error 33 us; skew 500 ppm
I20260809 13:07:57.639727 25792 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:07:57 dist-test-slave-jq4t krb5kdc[25236](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280877, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:07:57.643114 25792 init.cc:377] Logged in from keytab as kudu/127.28.155.195@KRBTEST.COM (short username kudu)
I20260809 13:07:57.644737 25792 webserver.cc:460] Webserver started at http://127.28.155.195:37519/ using document root <none> and password file <none>
I20260809 13:07:57.645462 25792 fs_manager.cc:359] Metadata directory not provided
I20260809 13:07:57.645617 25792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:07:57.645967 25792 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:07:57.649170 25792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-2/data/instance:
uuid: "abaf19658cc34b9981129d632a371aba"
format_stamp: "Formatted at 2026-08-09 13:07:57 on dist-test-slave-jq4t"
server_key: "5d317881e40860b8e2f8b739872050d6"
server_key_iv: "d72568df8c9c868462b4298906b8c64b"
server_key_version: "encryptionkey@0"
I20260809 13:07:57.650002 25792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance:
uuid: "abaf19658cc34b9981129d632a371aba"
format_stamp: "Formatted at 2026-08-09 13:07:57 on dist-test-slave-jq4t"
server_key: "5d317881e40860b8e2f8b739872050d6"
server_key_iv: "d72568df8c9c868462b4298906b8c64b"
server_key_version: "encryptionkey@0"
I20260809 13:07:57.655489 25792 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 13:07:57.659454 25812 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:57.660898 25792 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:07:57.661075 25792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "abaf19658cc34b9981129d632a371aba"
format_stamp: "Formatted at 2026-08-09 13:07:57 on dist-test-slave-jq4t"
server_key: "5d317881e40860b8e2f8b739872050d6"
server_key_iv: "d72568df8c9c868462b4298906b8c64b"
server_key_version: "encryptionkey@0"
I20260809 13:07:57.661295 25792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:07:57.687093 25792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:07:57.692219 25792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:07:57.692610 25792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:07:57.693780 25792 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:07:57.695484 25792 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:07:57.695590 25792 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:57.695744 25792 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:07:57.695828 25792 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:57.732084 25792 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:36695
I20260809 13:07:57.732131 25970 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:36695 every 8 connection(s)
I20260809 13:07:57.733557 25792 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:07:57.738142 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 25792
I20260809 13:07:57.738395 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance
I20260809 13:07:57.738889 29295 external_mini_cluster.cc:1428] Setting key 771b52abce224a92c8d29d13ad0a7afc
Aug 09 13:07:57 dist-test-slave-jq4t krb5kdc[25236](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280877, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:07:57.756028 25973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:57.736450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:36283 (local address 127.28.155.254:37431)
0809 13:07:57.736960 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:57.736965 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:57.737924 (+ 959us) server_negotiation.cc:407] Connection header received
0809 13:07:57.740291 (+ 2367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:57.740297 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:57.740413 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:57.740573 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:57.742508 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.743344 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.745063 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.745489 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.745628 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:57.749654 (+ 4026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:57.749660 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:57.749663 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:07:57.749699 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:57.752559 (+ 2860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:57.753475 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:57.753481 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:57.753486 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:57.753622 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:57.754129 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:57.754133 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:57.754135 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:57.754439 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:57.754619 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:57.755392 (+ 773us) server_negotiation.cc:299] Negotiation successful
0809 13:07:57.755631 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":240,"threads_started":1}
I20260809 13:07:57.757141 25974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:57.737014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:37431 (local address 127.28.155.195:36283)
0809 13:07:57.737750 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:57.737797 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:57.739981 (+ 2184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:57.740819 (+ 838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:57.740828 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:57.741605 (+ 777us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:07:57.742292 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:57.742311 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.743528 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.743532 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:57.744911 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:57.744925 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.745734 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.745742 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:57.745999 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:57.746865 (+ 866us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:07:57.746889 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:07:57.749410 (+ 2521us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:07:57.752708 (+ 3298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:07:57.752719 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:07:57.752738 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:07:57.753338 (+ 600us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:07:57.753743 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:07:57.753748 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:07:57.753752 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:07:57.753992 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:07:57.754593 (+ 601us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:07:57.754603 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:07:57.754987 (+ 384us) client_negotiation.cc:769] Sending connection context
0809 13:07:57.755272 (+ 285us) client_negotiation.cc:240] Negotiation successful
0809 13:07:57.755863 (+ 591us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":287,"threads_started":1}
I20260809 13:07:57.758605 25971 heartbeater.cc:347] Connected to a master server at 127.28.155.254:37431
I20260809 13:07:57.758960 25971 heartbeater.cc:464] Registering TS with master...
I20260809 13:07:57.759744 25971 heartbeater.cc:511] Master 127.28.155.254:37431 requested a full tablet report, sending...
I20260809 13:07:57.761302 25309 ts_manager.cc:194] Registered new tserver with Master: abaf19658cc34b9981129d632a371aba (127.28.155.195:36695)
I20260809 13:07:57.762151 25309 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.195@KRBTEST.COM'} at 127.28.155.195:36283
I20260809 13:07:57.767112 29295 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 13:07:57.784947 25973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:57.771478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40088 (local address 127.28.155.254:37431)
0809 13:07:57.771731 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:57.771739 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:57.772079 (+ 340us) server_negotiation.cc:407] Connection header received
0809 13:07:57.772214 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:57.772218 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:57.772298 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:57.772386 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:57.773921 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.774675 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.775991 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.776393 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.776517 (+ 124us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:57.779292 (+ 2775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:57.779297 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:57.779300 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:07:57.779335 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:57.782226 (+ 2891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:57.782976 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:57.782981 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:57.782983 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:57.783105 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:57.783493 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:57.783497 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:57.783498 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:57.783817 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:57.784037 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:57.784365 (+ 328us) server_negotiation.cc:299] Negotiation successful
0809 13:07:57.784565 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 13:07:57.789498 25309 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40088:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 13:07:57.797299 25309 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:07:57.836926 25994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:57.811141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:40205 (local address 127.0.0.1:36132)
0809 13:07:57.827921 (+ 16780us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:57.827939 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:57.828071 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:57.829119 (+ 1048us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:57.829128 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:57.829152 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:07:57.829636 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:57.829648 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.831697 (+ 2049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.831704 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:57.834127 (+ 2423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:57.834139 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.835840 (+ 1701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.835847 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:57.836053 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:57.836109 (+ 56us) client_negotiation.cc:769] Sending connection context
0809 13:07:57.836263 (+ 154us) client_negotiation.cc:240] Negotiation successful
0809 13:07:57.836527 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16643,"thread_start_us":16484,"threads_started":1}
I20260809 13:07:57.837313 25995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:57.811396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53566 (local address 127.28.155.195:36695)
0809 13:07:57.826358 (+ 14962us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:57.826373 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:57.827246 (+ 873us) server_negotiation.cc:407] Connection header received
0809 13:07:57.827624 (+ 378us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:57.827636 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:57.827943 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:57.828149 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:07:57.829421 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.830864 (+ 1443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.834194 (+ 3330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.835714 (+ 1520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.835914 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:57.836079 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:57.836746 (+ 667us) server_negotiation.cc:299] Negotiation successful
0809 13:07:57.836972 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14684,"thread_start_us":14980,"threads_started":1}
I20260809 13:07:57.837594 25996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:57.811831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36132 (local address 127.28.155.194:40205)
0809 13:07:57.827430 (+ 15599us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:57.827441 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:57.828220 (+ 779us) server_negotiation.cc:407] Connection header received
0809 13:07:57.828338 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:57.828346 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:57.828620 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:57.828827 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:07:57.829869 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.831525 (+ 1656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.834254 (+ 2729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.835314 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.835497 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:57.835704 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:57.837030 (+ 1326us) server_negotiation.cc:299] Negotiation successful
0809 13:07:57.837228 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15436,"thread_start_us":15295,"threads_started":1}
I20260809 13:07:57.837867 25990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:57.810646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:36695 (local address 127.0.0.1:53566)
0809 13:07:57.827095 (+ 16449us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:57.827118 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:57.827385 (+ 267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:57.828620 (+ 1235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:57.828629 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:57.828663 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:07:57.829148 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:57.829160 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.831020 (+ 1860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.831026 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:57.833983 (+ 2957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:57.834004 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.836239 (+ 2235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.836246 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:57.836430 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:57.836536 (+ 106us) client_negotiation.cc:769] Sending connection context
0809 13:07:57.836628 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 13:07:57.836765 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16303,"mutex_wait_us":102,"thread_start_us":9189,"threads_started":1}
I20260809 13:07:57.837992 25992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:57.810501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:38693 (local address 127.0.0.1:53282)
0809 13:07:57.820299 (+ 9798us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:57.820345 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:57.820585 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:57.830690 (+ 10105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:57.830696 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:57.830723 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:07:57.831151 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:57.831163 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.833113 (+ 1950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.833120 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:57.835119 (+ 1999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:57.835136 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.837115 (+ 1979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.837122 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:57.837277 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:57.837311 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 13:07:57.837383 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 13:07:57.837514 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9494,"mutex_wait_us":64,"thread_start_us":16289,"threads_started":1}
I20260809 13:07:57.838941 25993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:57.810880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53282 (local address 127.28.155.193:38693)
0809 13:07:57.830076 (+ 19196us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:57.830086 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:57.830115 (+ 29us) server_negotiation.cc:407] Connection header received
0809 13:07:57.830211 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:57.830221 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:57.830474 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:57.830663 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:07:57.831410 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.832962 (+ 1552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.835347 (+ 2385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.836881 (+ 1534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.838195 (+ 1314us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:57.838361 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:57.838426 (+ 65us) server_negotiation.cc:299] Negotiation successful
0809 13:07:57.838580 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19002,"thread_start_us":18817,"threads_started":1}
I20260809 13:07:57.841841 25878 tablet_service.cc:1467] Processing CreateTablet for tablet 40c463381f6e42a78e9ed93a500d248d (DEFAULT_TABLE table=test-table [id=9882fa812bb040508978bde2c03bc169]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:07:57.841866 25686 tablet_service.cc:1467] Processing CreateTablet for tablet 40c463381f6e42a78e9ed93a500d248d (DEFAULT_TABLE table=test-table [id=9882fa812bb040508978bde2c03bc169]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:07:57.843174 25878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40c463381f6e42a78e9ed93a500d248d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:07:57.843240 25686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40c463381f6e42a78e9ed93a500d248d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:07:57.848796 25490 tablet_service.cc:1467] Processing CreateTablet for tablet 40c463381f6e42a78e9ed93a500d248d (DEFAULT_TABLE table=test-table [id=9882fa812bb040508978bde2c03bc169]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:07:57.850485 25490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40c463381f6e42a78e9ed93a500d248d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:07:57.861110 25998 tablet_bootstrap.cc:492] T 40c463381f6e42a78e9ed93a500d248d P abaf19658cc34b9981129d632a371aba: Bootstrap starting.
I20260809 13:07:57.864887 25999 tablet_bootstrap.cc:492] T 40c463381f6e42a78e9ed93a500d248d P 8adc934ad7e044a09be4de9c3ff6a72b: Bootstrap starting.
I20260809 13:07:57.865281 25998 tablet_bootstrap.cc:654] T 40c463381f6e42a78e9ed93a500d248d P abaf19658cc34b9981129d632a371aba: Neither blocks nor log segments found. Creating new log.
I20260809 13:07:57.865772 26000 tablet_bootstrap.cc:492] T 40c463381f6e42a78e9ed93a500d248d P 80524acc93624e5d841b2143428fef11: Bootstrap starting.
I20260809 13:07:57.866884 25998 log.cc:824] T 40c463381f6e42a78e9ed93a500d248d P abaf19658cc34b9981129d632a371aba: Log is configured to *not* fsync() on all Append() calls
I20260809 13:07:57.869454 26000 tablet_bootstrap.cc:654] T 40c463381f6e42a78e9ed93a500d248d P 80524acc93624e5d841b2143428fef11: Neither blocks nor log segments found. Creating new log.
I20260809 13:07:57.869518 25999 tablet_bootstrap.cc:654] T 40c463381f6e42a78e9ed93a500d248d P 8adc934ad7e044a09be4de9c3ff6a72b: Neither blocks nor log segments found. Creating new log.
I20260809 13:07:57.870306 25998 tablet_bootstrap.cc:492] T 40c463381f6e42a78e9ed93a500d248d P abaf19658cc34b9981129d632a371aba: No bootstrap required, opened a new log
I20260809 13:07:57.870612 25998 ts_tablet_manager.cc:1397] T 40c463381f6e42a78e9ed93a500d248d P abaf19658cc34b9981129d632a371aba: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260809 13:07:57.870918 26000 log.cc:824] T 40c463381f6e42a78e9ed93a500d248d P 80524acc93624e5d841b2143428fef11: Log is configured to *not* fsync() on all Append() calls
I20260809 13:07:57.871274 25999 log.cc:824] T 40c463381f6e42a78e9ed93a500d248d P 8adc934ad7e044a09be4de9c3ff6a72b: Log is configured to *not* fsync() on all Append() calls
I20260809 13:07:57.874210 25999 tablet_bootstrap.cc:492] T 40c463381f6e42a78e9ed93a500d248d P 8adc934ad7e044a09be4de9c3ff6a72b: No bootstrap required, opened a new log
I20260809 13:07:57.874483 25999 ts_tablet_manager.cc:1397] T 40c463381f6e42a78e9ed93a500d248d P 8adc934ad7e044a09be4de9c3ff6a72b: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260809 13:07:57.874689 26000 tablet_bootstrap.cc:492] T 40c463381f6e42a78e9ed93a500d248d P 80524acc93624e5d841b2143428fef11: No bootstrap required, opened a new log
I20260809 13:07:57.874963 26000 ts_tablet_manager.cc:1397] T 40c463381f6e42a78e9ed93a500d248d P 80524acc93624e5d841b2143428fef11: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.006s
I20260809 13:07:57.881543 25998 raft_consensus.cc:348] T 40c463381f6e42a78e9ed93a500d248d P abaf19658cc34b9981129d632a371aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80524acc93624e5d841b2143428fef11" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 38693 } } peers { permanent_uuid: "abaf19658cc34b9981129d632a371aba" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36695 } } peers { permanent_uuid: "8adc934ad7e044a09be4de9c3ff6a72b" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 40205 } }
I20260809 13:07:57.882043 25998 raft_consensus.cc:374] T 40c463381f6e42a78e9ed93a500d248d P abaf19658cc34b9981129d632a371aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:07:57.882195 25998 raft_consensus.cc:729] T 40c463381f6e42a78e9ed93a500d248d P abaf19658cc34b9981129d632a371aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abaf19658cc34b9981129d632a371aba, State: Initialized, Role: FOLLOWER
I20260809 13:07:57.882246 25999 raft_consensus.cc:348] T 40c463381f6e42a78e9ed93a500d248d P 8adc934ad7e044a09be4de9c3ff6a72b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80524acc93624e5d841b2143428fef11" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 38693 } } peers { permanent_uuid: "abaf19658cc34b9981129d632a371aba" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36695 } } peers { permanent_uuid: "8adc934ad7e044a09be4de9c3ff6a72b" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 40205 } }
I20260809 13:07:57.882754 25999 raft_consensus.cc:374] T 40c463381f6e42a78e9ed93a500d248d P 8adc934ad7e044a09be4de9c3ff6a72b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:07:57.882887 25999 raft_consensus.cc:729] T 40c463381f6e42a78e9ed93a500d248d P 8adc934ad7e044a09be4de9c3ff6a72b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8adc934ad7e044a09be4de9c3ff6a72b, State: Initialized, Role: FOLLOWER
I20260809 13:07:57.882871 25998 consensus_queue.cc:260] T 40c463381f6e42a78e9ed93a500d248d P abaf19658cc34b9981129d632a371aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80524acc93624e5d841b2143428fef11" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 38693 } } peers { permanent_uuid: "abaf19658cc34b9981129d632a371aba" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36695 } } peers { permanent_uuid: "8adc934ad7e044a09be4de9c3ff6a72b" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 40205 } }
I20260809 13:07:57.883622 25999 consensus_queue.cc:260] T 40c463381f6e42a78e9ed93a500d248d P 8adc934ad7e044a09be4de9c3ff6a72b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80524acc93624e5d841b2143428fef11" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 38693 } } peers { permanent_uuid: "abaf19658cc34b9981129d632a371aba" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36695 } } peers { permanent_uuid: "8adc934ad7e044a09be4de9c3ff6a72b" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 40205 } }
I20260809 13:07:57.884080 25971 heartbeater.cc:503] Master 127.28.155.254:37431 was elected leader, sending a full tablet report...
I20260809 13:07:57.884809 25998 ts_tablet_manager.cc:1428] T 40c463381f6e42a78e9ed93a500d248d P abaf19658cc34b9981129d632a371aba: Time spent starting tablet: real 0.014s user 0.015s sys 0.001s
I20260809 13:07:57.885522 26000 raft_consensus.cc:348] T 40c463381f6e42a78e9ed93a500d248d P 80524acc93624e5d841b2143428fef11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80524acc93624e5d841b2143428fef11" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 38693 } } peers { permanent_uuid: "abaf19658cc34b9981129d632a371aba" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36695 } } peers { permanent_uuid: "8adc934ad7e044a09be4de9c3ff6a72b" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 40205 } }
I20260809 13:07:57.886019 26000 raft_consensus.cc:374] T 40c463381f6e42a78e9ed93a500d248d P 80524acc93624e5d841b2143428fef11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:07:57.886155 26000 raft_consensus.cc:729] T 40c463381f6e42a78e9ed93a500d248d P 80524acc93624e5d841b2143428fef11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80524acc93624e5d841b2143428fef11, State: Initialized, Role: FOLLOWER
I20260809 13:07:57.886875 25999 ts_tablet_manager.cc:1428] T 40c463381f6e42a78e9ed93a500d248d P 8adc934ad7e044a09be4de9c3ff6a72b: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260809 13:07:57.886737 26000 consensus_queue.cc:260] T 40c463381f6e42a78e9ed93a500d248d P 80524acc93624e5d841b2143428fef11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80524acc93624e5d841b2143428fef11" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 38693 } } peers { permanent_uuid: "abaf19658cc34b9981129d632a371aba" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36695 } } peers { permanent_uuid: "8adc934ad7e044a09be4de9c3ff6a72b" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 40205 } }
I20260809 13:07:57.887379 25783 heartbeater.cc:503] Master 127.28.155.254:37431 was elected leader, sending a full tablet report...
I20260809 13:07:57.888530 26000 ts_tablet_manager.cc:1428] T 40c463381f6e42a78e9ed93a500d248d P 80524acc93624e5d841b2143428fef11: Time spent starting tablet: real 0.013s user 0.010s sys 0.004s
I20260809 13:07:57.898020 26006 raft_consensus.cc:482] T 40c463381f6e42a78e9ed93a500d248d P 80524acc93624e5d841b2143428fef11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:07:57.898243 26006 raft_consensus.cc:504] T 40c463381f6e42a78e9ed93a500d248d P 80524acc93624e5d841b2143428fef11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80524acc93624e5d841b2143428fef11" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 38693 } } peers { permanent_uuid: "abaf19658cc34b9981129d632a371aba" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36695 } } peers { permanent_uuid: "8adc934ad7e044a09be4de9c3ff6a72b" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 40205 } }
I20260809 13:07:57.899799 26006 leader_election.cc:288] T 40c463381f6e42a78e9ed93a500d248d P 80524acc93624e5d841b2143428fef11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abaf19658cc34b9981129d632a371aba (127.28.155.195:36695), 8adc934ad7e044a09be4de9c3ff6a72b (127.28.155.194:40205)
W20260809 13:07:57.903298 25784 tablet.cc:2369] T 40c463381f6e42a78e9ed93a500d248d P 8adc934ad7e044a09be4de9c3ff6a72b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:07:57.907779 25995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:57.900117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:34439 (local address 127.28.155.195:36695)
0809 13:07:57.900660 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:57.900690 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:57.902156 (+ 1466us) server_negotiation.cc:407] Connection header received
0809 13:07:57.902336 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:57.902339 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:57.902397 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:57.902475 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:07:57.903064 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.904010 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.906059 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.906811 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.906980 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:57.907082 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:57.907362 (+ 280us) server_negotiation.cc:299] Negotiation successful
0809 13:07:57.907508 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317}
I20260809 13:07:57.907806 25996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:57.900350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:46007 (local address 127.28.155.194:40205)
0809 13:07:57.900676 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:57.900685 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:57.901520 (+ 835us) server_negotiation.cc:407] Connection header received
0809 13:07:57.901706 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:57.901715 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:57.901806 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:57.901916 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:07:57.902674 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.903755 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.905982 (+ 2227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.906812 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.907009 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:57.907082 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:57.907428 (+ 346us) server_negotiation.cc:299] Negotiation successful
0809 13:07:57.907563 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 13:07:57.907907 26007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:57.900303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:36695 (local address 127.28.155.193:34439)
0809 13:07:57.902044 (+ 1741us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:57.902067 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:57.902214 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:57.902539 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:57.902547 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:57.902575 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:07:57.902910 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:57.902918 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.904236 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.904240 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:57.905882 (+ 1642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:57.905918 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.907040 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.907048 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:57.907205 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:57.907229 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 13:07:57.907306 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 13:07:57.907437 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1627,"mutex_wait_us":2,"thread_start_us":751,"threads_started":1}
I20260809 13:07:57.907991 26009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:57.900219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:40205 (local address 127.28.155.193:46007)
0809 13:07:57.901411 (+ 1192us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:57.901427 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:57.901550 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:57.901963 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:57.901969 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:57.901996 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:07:57.902478 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:57.902491 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.903924 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.903929 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:57.905819 (+ 1890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:57.905832 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.907089 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.907096 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:57.907244 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:57.907266 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 13:07:57.907384 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 13:07:57.907507 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1063,"mutex_wait_us":19,"spinlock_wait_cycles":58240,"thread_start_us":1535,"threads_started":1}
I20260809 13:07:57.909165 25715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40c463381f6e42a78e9ed93a500d248d" candidate_uuid: "80524acc93624e5d841b2143428fef11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8adc934ad7e044a09be4de9c3ff6a72b" is_pre_election: true
I20260809 13:07:57.909206 25903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40c463381f6e42a78e9ed93a500d248d" candidate_uuid: "80524acc93624e5d841b2143428fef11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abaf19658cc34b9981129d632a371aba" is_pre_election: true
I20260809 13:07:57.909770 25903 raft_consensus.cc:2454] T 40c463381f6e42a78e9ed93a500d248d P abaf19658cc34b9981129d632a371aba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80524acc93624e5d841b2143428fef11 in term 0.
I20260809 13:07:57.909760 25715 raft_consensus.cc:2454] T 40c463381f6e42a78e9ed93a500d248d P 8adc934ad7e044a09be4de9c3ff6a72b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80524acc93624e5d841b2143428fef11 in term 0.
I20260809 13:07:57.910567 25428 leader_election.cc:302] T 40c463381f6e42a78e9ed93a500d248d P 80524acc93624e5d841b2143428fef11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 80524acc93624e5d841b2143428fef11, 8adc934ad7e044a09be4de9c3ff6a72b, abaf19658cc34b9981129d632a371aba; no voters:
I20260809 13:07:57.911001 26006 raft_consensus.cc:2781] T 40c463381f6e42a78e9ed93a500d248d P 80524acc93624e5d841b2143428fef11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:07:57.911170 26006 raft_consensus.cc:482] T 40c463381f6e42a78e9ed93a500d248d P 80524acc93624e5d841b2143428fef11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:07:57.911291 26006 raft_consensus.cc:3037] T 40c463381f6e42a78e9ed93a500d248d P 80524acc93624e5d841b2143428fef11 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:07:57.913693 26006 raft_consensus.cc:504] T 40c463381f6e42a78e9ed93a500d248d P 80524acc93624e5d841b2143428fef11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80524acc93624e5d841b2143428fef11" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 38693 } } peers { permanent_uuid: "abaf19658cc34b9981129d632a371aba" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36695 } } peers { permanent_uuid: "8adc934ad7e044a09be4de9c3ff6a72b" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 40205 } }
I20260809 13:07:57.914343 26006 leader_election.cc:288] T 40c463381f6e42a78e9ed93a500d248d P 80524acc93624e5d841b2143428fef11 [CANDIDATE]: Term 1 election: Requested vote from peers abaf19658cc34b9981129d632a371aba (127.28.155.195:36695), 8adc934ad7e044a09be4de9c3ff6a72b (127.28.155.194:40205)
I20260809 13:07:57.914860 25903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40c463381f6e42a78e9ed93a500d248d" candidate_uuid: "80524acc93624e5d841b2143428fef11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abaf19658cc34b9981129d632a371aba"
I20260809 13:07:57.914963 25715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40c463381f6e42a78e9ed93a500d248d" candidate_uuid: "80524acc93624e5d841b2143428fef11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8adc934ad7e044a09be4de9c3ff6a72b"
I20260809 13:07:57.915076 25903 raft_consensus.cc:3037] T 40c463381f6e42a78e9ed93a500d248d P abaf19658cc34b9981129d632a371aba [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:07:57.915241 25715 raft_consensus.cc:3037] T 40c463381f6e42a78e9ed93a500d248d P 8adc934ad7e044a09be4de9c3ff6a72b [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:07:57.917508 25903 raft_consensus.cc:2454] T 40c463381f6e42a78e9ed93a500d248d P abaf19658cc34b9981129d632a371aba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80524acc93624e5d841b2143428fef11 in term 1.
I20260809 13:07:57.917734 25715 raft_consensus.cc:2454] T 40c463381f6e42a78e9ed93a500d248d P 8adc934ad7e044a09be4de9c3ff6a72b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80524acc93624e5d841b2143428fef11 in term 1.
I20260809 13:07:57.917992 25428 leader_election.cc:302] T 40c463381f6e42a78e9ed93a500d248d P 80524acc93624e5d841b2143428fef11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80524acc93624e5d841b2143428fef11, abaf19658cc34b9981129d632a371aba; no voters:
I20260809 13:07:57.918330 26006 raft_consensus.cc:2781] T 40c463381f6e42a78e9ed93a500d248d P 80524acc93624e5d841b2143428fef11 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:07:57.918794 26006 raft_consensus.cc:686] T 40c463381f6e42a78e9ed93a500d248d P 80524acc93624e5d841b2143428fef11 [term 1 LEADER]: Becoming Leader. State: Replica: 80524acc93624e5d841b2143428fef11, State: Running, Role: LEADER
I20260809 13:07:57.919344 26006 consensus_queue.cc:237] T 40c463381f6e42a78e9ed93a500d248d P 80524acc93624e5d841b2143428fef11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80524acc93624e5d841b2143428fef11" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 38693 } } peers { permanent_uuid: "abaf19658cc34b9981129d632a371aba" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36695 } } peers { permanent_uuid: "8adc934ad7e044a09be4de9c3ff6a72b" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 40205 } }
I20260809 13:07:57.923899 25308 catalog_manager.cc:5495] T 40c463381f6e42a78e9ed93a500d248d P 80524acc93624e5d841b2143428fef11 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80524acc93624e5d841b2143428fef11 (127.28.155.193). New cstate: current_term: 1 leader_uuid: "80524acc93624e5d841b2143428fef11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80524acc93624e5d841b2143428fef11" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 38693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abaf19658cc34b9981129d632a371aba" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8adc934ad7e044a09be4de9c3ff6a72b" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 40205 } health_report { overall_health: UNKNOWN } } }
I20260809 13:07:57.943359 25993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:57.937467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53294 (local address 127.28.155.193:38693)
0809 13:07:57.937711 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:57.937718 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:57.937738 (+ 20us) server_negotiation.cc:407] Connection header received
0809 13:07:57.937959 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:57.937963 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:57.938053 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:57.938220 (+ 167us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:07:57.938664 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.939409 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.940969 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:57.941391 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:57.941546 (+ 155us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:57.942177 (+ 631us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:07:57.942695 (+ 518us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:07:57.942894 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:57.943060 (+ 166us) server_negotiation.cc:299] Negotiation successful
0809 13:07:57.943109 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 13:07:57.951915 25903 raft_consensus.cc:1261] T 40c463381f6e42a78e9ed93a500d248d P abaf19658cc34b9981129d632a371aba [term 1 FOLLOWER]: Refusing update from remote peer 80524acc93624e5d841b2143428fef11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:07:57.951915 25715 raft_consensus.cc:1261] T 40c463381f6e42a78e9ed93a500d248d P 8adc934ad7e044a09be4de9c3ff6a72b [term 1 FOLLOWER]: Refusing update from remote peer 80524acc93624e5d841b2143428fef11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:07:57.953044 26010 consensus_queue.cc:1035] T 40c463381f6e42a78e9ed93a500d248d P 80524acc93624e5d841b2143428fef11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abaf19658cc34b9981129d632a371aba" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 36695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:07:57.953408 26006 consensus_queue.cc:1035] T 40c463381f6e42a78e9ed93a500d248d P 80524acc93624e5d841b2143428fef11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8adc934ad7e044a09be4de9c3ff6a72b" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 40205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:07:57.982142 25309 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40088:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:07:57.982483 25309 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40088:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:07:57.986865 25309 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9a63ece176a04d419aee517c92905ef8: Sending DeleteTablet for 3 replicas of tablet 40c463381f6e42a78e9ed93a500d248d
I20260809 13:07:57.988226 25490 tablet_service.cc:1514] Processing DeleteTablet for tablet 40c463381f6e42a78e9ed93a500d248d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:07:57 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:53282
I20260809 13:07:57.988255 25878 tablet_service.cc:1514] Processing DeleteTablet for tablet 40c463381f6e42a78e9ed93a500d248d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:07:57 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:53566
I20260809 13:07:57.989044 25686 tablet_service.cc:1514] Processing DeleteTablet for tablet 40c463381f6e42a78e9ed93a500d248d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:07:57 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:36132
I20260809 13:07:57.991657 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 25400
I20260809 13:07:58.001073 26024 tablet_replica.cc:330] T 40c463381f6e42a78e9ed93a500d248d P abaf19658cc34b9981129d632a371aba: stopping tablet replica
I20260809 13:07:58.001768 26024 raft_consensus.cc:2229] T 40c463381f6e42a78e9ed93a500d248d P abaf19658cc34b9981129d632a371aba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:07:58.002535 26024 raft_consensus.cc:2258] T 40c463381f6e42a78e9ed93a500d248d P abaf19658cc34b9981129d632a371aba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:07:58.005151 26024 ts_tablet_manager.cc:1905] T 40c463381f6e42a78e9ed93a500d248d P abaf19658cc34b9981129d632a371aba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:07:58.006443 26027 tablet_replica.cc:330] T 40c463381f6e42a78e9ed93a500d248d P 8adc934ad7e044a09be4de9c3ff6a72b: stopping tablet replica
I20260809 13:07:58.007027 26027 raft_consensus.cc:2229] T 40c463381f6e42a78e9ed93a500d248d P 8adc934ad7e044a09be4de9c3ff6a72b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:07:58.007730 26027 raft_consensus.cc:2258] T 40c463381f6e42a78e9ed93a500d248d P 8adc934ad7e044a09be4de9c3ff6a72b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:07:58.011165 26023 tablet_replica.cc:330] T 40c463381f6e42a78e9ed93a500d248d P 80524acc93624e5d841b2143428fef11: stopping tablet replica
I20260809 13:07:58.011665 26023 raft_consensus.cc:2229] T 40c463381f6e42a78e9ed93a500d248d P 80524acc93624e5d841b2143428fef11 [term 1 LEADER]: Raft consensus shutting down.
I20260809 13:07:58.012634 26023 raft_consensus.cc:2258] T 40c463381f6e42a78e9ed93a500d248d P 80524acc93624e5d841b2143428fef11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:07:58.013312 26027 ts_tablet_manager.cc:1905] T 40c463381f6e42a78e9ed93a500d248d P 8adc934ad7e044a09be4de9c3ff6a72b: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 09 13:07:58 dist-test-slave-jq4t krb5kdc[25236](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280875, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.193@KRBTEST.COM
I20260809 13:07:58.014623 26024 ts_tablet_manager.cc:1918] T 40c463381f6e42a78e9ed93a500d248d P abaf19658cc34b9981129d632a371aba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:07:58.014907 26024 log.cc:1196] T 40c463381f6e42a78e9ed93a500d248d P abaf19658cc34b9981129d632a371aba: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-2/wal/wals/40c463381f6e42a78e9ed93a500d248d
I20260809 13:07:58.015592 26024 ts_tablet_manager.cc:1939] T 40c463381f6e42a78e9ed93a500d248d P abaf19658cc34b9981129d632a371aba: Deleting consensus metadata
I20260809 13:07:58.017966 25290 catalog_manager.cc:4841] TS abaf19658cc34b9981129d632a371aba (127.28.155.195:36695): tablet 40c463381f6e42a78e9ed93a500d248d (table test-table [id=9882fa812bb040508978bde2c03bc169]) successfully deleted
I20260809 13:07:58.022188 26027 ts_tablet_manager.cc:1918] T 40c463381f6e42a78e9ed93a500d248d P 8adc934ad7e044a09be4de9c3ff6a72b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:07:58.022219 26023 ts_tablet_manager.cc:1905] T 40c463381f6e42a78e9ed93a500d248d P 80524acc93624e5d841b2143428fef11: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:07:58.022580 26027 log.cc:1196] T 40c463381f6e42a78e9ed93a500d248d P 8adc934ad7e044a09be4de9c3ff6a72b: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786280548611909-29295-0/minicluster-data/ts-1/wal/wals/40c463381f6e42a78e9ed93a500d248d
I20260809 13:07:58.023310 26027 ts_tablet_manager.cc:1939] T 40c463381f6e42a78e9ed93a500d248d P 8adc934ad7e044a09be4de9c3ff6a72b: Deleting consensus metadata
I20260809 13:07:58.024873 25993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:57.993538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53306 (local address 127.28.155.193:38693)
0809 13:07:57.993714 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:57.993721 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:57.997328 (+ 3607us) server_negotiation.cc:407] Connection header received
0809 13:07:57.997998 (+ 670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:57.998004 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:57.998122 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:57.998219 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:58.002824 (+ 4605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:58.004433 (+ 1609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:58.008396 (+ 3963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:58.009189 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:58.009330 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:58.015556 (+ 6226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:58.015576 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:58.015597 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:07:58.015643 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:58.020423 (+ 4780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:58.021575 (+ 1152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:58.021585 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:58.021588 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:58.021813 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:58.022398 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:58.022406 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:58.022409 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:58.023014 (+ 605us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:58.023375 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:58.024132 (+ 757us) server_negotiation.cc:299] Negotiation successful
0809 13:07:58.024430 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 13:07:58.025554 25288 catalog_manager.cc:4841] TS 8adc934ad7e044a09be4de9c3ff6a72b (127.28.155.194:40205): tablet 40c463381f6e42a78e9ed93a500d248d (table test-table [id=9882fa812bb040508978bde2c03bc169]) successfully deleted
I20260809 13:07:58.026835 25579 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:07:58.130126 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 25400
I20260809 13:07:58.154301 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 25593
W20260809 13:07:58.154301 25287 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.155.193:38693 (error 108)
I20260809 13:07:58.156456 25990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:58.155959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:38693 (local address 127.0.0.1:53316)
0809 13:07:58.156138 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:58.156265 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:38693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260809 13:07:58.156980 25287 catalog_manager.cc:4584] TS 80524acc93624e5d841b2143428fef11 (127.28.155.193:38693): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 40c463381f6e42a78e9ed93a500d248d: Network error: Client connection negotiation failed: client connection to 127.28.155.193:38693: connect: Connection refused (error 111)
Aug 09 13:07:58 dist-test-slave-jq4t krb5kdc[25236](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280875, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.194@KRBTEST.COM
I20260809 13:07:58.172852 25996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:58.155461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36140 (local address 127.28.155.194:40205)
0809 13:07:58.155640 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:58.155646 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:58.155665 (+ 19us) server_negotiation.cc:407] Connection header received
0809 13:07:58.155820 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:58.155826 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:58.155907 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:58.156012 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:58.157929 (+ 1917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:58.159076 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:58.160358 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:58.161041 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:58.161166 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:58.165896 (+ 4730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:58.165910 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:58.165927 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:07:58.165972 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:58.169958 (+ 3986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:58.170676 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:58.170685 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:58.170689 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:58.170859 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:58.171223 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:58.171228 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:58.171232 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:58.171741 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:58.172048 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:58.172264 (+ 216us) server_negotiation.cc:299] Negotiation successful
0809 13:07:58.172546 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 13:07:58.173556 25777 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:07:58.211136 25990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:58.210498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:38693 (local address 127.0.0.1:53318)
0809 13:07:58.210774 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:58.210912 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:38693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260809 13:07:58.212458 25990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:58.212012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:38693 (local address 127.0.0.1:53322)
0809 13:07:58.212186 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:58.212300 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:38693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260809 13:07:58.268280 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 25593
I20260809 13:07:58.273239 25990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:58.272597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:38693 (local address 127.0.0.1:53324)
0809 13:07:58.272916 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:58.273031 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:38693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158}
I20260809 13:07:58.274372 25990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:58.274027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:38693 (local address 127.0.0.1:53336)
0809 13:07:58.274175 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:58.274255 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:38693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 13:07:58.295308 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 25792
Aug 09 13:07:58 dist-test-slave-jq4t krb5kdc[25236](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280875, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.195@KRBTEST.COM
I20260809 13:07:58.311218 25995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:58.296278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53574 (local address 127.28.155.195:36695)
0809 13:07:58.296463 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:58.296468 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:58.296529 (+ 61us) server_negotiation.cc:407] Connection header received
0809 13:07:58.296662 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:58.296666 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:58.296737 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:58.296828 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:58.298206 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:58.298969 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:58.300237 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:58.300689 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:58.300787 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:58.305516 (+ 4729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:58.305534 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:58.305551 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:07:58.305591 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:58.308621 (+ 3030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:58.309304 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:58.309311 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:58.309313 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:58.309461 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:07:58.309803 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:07:58.309807 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:07:58.309809 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:07:58.310175 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:58.310410 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:58.310663 (+ 253us) server_negotiation.cc:299] Negotiation successful
0809 13:07:58.310852 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 13:07:58.311939 25963 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:07:58.355366 25990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:58.354837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:38693 (local address 127.0.0.1:53338)
0809 13:07:58.355082 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:58.355190 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:38693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260809 13:07:58.356595 25990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:58.356111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:38693 (local address 127.0.0.1:53346)
0809 13:07:58.356329 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:58.356414 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:38693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
I20260809 13:07:58.406132 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 25792
I20260809 13:07:58.431736 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 25254
I20260809 13:07:58.433063 25352 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:07:58.550489 25990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:58.549783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:38693 (local address 127.0.0.1:53356)
0809 13:07:58.550029 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:58.550181 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:38693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 13:07:58.550693 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 25254
2026-08-09T13:07:58Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4852 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-09T13:07:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:07:58Z Disabled control of system clock
I20260809 13:07:58.648746 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:35053
--webserver_interface=127.28.155.254
--webserver_port=0
--builtin_ntp_servers=127.28.155.212:39169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:35053
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 13:07:59.013715 26038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:07:59.014057 26038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:07:59.014148 26038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:07:59.021785 26038 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:07:59.021911 26038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:07:59.021951 26038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:07:59.022019 26038 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:07:59.022066 26038 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:07:59.031761 26038 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:39169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:35053
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:35053
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:07:59.033221 26038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:07:59.035111 26038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:07:59.047647 26050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:59.047725 26046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:59.047752 26047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:07:59.048974 26038 server_base.cc:1034] running on GCE node
I20260809 13:07:59.049791 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:07:59.051244 26038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:07:59.052449 26038 hybrid_clock.cc:648] HybridClock initialized: now 1786280879052386 us; error 59 us; skew 500 ppm
I20260809 13:07:59.052903 26038 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 13:07:59.055344 26038 webserver.cc:460] Webserver started at http://127.28.155.254:38323/ using document root <none> and password file <none>
I20260809 13:07:59.056102 26038 fs_manager.cc:359] Metadata directory not provided
I20260809 13:07:59.056222 26038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:07:59.056690 26038 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:07:59.059844 26038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "a2c2d75c4a3340b1af405c9a8742ea44"
format_stamp: "Formatted at 2026-08-09 13:07:59 on dist-test-slave-jq4t"
server_key: "d692aaabe54eacb6f580ac75e9aa9a5a"
server_key_iv: "73e78e92d31e3ea832d8adb25fda112c"
server_key_version: "encryptionkey@0"
I20260809 13:07:59.060868 26038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "a2c2d75c4a3340b1af405c9a8742ea44"
format_stamp: "Formatted at 2026-08-09 13:07:59 on dist-test-slave-jq4t"
server_key: "d692aaabe54eacb6f580ac75e9aa9a5a"
server_key_iv: "73e78e92d31e3ea832d8adb25fda112c"
server_key_version: "encryptionkey@0"
I20260809 13:07:59.066727 26038 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 13:07:59.070672 26058 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:59.072242 26038 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 13:07:59.072521 26038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "a2c2d75c4a3340b1af405c9a8742ea44"
format_stamp: "Formatted at 2026-08-09 13:07:59 on dist-test-slave-jq4t"
server_key: "d692aaabe54eacb6f580ac75e9aa9a5a"
server_key_iv: "73e78e92d31e3ea832d8adb25fda112c"
server_key_version: "encryptionkey@0"
I20260809 13:07:59.072830 26038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:07:59.091008 26038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:07:59.091945 26038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:07:59.092273 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:07:59.113476 26038 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:35053
I20260809 13:07:59.113516 26131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:35053 every 8 connection(s)
I20260809 13:07:59.114934 26038 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:07:59.118836 26132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:07:59.122706 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 26038
I20260809 13:07:59.122907 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:07:59.123384 29295 external_mini_cluster.cc:1428] Setting key fcb88081cf64869cdfaa865fc380b070
I20260809 13:07:59.132598 26132 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2c2d75c4a3340b1af405c9a8742ea44: Bootstrap starting.
I20260809 13:07:59.136708 26132 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a2c2d75c4a3340b1af405c9a8742ea44: Neither blocks nor log segments found. Creating new log.
I20260809 13:07:59.137866 26132 log.cc:824] T 00000000000000000000000000000000 P a2c2d75c4a3340b1af405c9a8742ea44: Log is configured to *not* fsync() on all Append() calls
I20260809 13:07:59.138238 26137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:59.125414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42644 (local address 127.28.155.254:35053)
0809 13:07:59.126487 (+ 1073us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:59.126499 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:59.126545 (+ 46us) server_negotiation.cc:407] Connection header received
0809 13:07:59.128249 (+ 1704us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:59.128276 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:59.128886 (+ 610us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:59.129258 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:59.129968 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:59.131321 (+ 1353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:59.133380 (+ 2059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:59.134089 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:59.134243 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:59.135620 (+ 1377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:59.135628 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:59.135642 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:07:59.136197 (+ 555us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:59.136298 (+ 101us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:07:59.136321 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:59.136463 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:59.136800 (+ 337us) server_negotiation.cc:299] Negotiation successful
0809 13:07:59.137202 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":657,"thread_start_us":403,"threads_started":1}
I20260809 13:07:59.141112 26132 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2c2d75c4a3340b1af405c9a8742ea44: No bootstrap required, opened a new log
I20260809 13:07:59.148536 26132 raft_consensus.cc:348] T 00000000000000000000000000000000 P a2c2d75c4a3340b1af405c9a8742ea44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2c2d75c4a3340b1af405c9a8742ea44" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 35053 } }
I20260809 13:07:59.148967 26132 raft_consensus.cc:374] T 00000000000000000000000000000000 P a2c2d75c4a3340b1af405c9a8742ea44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:07:59.149099 26132 raft_consensus.cc:729] T 00000000000000000000000000000000 P a2c2d75c4a3340b1af405c9a8742ea44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c2d75c4a3340b1af405c9a8742ea44, State: Initialized, Role: FOLLOWER
I20260809 13:07:59.149727 26132 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2c2d75c4a3340b1af405c9a8742ea44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2c2d75c4a3340b1af405c9a8742ea44" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 35053 } }
I20260809 13:07:59.150003 26132 raft_consensus.cc:388] T 00000000000000000000000000000000 P a2c2d75c4a3340b1af405c9a8742ea44 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:07:59.150159 26132 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2c2d75c4a3340b1af405c9a8742ea44 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:07:59.150347 26132 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a2c2d75c4a3340b1af405c9a8742ea44 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:07:59.152760 26132 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2c2d75c4a3340b1af405c9a8742ea44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2c2d75c4a3340b1af405c9a8742ea44" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 35053 } }
I20260809 13:07:59.153337 26132 leader_election.cc:302] T 00000000000000000000000000000000 P a2c2d75c4a3340b1af405c9a8742ea44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a2c2d75c4a3340b1af405c9a8742ea44; no voters:
I20260809 13:07:59.154085 26132 leader_election.cc:288] T 00000000000000000000000000000000 P a2c2d75c4a3340b1af405c9a8742ea44 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:07:59.154306 26139 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a2c2d75c4a3340b1af405c9a8742ea44 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:07:59.155673 26139 raft_consensus.cc:686] T 00000000000000000000000000000000 P a2c2d75c4a3340b1af405c9a8742ea44 [term 1 LEADER]: Becoming Leader. State: Replica: a2c2d75c4a3340b1af405c9a8742ea44, State: Running, Role: LEADER
I20260809 13:07:59.156266 26139 consensus_queue.cc:237] T 00000000000000000000000000000000 P a2c2d75c4a3340b1af405c9a8742ea44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2c2d75c4a3340b1af405c9a8742ea44" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 35053 } }
I20260809 13:07:59.156867 26132 sys_catalog.cc:564] T 00000000000000000000000000000000 P a2c2d75c4a3340b1af405c9a8742ea44 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:07:59.159821 26140 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2c2d75c4a3340b1af405c9a8742ea44 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a2c2d75c4a3340b1af405c9a8742ea44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2c2d75c4a3340b1af405c9a8742ea44" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 35053 } } }
I20260809 13:07:59.159789 26143 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2c2d75c4a3340b1af405c9a8742ea44 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a2c2d75c4a3340b1af405c9a8742ea44. Latest consensus state: current_term: 1 leader_uuid: "a2c2d75c4a3340b1af405c9a8742ea44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2c2d75c4a3340b1af405c9a8742ea44" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 35053 } } }
I20260809 13:07:59.160344 26140 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2c2d75c4a3340b1af405c9a8742ea44 [sys.catalog]: This master's current role is: LEADER
I20260809 13:07:59.160375 26143 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2c2d75c4a3340b1af405c9a8742ea44 [sys.catalog]: This master's current role is: LEADER
I20260809 13:07:59.164456 26152 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:07:59.170113 26152 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:07:59.179713 26152 catalog_manager.cc:1347] Generated new cluster ID: faac5508339048b2a385f486cd02e6d9
I20260809 13:07:59.179862 26152 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:07:59.195667 26152 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:07:59.197592 26152 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:07:59.206962 26152 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a2c2d75c4a3340b1af405c9a8742ea44: Generated new TSK 0
I20260809 13:07:59.208185 26152 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 13:07:59.223439 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:0
--local_ip_for_outbound_sockets=127.28.155.193
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:35053
--builtin_ntp_servers=127.28.155.212:39169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 13:07:59.603250 26171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:07:59.603559 26171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:07:59.603752 26171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:07:59.611382 26171 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:07:59.611513 26171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:07:59.611697 26171 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:07:59.621588 26171 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:39169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:35053
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:07:59.623102 26171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:07:59.625130 26171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:07:59.639187 26179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:59.639120 26180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:07:59.639230 26182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:07:59.640648 26171 server_base.cc:1034] running on GCE node
I20260809 13:07:59.641404 26171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:07:59.642524 26171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:07:59.643784 26171 hybrid_clock.cc:648] HybridClock initialized: now 1786280879643738 us; error 43 us; skew 500 ppm
I20260809 13:07:59.644167 26171 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 13:07:59.646605 26171 webserver.cc:460] Webserver started at http://127.28.155.193:44465/ using document root <none> and password file <none>
I20260809 13:07:59.647368 26171 fs_manager.cc:359] Metadata directory not provided
I20260809 13:07:59.647524 26171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:07:59.647881 26171 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:07:59.651103 26171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-0/data/instance:
uuid: "b5bd71dffb0a47a8b6977983bb136e2e"
format_stamp: "Formatted at 2026-08-09 13:07:59 on dist-test-slave-jq4t"
server_key: "2e9ec2de61b21c31fd83fb312112ec6e"
server_key_iv: "3f857bcd3661d7e04a39c9cda67c932e"
server_key_version: "encryptionkey@0"
I20260809 13:07:59.651963 26171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance:
uuid: "b5bd71dffb0a47a8b6977983bb136e2e"
format_stamp: "Formatted at 2026-08-09 13:07:59 on dist-test-slave-jq4t"
server_key: "2e9ec2de61b21c31fd83fb312112ec6e"
server_key_iv: "3f857bcd3661d7e04a39c9cda67c932e"
server_key_version: "encryptionkey@0"
I20260809 13:07:59.657584 26171 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260809 13:07:59.661368 26191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:59.662736 26171 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260809 13:07:59.662921 26171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "b5bd71dffb0a47a8b6977983bb136e2e"
format_stamp: "Formatted at 2026-08-09 13:07:59 on dist-test-slave-jq4t"
server_key: "2e9ec2de61b21c31fd83fb312112ec6e"
server_key_iv: "3f857bcd3661d7e04a39c9cda67c932e"
server_key_version: "encryptionkey@0"
I20260809 13:07:59.663157 26171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:07:59.683434 26171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:07:59.684397 26171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:07:59.684794 26171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:07:59.685883 26171 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:07:59.687598 26171 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:07:59.687736 26171 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:59.687865 26171 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:07:59.687956 26171 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:07:59.723573 26171 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:43273
I20260809 13:07:59.723594 26383 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:43273 every 8 connection(s)
I20260809 13:07:59.725061 26171 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:07:59.727243 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 26171
I20260809 13:07:59.727425 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance
I20260809 13:07:59.727906 29295 external_mini_cluster.cc:1428] Setting key 04b4e8f44b98361bd7a9d11b0b38c644
I20260809 13:07:59.730865 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:0
--local_ip_for_outbound_sockets=127.28.155.194
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:35053
--builtin_ntp_servers=127.28.155.212:39169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 13:07:59.738865 26386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:59.728227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:44873 (local address 127.28.155.254:35053)
0809 13:07:59.728754 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0809 13:07:59.728761 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:07:59.729980 (+ 1219us) server_negotiation.cc:407] Connection header received
0809 13:07:59.732007 (+ 2027us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:07:59.732015 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:07:59.732104 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:07:59.732236 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:07:59.733386 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:59.734123 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:59.735756 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:07:59.736236 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:07:59.736382 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:59.737937 (+ 1555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:07:59.737947 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:07:59.737950 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:07:59.737969 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:07:59.738015 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:07:59.738027 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:07:59.738128 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 13:07:59.738368 (+ 240us) server_negotiation.cc:299] Negotiation successful
0809 13:07:59.738482 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":268,"threads_started":1}
I20260809 13:07:59.739936 26387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:07:59.728669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:35053 (local address 127.28.155.193:44873)
0809 13:07:59.729828 (+ 1159us) negotiation.cc:107] Waiting for socket to connect
0809 13:07:59.729875 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 13:07:59.731722 (+ 1847us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:07:59.732522 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:07:59.732539 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:07:59.732628 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:07:59.733213 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:59.733231 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:59.734301 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:59.734305 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:59.735603 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:07:59.735616 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:07:59.736532 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:07:59.736541 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:07:59.736792 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:07:59.737578 (+ 786us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 13:07:59.737581 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:07:59.737625 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 13:07:59.737715 (+ 90us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:07:59.738130 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:07:59.738144 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:07:59.738155 (+ 11us) client_negotiation.cc:769] Sending connection context
0809 13:07:59.738338 (+ 183us) client_negotiation.cc:240] Negotiation successful
0809 13:07:59.738780 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":392,"threads_started":1}
I20260809 13:07:59.741608 26384 heartbeater.cc:347] Connected to a master server at 127.28.155.254:35053
I20260809 13:07:59.741957 26384 heartbeater.cc:464] Registering TS with master...
I20260809 13:07:59.742780 26384 heartbeater.cc:511] Master 127.28.155.254:35053 requested a full tablet report, sending...
I20260809 13:07:59.745066 26082 ts_manager.cc:194] Registered new tserver with Master: b5bd71dffb0a47a8b6977983bb136e2e (127.28.155.193:43273)
I20260809 13:07:59.746547 26082 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.155.193:44873
W20260809 13:08:00.097615 26388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:00.097908 26388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:00.098043 26388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:00.105536 26388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:00.105659 26388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:00.105829 26388 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:08:00.115540 26388 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:39169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:35053
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:00.116966 26388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:00.118868 26388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:00.132984 26396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:00.132917 26402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:00.132891 26398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:00.133724 26388 server_base.cc:1034] running on GCE node
I20260809 13:08:00.134395 26388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:00.135468 26388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:00.136714 26388 hybrid_clock.cc:648] HybridClock initialized: now 1786280880136661 us; error 46 us; skew 500 ppm
I20260809 13:08:00.137069 26388 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 13:08:00.139489 26388 webserver.cc:460] Webserver started at http://127.28.155.194:34091/ using document root <none> and password file <none>
I20260809 13:08:00.140255 26388 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:00.140398 26388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:00.140771 26388 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:00.143723 26388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-1/data/instance:
uuid: "26335f9300f046928a185b26faef002a"
format_stamp: "Formatted at 2026-08-09 13:08:00 on dist-test-slave-jq4t"
server_key: "d3809f7b15e346d6a351f6ee8bd6cb68"
server_key_iv: "f43ae29426c84de7a4fac81b36faedca"
server_key_version: "encryptionkey@0"
I20260809 13:08:00.144610 26388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance:
uuid: "26335f9300f046928a185b26faef002a"
format_stamp: "Formatted at 2026-08-09 13:08:00 on dist-test-slave-jq4t"
server_key: "d3809f7b15e346d6a351f6ee8bd6cb68"
server_key_iv: "f43ae29426c84de7a4fac81b36faedca"
server_key_version: "encryptionkey@0"
I20260809 13:08:00.149937 26388 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260809 13:08:00.153528 26410 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:00.154985 26388 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 13:08:00.155182 26388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "26335f9300f046928a185b26faef002a"
format_stamp: "Formatted at 2026-08-09 13:08:00 on dist-test-slave-jq4t"
server_key: "d3809f7b15e346d6a351f6ee8bd6cb68"
server_key_iv: "f43ae29426c84de7a4fac81b36faedca"
server_key_version: "encryptionkey@0"
I20260809 13:08:00.155421 26388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:00.176458 26388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:00.177529 26388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:00.177877 26388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:00.178884 26388 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:08:00.180404 26388 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:08:00.180552 26388 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:00.180645 26388 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:08:00.180704 26388 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:00.215608 26388 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:42813
I20260809 13:08:00.215708 26583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:42813 every 8 connection(s)
I20260809 13:08:00.217165 26388 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:08:00.226584 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 26388
I20260809 13:08:00.226785 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance
I20260809 13:08:00.227350 29295 external_mini_cluster.cc:1428] Setting key f9aab5513fc96cfc897bdcc4a1fce142
I20260809 13:08:00.230885 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:0
--local_ip_for_outbound_sockets=127.28.155.195
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:35053
--builtin_ntp_servers=127.28.155.212:39169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 13:08:00.231103 26386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:00.219857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:60347 (local address 127.28.155.254:35053)
0809 13:08:00.220090 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:00.220097 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:00.221596 (+ 1499us) server_negotiation.cc:407] Connection header received
0809 13:08:00.223452 (+ 1856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:00.223456 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:00.223533 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:00.223626 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:00.224788 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:00.225544 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:00.227762 (+ 2218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:00.228201 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:00.228340 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:00.230255 (+ 1915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:00.230260 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:00.230263 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:00.230282 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:00.230317 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:00.230329 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:00.230401 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:00.230692 (+ 291us) server_negotiation.cc:299] Negotiation successful
0809 13:08:00.230774 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 13:08:00.232690 26587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:00.220440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:35053 (local address 127.28.155.194:60347)
0809 13:08:00.221432 (+ 992us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:00.221476 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:00.223187 (+ 1711us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:00.223842 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:00.223851 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:00.223937 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:08:00.224620 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:00.224640 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:00.225686 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:00.225690 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:00.227614 (+ 1924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:00.227629 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:00.228430 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:00.228435 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:00.228777 (+ 342us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:00.229876 (+ 1099us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 13:08:00.229880 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:08:00.229936 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 13:08:00.230060 (+ 124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:08:00.230439 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:08:00.230456 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:08:00.230466 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 13:08:00.230669 (+ 203us) client_negotiation.cc:240] Negotiation successful
0809 13:08:00.231145 (+ 476us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":278,"threads_started":1}
I20260809 13:08:00.234287 26584 heartbeater.cc:347] Connected to a master server at 127.28.155.254:35053
I20260809 13:08:00.234647 26584 heartbeater.cc:464] Registering TS with master...
I20260809 13:08:00.235472 26584 heartbeater.cc:511] Master 127.28.155.254:35053 requested a full tablet report, sending...
I20260809 13:08:00.237051 26082 ts_manager.cc:194] Registered new tserver with Master: 26335f9300f046928a185b26faef002a (127.28.155.194:42813)
I20260809 13:08:00.237901 26082 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.155.194:60347
W20260809 13:08:00.596719 26589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:00.597031 26589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:00.597190 26589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:00.604835 26589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:00.604974 26589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:00.605159 26589 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:08:00.615190 26589 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:39169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:35053
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:00.616756 26589 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:00.618686 26589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:00.632893 26595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:00.632838 26598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:00.632932 26596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:00.634110 26589 server_base.cc:1034] running on GCE node
I20260809 13:08:00.634728 26589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:00.635706 26589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:00.636909 26589 hybrid_clock.cc:648] HybridClock initialized: now 1786280880636865 us; error 51 us; skew 500 ppm
I20260809 13:08:00.637247 26589 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 13:08:00.639601 26589 webserver.cc:460] Webserver started at http://127.28.155.195:43631/ using document root <none> and password file <none>
I20260809 13:08:00.640332 26589 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:00.640455 26589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:00.640834 26589 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:00.643855 26589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-2/data/instance:
uuid: "7a7b87e125754c62bd59209ab2951b5a"
format_stamp: "Formatted at 2026-08-09 13:08:00 on dist-test-slave-jq4t"
server_key: "0527a586f900ff9a086a44c79f77cbdb"
server_key_iv: "44b02aed89df4cdf6bf9c8d8c22ea3f2"
server_key_version: "encryptionkey@0"
I20260809 13:08:00.644770 26589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance:
uuid: "7a7b87e125754c62bd59209ab2951b5a"
format_stamp: "Formatted at 2026-08-09 13:08:00 on dist-test-slave-jq4t"
server_key: "0527a586f900ff9a086a44c79f77cbdb"
server_key_iv: "44b02aed89df4cdf6bf9c8d8c22ea3f2"
server_key_version: "encryptionkey@0"
I20260809 13:08:00.650142 26589 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 13:08:00.653841 26607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:00.655242 26589 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:08:00.655429 26589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "7a7b87e125754c62bd59209ab2951b5a"
format_stamp: "Formatted at 2026-08-09 13:08:00 on dist-test-slave-jq4t"
server_key: "0527a586f900ff9a086a44c79f77cbdb"
server_key_iv: "44b02aed89df4cdf6bf9c8d8c22ea3f2"
server_key_version: "encryptionkey@0"
I20260809 13:08:00.655676 26589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:00.682852 26589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:00.683791 26589 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:00.684142 26589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:00.685361 26589 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:08:00.686959 26589 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:08:00.687089 26589 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:00.687211 26589 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:08:00.687301 26589 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:00.722052 26589 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:41327
I20260809 13:08:00.722148 26786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:41327 every 8 connection(s)
I20260809 13:08:00.723584 26589 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:08:00.726028 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 26589
I20260809 13:08:00.726217 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance
I20260809 13:08:00.726678 29295 external_mini_cluster.cc:1428] Setting key 2f0d8facd32ad5b022406eedb55de1f1
I20260809 13:08:00.737560 26386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:00.727779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:46283 (local address 127.28.155.254:35053)
0809 13:08:00.728178 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:00.728185 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:00.729006 (+ 821us) server_negotiation.cc:407] Connection header received
0809 13:08:00.731090 (+ 2084us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:00.731094 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:00.731160 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:00.731246 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:00.732271 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:00.733095 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:00.734712 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:00.735124 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:00.735272 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:00.736680 (+ 1408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:00.736685 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:00.736689 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:00.736706 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:00.736740 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:00.736752 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:00.736849 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:00.737075 (+ 226us) server_negotiation.cc:299] Negotiation successful
0809 13:08:00.737186 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251}
I20260809 13:08:00.738600 26792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:00.727239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:35053 (local address 127.28.155.195:46283)
0809 13:08:00.728819 (+ 1580us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:00.728870 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:00.730843 (+ 1973us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:00.731440 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:00.731449 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:00.731539 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:08:00.732125 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:00.732142 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:00.733290 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:00.733294 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:00.734559 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:00.734573 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:00.735363 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:00.735370 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:00.735610 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:00.736304 (+ 694us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 13:08:00.736307 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:08:00.736348 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 13:08:00.736434 (+ 86us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:08:00.736850 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:08:00.736865 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:08:00.736874 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 13:08:00.737060 (+ 186us) client_negotiation.cc:240] Negotiation successful
0809 13:08:00.737468 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":982,"thread_start_us":750,"threads_started":1}
I20260809 13:08:00.739931 26787 heartbeater.cc:347] Connected to a master server at 127.28.155.254:35053
I20260809 13:08:00.740271 26787 heartbeater.cc:464] Registering TS with master...
I20260809 13:08:00.741222 26787 heartbeater.cc:511] Master 127.28.155.254:35053 requested a full tablet report, sending...
I20260809 13:08:00.742681 26082 ts_manager.cc:194] Registered new tserver with Master: 7a7b87e125754c62bd59209ab2951b5a (127.28.155.195:41327)
I20260809 13:08:00.743446 26082 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.155.195:46283
I20260809 13:08:00.749580 26384 heartbeater.cc:503] Master 127.28.155.254:35053 was elected leader, sending a full tablet report...
I20260809 13:08:00.754823 29295 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 13:08:00.765470 26386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:00.759484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42648 (local address 127.28.155.254:35053)
0809 13:08:00.759740 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:00.759748 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:00.760236 (+ 488us) server_negotiation.cc:407] Connection header received
0809 13:08:00.760404 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:00.760410 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:00.760523 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:00.760631 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:00.761155 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:00.761864 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:00.763129 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:00.763528 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:00.763619 (+ 91us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:00.764795 (+ 1176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:00.764800 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:00.764804 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:00.764820 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:00.764855 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:00.764867 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:00.764984 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:00.765164 (+ 180us) server_negotiation.cc:299] Negotiation successful
0809 13:08:00.765212 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 13:08:00.769671 26082 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42648:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 13:08:00.776711 26082 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:08:00.815582 26816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:00.790849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54572 (local address 127.28.155.195:41327)
0809 13:08:00.805601 (+ 14752us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:00.805613 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:00.806587 (+ 974us) server_negotiation.cc:407] Connection header received
0809 13:08:00.806752 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:00.806764 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:00.807120 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:00.807364 (+ 244us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:08:00.808380 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:00.810399 (+ 2019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:00.812953 (+ 2554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:00.814323 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:00.814550 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:00.814810 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:00.815039 (+ 229us) server_negotiation.cc:299] Negotiation successful
0809 13:08:00.815227 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14503,"thread_start_us":14311,"threads_started":1}
I20260809 13:08:00.815677 26811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:00.790185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:41327 (local address 127.0.0.1:54572)
0809 13:08:00.806221 (+ 16036us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:00.806246 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:00.806415 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:00.807704 (+ 1289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:00.807709 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:00.807734 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:08:00.808112 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:00.808124 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:00.810539 (+ 2415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:00.810544 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:00.812679 (+ 2135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:00.812695 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:00.814534 (+ 1839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:00.814541 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:00.814762 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:00.814814 (+ 52us) client_negotiation.cc:769] Sending connection context
0809 13:08:00.814985 (+ 171us) client_negotiation.cc:240] Negotiation successful
0809 13:08:00.815184 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15834,"mutex_wait_us":73,"thread_start_us":15634,"threads_started":1}
I20260809 13:08:00.816622 26809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:00.789707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:43273 (local address 127.0.0.1:45316)
0809 13:08:00.803410 (+ 13703us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:00.803493 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:00.803804 (+ 311us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:00.808424 (+ 4620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:00.808430 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:00.808465 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:08:00.808972 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:00.808987 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:00.810970 (+ 1983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:00.810977 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:00.813296 (+ 2319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:00.813306 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:00.815679 (+ 2373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:00.815686 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:00.815909 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:00.815996 (+ 87us) client_negotiation.cc:769] Sending connection context
0809 13:08:00.816073 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 13:08:00.816232 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13277,"mutex_wait_us":56,"thread_start_us":13046,"threads_started":1}
I20260809 13:08:00.816767 26815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:00.790673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40520 (local address 127.28.155.194:42813)
0809 13:08:00.804636 (+ 13963us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:00.804651 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:00.807549 (+ 2898us) server_negotiation.cc:407] Connection header received
0809 13:08:00.807670 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:00.807678 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:00.807900 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:00.808134 (+ 234us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:08:00.808860 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:00.810403 (+ 1543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:00.813580 (+ 3177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:00.815068 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:00.815235 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:00.815454 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:00.816203 (+ 749us) server_negotiation.cc:299] Negotiation successful
0809 13:08:00.816392 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13678,"thread_start_us":13976,"threads_started":1}
I20260809 13:08:00.817034 26814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:00.790326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:42813 (local address 127.0.0.1:40520)
0809 13:08:00.807216 (+ 16890us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:00.807239 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:00.807386 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:00.808126 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:00.808131 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:00.808161 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:08:00.808638 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:00.808655 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:00.810607 (+ 1952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:00.810611 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:00.813271 (+ 2660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:00.813288 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:00.815646 (+ 2358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:00.815665 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:00.815903 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:00.815993 (+ 90us) client_negotiation.cc:769] Sending connection context
0809 13:08:00.816074 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 13:08:00.816674 (+ 600us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16760,"mutex_wait_us":574,"thread_start_us":16628,"threads_started":1}
I20260809 13:08:00.818038 26810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:00.789835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45316 (local address 127.28.155.193:43273)
0809 13:08:00.807672 (+ 17837us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:00.807680 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:00.807705 (+ 25us) server_negotiation.cc:407] Connection header received
0809 13:08:00.807800 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:00.807805 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:00.807985 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:00.808200 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:08:00.809197 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:00.810801 (+ 1604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:00.813580 (+ 2779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:00.815068 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:00.815266 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:00.815454 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:00.817477 (+ 2023us) server_negotiation.cc:299] Negotiation successful
0809 13:08:00.817665 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17651,"thread_start_us":17493,"threads_started":1}
I20260809 13:08:00.820447 26680 tablet_service.cc:1467] Processing CreateTablet for tablet 7f9e1700c1a3469ba431729034f24ef3 (DEFAULT_TABLE table=test-table [id=186f323adb1f443bbff5f2e24d8c2301]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:08:00.821851 26680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f9e1700c1a3469ba431729034f24ef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:00.821672 26259 tablet_service.cc:1467] Processing CreateTablet for tablet 7f9e1700c1a3469ba431729034f24ef3 (DEFAULT_TABLE table=test-table [id=186f323adb1f443bbff5f2e24d8c2301]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:08:00.823201 26259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f9e1700c1a3469ba431729034f24ef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:00.822767 26482 tablet_service.cc:1467] Processing CreateTablet for tablet 7f9e1700c1a3469ba431729034f24ef3 (DEFAULT_TABLE table=test-table [id=186f323adb1f443bbff5f2e24d8c2301]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:08:00.824160 26482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f9e1700c1a3469ba431729034f24ef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:00.834478 26817 tablet_bootstrap.cc:492] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a: Bootstrap starting.
I20260809 13:08:00.838404 26817 tablet_bootstrap.cc:654] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:00.839486 26817 log.cc:824] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:00.844738 26819 tablet_bootstrap.cc:492] T 7f9e1700c1a3469ba431729034f24ef3 P b5bd71dffb0a47a8b6977983bb136e2e: Bootstrap starting.
I20260809 13:08:00.847167 26820 tablet_bootstrap.cc:492] T 7f9e1700c1a3469ba431729034f24ef3 P 26335f9300f046928a185b26faef002a: Bootstrap starting.
I20260809 13:08:00.849459 26819 tablet_bootstrap.cc:654] T 7f9e1700c1a3469ba431729034f24ef3 P b5bd71dffb0a47a8b6977983bb136e2e: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:00.850505 26819 log.cc:824] T 7f9e1700c1a3469ba431729034f24ef3 P b5bd71dffb0a47a8b6977983bb136e2e: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:00.850912 26820 tablet_bootstrap.cc:654] T 7f9e1700c1a3469ba431729034f24ef3 P 26335f9300f046928a185b26faef002a: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:00.851717 26817 tablet_bootstrap.cc:492] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a: No bootstrap required, opened a new log
I20260809 13:08:00.852027 26817 ts_tablet_manager.cc:1397] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.011s
I20260809 13:08:00.852260 26820 log.cc:824] T 7f9e1700c1a3469ba431729034f24ef3 P 26335f9300f046928a185b26faef002a: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:00.853454 26819 tablet_bootstrap.cc:492] T 7f9e1700c1a3469ba431729034f24ef3 P b5bd71dffb0a47a8b6977983bb136e2e: No bootstrap required, opened a new log
I20260809 13:08:00.853739 26819 ts_tablet_manager.cc:1397] T 7f9e1700c1a3469ba431729034f24ef3 P b5bd71dffb0a47a8b6977983bb136e2e: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260809 13:08:00.855383 26820 tablet_bootstrap.cc:492] T 7f9e1700c1a3469ba431729034f24ef3 P 26335f9300f046928a185b26faef002a: No bootstrap required, opened a new log
I20260809 13:08:00.855647 26820 ts_tablet_manager.cc:1397] T 7f9e1700c1a3469ba431729034f24ef3 P 26335f9300f046928a185b26faef002a: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260809 13:08:00.861948 26819 raft_consensus.cc:348] T 7f9e1700c1a3469ba431729034f24ef3 P b5bd71dffb0a47a8b6977983bb136e2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5bd71dffb0a47a8b6977983bb136e2e" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 43273 } } peers { permanent_uuid: "26335f9300f046928a185b26faef002a" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 42813 } } peers { permanent_uuid: "7a7b87e125754c62bd59209ab2951b5a" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 41327 } }
I20260809 13:08:00.862365 26819 raft_consensus.cc:374] T 7f9e1700c1a3469ba431729034f24ef3 P b5bd71dffb0a47a8b6977983bb136e2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:08:00.862476 26819 raft_consensus.cc:729] T 7f9e1700c1a3469ba431729034f24ef3 P b5bd71dffb0a47a8b6977983bb136e2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5bd71dffb0a47a8b6977983bb136e2e, State: Initialized, Role: FOLLOWER
I20260809 13:08:00.863109 26819 consensus_queue.cc:260] T 7f9e1700c1a3469ba431729034f24ef3 P b5bd71dffb0a47a8b6977983bb136e2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5bd71dffb0a47a8b6977983bb136e2e" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 43273 } } peers { permanent_uuid: "26335f9300f046928a185b26faef002a" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 42813 } } peers { permanent_uuid: "7a7b87e125754c62bd59209ab2951b5a" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 41327 } }
I20260809 13:08:00.863279 26817 raft_consensus.cc:348] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5bd71dffb0a47a8b6977983bb136e2e" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 43273 } } peers { permanent_uuid: "26335f9300f046928a185b26faef002a" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 42813 } } peers { permanent_uuid: "7a7b87e125754c62bd59209ab2951b5a" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 41327 } }
I20260809 13:08:00.863807 26817 raft_consensus.cc:374] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:08:00.863955 26817 raft_consensus.cc:729] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a7b87e125754c62bd59209ab2951b5a, State: Initialized, Role: FOLLOWER
I20260809 13:08:00.864689 26817 consensus_queue.cc:260] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5bd71dffb0a47a8b6977983bb136e2e" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 43273 } } peers { permanent_uuid: "26335f9300f046928a185b26faef002a" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 42813 } } peers { permanent_uuid: "7a7b87e125754c62bd59209ab2951b5a" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 41327 } }
I20260809 13:08:00.865039 26819 ts_tablet_manager.cc:1428] T 7f9e1700c1a3469ba431729034f24ef3 P b5bd71dffb0a47a8b6977983bb136e2e: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260809 13:08:00.865928 26787 heartbeater.cc:503] Master 127.28.155.254:35053 was elected leader, sending a full tablet report...
I20260809 13:08:00.866604 26817 ts_tablet_manager.cc:1428] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
I20260809 13:08:00.869338 26820 raft_consensus.cc:348] T 7f9e1700c1a3469ba431729034f24ef3 P 26335f9300f046928a185b26faef002a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5bd71dffb0a47a8b6977983bb136e2e" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 43273 } } peers { permanent_uuid: "26335f9300f046928a185b26faef002a" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 42813 } } peers { permanent_uuid: "7a7b87e125754c62bd59209ab2951b5a" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 41327 } }
I20260809 13:08:00.869822 26820 raft_consensus.cc:374] T 7f9e1700c1a3469ba431729034f24ef3 P 26335f9300f046928a185b26faef002a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:08:00.869988 26820 raft_consensus.cc:729] T 7f9e1700c1a3469ba431729034f24ef3 P 26335f9300f046928a185b26faef002a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26335f9300f046928a185b26faef002a, State: Initialized, Role: FOLLOWER
I20260809 13:08:00.870662 26820 consensus_queue.cc:260] T 7f9e1700c1a3469ba431729034f24ef3 P 26335f9300f046928a185b26faef002a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5bd71dffb0a47a8b6977983bb136e2e" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 43273 } } peers { permanent_uuid: "26335f9300f046928a185b26faef002a" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 42813 } } peers { permanent_uuid: "7a7b87e125754c62bd59209ab2951b5a" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 41327 } }
I20260809 13:08:00.871927 26584 heartbeater.cc:503] Master 127.28.155.254:35053 was elected leader, sending a full tablet report...
I20260809 13:08:00.872699 26820 ts_tablet_manager.cc:1428] T 7f9e1700c1a3469ba431729034f24ef3 P 26335f9300f046928a185b26faef002a: Time spent starting tablet: real 0.017s user 0.014s sys 0.000s
W20260809 13:08:00.969339 26585 tablet.cc:2369] T 7f9e1700c1a3469ba431729034f24ef3 P 26335f9300f046928a185b26faef002a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 13:08:00.975553 26788 tablet.cc:2369] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 13:08:00.977671 26385 tablet.cc:2369] T 7f9e1700c1a3469ba431729034f24ef3 P b5bd71dffb0a47a8b6977983bb136e2e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:08:01.081645 26825 raft_consensus.cc:482] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:08:01.082016 26825 raft_consensus.cc:504] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5bd71dffb0a47a8b6977983bb136e2e" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 43273 } } peers { permanent_uuid: "26335f9300f046928a185b26faef002a" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 42813 } } peers { permanent_uuid: "7a7b87e125754c62bd59209ab2951b5a" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 41327 } }
I20260809 13:08:01.083891 26825 leader_election.cc:288] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5bd71dffb0a47a8b6977983bb136e2e (127.28.155.193:43273), 26335f9300f046928a185b26faef002a (127.28.155.194:42813)
I20260809 13:08:01.090814 26810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:01.084511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:57799 (local address 127.28.155.193:43273)
0809 13:08:01.084810 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:01.084819 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:01.084924 (+ 105us) server_negotiation.cc:407] Connection header received
0809 13:08:01.085171 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:01.085179 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:01.085288 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:01.085400 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:08:01.086589 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:01.087312 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:01.089104 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:01.089912 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:01.090088 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:01.090163 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:01.090416 (+ 253us) server_negotiation.cc:299] Negotiation successful
0809 13:08:01.090558 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116}
I20260809 13:08:01.090812 26792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:01.084378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:43273 (local address 127.28.155.195:57799)
0809 13:08:01.084776 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:01.084798 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:01.084983 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:01.086028 (+ 1045us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:01.086036 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:01.086089 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:08:01.086389 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:01.086402 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:01.087459 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:01.087465 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:01.088924 (+ 1459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:01.088941 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:01.090076 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:01.090082 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:01.090251 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:01.090276 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 13:08:01.090381 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 13:08:01.090522 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238}
I20260809 13:08:01.091712 26815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:01.084566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:60149 (local address 127.28.155.194:42813)
0809 13:08:01.084771 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:01.084778 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:01.086596 (+ 1818us) server_negotiation.cc:407] Connection header received
0809 13:08:01.086793 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:01.086798 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:01.086875 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:01.086975 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:08:01.087564 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:01.088256 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:01.090047 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:01.090803 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:01.090991 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:01.091061 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:01.091370 (+ 309us) server_negotiation.cc:299] Negotiation successful
0809 13:08:01.091515 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 13:08:01.091938 26305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f9e1700c1a3469ba431729034f24ef3" candidate_uuid: "7a7b87e125754c62bd59209ab2951b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5bd71dffb0a47a8b6977983bb136e2e" is_pre_election: true
I20260809 13:08:01.092305 26828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:01.085072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:42813 (local address 127.28.155.195:60149)
0809 13:08:01.086475 (+ 1403us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:01.086490 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:01.086641 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:01.086995 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:01.086999 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:01.087024 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:08:01.087379 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:01.087387 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:01.088417 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:01.088422 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:01.089834 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:01.089847 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:01.090994 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:01.091000 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:01.091176 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:01.091199 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 13:08:01.091928 (+ 729us) client_negotiation.cc:240] Negotiation successful
0809 13:08:01.092036 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1292,"thread_start_us":1100,"threads_started":1}
I20260809 13:08:01.092653 26305 raft_consensus.cc:2454] T 7f9e1700c1a3469ba431729034f24ef3 P b5bd71dffb0a47a8b6977983bb136e2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a7b87e125754c62bd59209ab2951b5a in term 0.
I20260809 13:08:01.093499 26612 leader_election.cc:302] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a7b87e125754c62bd59209ab2951b5a, b5bd71dffb0a47a8b6977983bb136e2e; no voters:
I20260809 13:08:01.093568 26509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f9e1700c1a3469ba431729034f24ef3" candidate_uuid: "7a7b87e125754c62bd59209ab2951b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26335f9300f046928a185b26faef002a" is_pre_election: true
I20260809 13:08:01.094018 26825 raft_consensus.cc:2781] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:08:01.094182 26825 raft_consensus.cc:482] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:08:01.094187 26509 raft_consensus.cc:2454] T 7f9e1700c1a3469ba431729034f24ef3 P 26335f9300f046928a185b26faef002a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a7b87e125754c62bd59209ab2951b5a in term 0.
I20260809 13:08:01.094297 26825 raft_consensus.cc:3037] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:01.096761 26825 raft_consensus.cc:504] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5bd71dffb0a47a8b6977983bb136e2e" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 43273 } } peers { permanent_uuid: "26335f9300f046928a185b26faef002a" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 42813 } } peers { permanent_uuid: "7a7b87e125754c62bd59209ab2951b5a" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 41327 } }
I20260809 13:08:01.097414 26825 leader_election.cc:288] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a [CANDIDATE]: Term 1 election: Requested vote from peers b5bd71dffb0a47a8b6977983bb136e2e (127.28.155.193:43273), 26335f9300f046928a185b26faef002a (127.28.155.194:42813)
I20260809 13:08:01.098047 26305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f9e1700c1a3469ba431729034f24ef3" candidate_uuid: "7a7b87e125754c62bd59209ab2951b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5bd71dffb0a47a8b6977983bb136e2e"
I20260809 13:08:01.098032 26509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f9e1700c1a3469ba431729034f24ef3" candidate_uuid: "7a7b87e125754c62bd59209ab2951b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26335f9300f046928a185b26faef002a"
I20260809 13:08:01.098285 26305 raft_consensus.cc:3037] T 7f9e1700c1a3469ba431729034f24ef3 P b5bd71dffb0a47a8b6977983bb136e2e [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:01.098285 26509 raft_consensus.cc:3037] T 7f9e1700c1a3469ba431729034f24ef3 P 26335f9300f046928a185b26faef002a [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:01.101840 26305 raft_consensus.cc:2454] T 7f9e1700c1a3469ba431729034f24ef3 P b5bd71dffb0a47a8b6977983bb136e2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a7b87e125754c62bd59209ab2951b5a in term 1.
I20260809 13:08:01.101840 26509 raft_consensus.cc:2454] T 7f9e1700c1a3469ba431729034f24ef3 P 26335f9300f046928a185b26faef002a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a7b87e125754c62bd59209ab2951b5a in term 1.
I20260809 13:08:01.102396 26611 leader_election.cc:302] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26335f9300f046928a185b26faef002a, 7a7b87e125754c62bd59209ab2951b5a; no voters:
I20260809 13:08:01.102792 26825 raft_consensus.cc:2781] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:08:01.103439 26825 raft_consensus.cc:686] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a [term 1 LEADER]: Becoming Leader. State: Replica: 7a7b87e125754c62bd59209ab2951b5a, State: Running, Role: LEADER
I20260809 13:08:01.104084 26825 consensus_queue.cc:237] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5bd71dffb0a47a8b6977983bb136e2e" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 43273 } } peers { permanent_uuid: "26335f9300f046928a185b26faef002a" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 42813 } } peers { permanent_uuid: "7a7b87e125754c62bd59209ab2951b5a" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 41327 } }
I20260809 13:08:01.108966 26081 catalog_manager.cc:5495] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a7b87e125754c62bd59209ab2951b5a (127.28.155.195). New cstate: current_term: 1 leader_uuid: "7a7b87e125754c62bd59209ab2951b5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5bd71dffb0a47a8b6977983bb136e2e" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 43273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26335f9300f046928a185b26faef002a" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 42813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a7b87e125754c62bd59209ab2951b5a" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 41327 } health_report { overall_health: HEALTHY } } }
I20260809 13:08:01.187871 26816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:01.182597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54576 (local address 127.28.155.195:41327)
0809 13:08:01.182773 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:01.182778 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:01.182798 (+ 20us) server_negotiation.cc:407] Connection header received
0809 13:08:01.182963 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:01.182967 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:01.183066 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:01.183208 (+ 142us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:08:01.183568 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:01.184337 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:01.185814 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:01.186231 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:01.186326 (+ 95us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:01.186812 (+ 486us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:08:01.187361 (+ 549us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:08:01.187492 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:01.187628 (+ 136us) server_negotiation.cc:299] Negotiation successful
0809 13:08:01.187668 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 13:08:01.196225 26509 raft_consensus.cc:1261] T 7f9e1700c1a3469ba431729034f24ef3 P 26335f9300f046928a185b26faef002a [term 1 FOLLOWER]: Refusing update from remote peer 7a7b87e125754c62bd59209ab2951b5a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:08:01.196225 26305 raft_consensus.cc:1261] T 7f9e1700c1a3469ba431729034f24ef3 P b5bd71dffb0a47a8b6977983bb136e2e [term 1 FOLLOWER]: Refusing update from remote peer 7a7b87e125754c62bd59209ab2951b5a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:08:01.197355 26829 consensus_queue.cc:1035] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5bd71dffb0a47a8b6977983bb136e2e" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 43273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:08:01.197728 26825 consensus_queue.cc:1035] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "26335f9300f046928a185b26faef002a" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 42813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:08:01.209990 26833 mvcc.cc:205] Tried to move back new op lower bound from 7316606489369772032 to 7316606489006923776. Current Snapshot: MvccSnapshot[applied={T|T < 7316606489369772032}]
I20260809 13:08:01.228566 26081 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42648:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:08:01.228876 26081 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42648:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:08:01.233304 26081 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a2c2d75c4a3340b1af405c9a8742ea44: Sending DeleteTablet for 3 replicas of tablet 7f9e1700c1a3469ba431729034f24ef3
I20260809 13:08:01.234593 26259 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f9e1700c1a3469ba431729034f24ef3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:08:01 UTC) from {username='slave'} at 127.0.0.1:45316
I20260809 13:08:01.234760 26482 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f9e1700c1a3469ba431729034f24ef3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:08:01 UTC) from {username='slave'} at 127.0.0.1:40520
I20260809 13:08:01.235891 26680 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f9e1700c1a3469ba431729034f24ef3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:08:01 UTC) from {username='slave'} at 127.0.0.1:54572
I20260809 13:08:01.236406 26847 tablet_replica.cc:330] T 7f9e1700c1a3469ba431729034f24ef3 P 26335f9300f046928a185b26faef002a: stopping tablet replica
I20260809 13:08:01.236944 26847 raft_consensus.cc:2229] T 7f9e1700c1a3469ba431729034f24ef3 P 26335f9300f046928a185b26faef002a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:08:01.237528 26847 raft_consensus.cc:2258] T 7f9e1700c1a3469ba431729034f24ef3 P 26335f9300f046928a185b26faef002a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:08:01.238054 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 26171
I20260809 13:08:01.242461 26847 ts_tablet_manager.cc:1905] T 7f9e1700c1a3469ba431729034f24ef3 P 26335f9300f046928a185b26faef002a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:08:01.251312 26847 ts_tablet_manager.cc:1918] T 7f9e1700c1a3469ba431729034f24ef3 P 26335f9300f046928a185b26faef002a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:08:01.251662 26847 log.cc:1196] T 7f9e1700c1a3469ba431729034f24ef3 P 26335f9300f046928a185b26faef002a: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-1/wal/wals/7f9e1700c1a3469ba431729034f24ef3
I20260809 13:08:01.252394 26847 ts_tablet_manager.cc:1939] T 7f9e1700c1a3469ba431729034f24ef3 P 26335f9300f046928a185b26faef002a: Deleting consensus metadata
I20260809 13:08:01.253866 26848 tablet_replica.cc:330] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a: stopping tablet replica
I20260809 13:08:01.254822 26061 catalog_manager.cc:4841] TS 26335f9300f046928a185b26faef002a (127.28.155.194:42813): tablet 7f9e1700c1a3469ba431729034f24ef3 (table test-table [id=186f323adb1f443bbff5f2e24d8c2301]) successfully deleted
I20260809 13:08:01.255295 26848 raft_consensus.cc:2229] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a [term 1 LEADER]: Raft consensus shutting down.
I20260809 13:08:01.255637 26845 tablet_replica.cc:330] T 7f9e1700c1a3469ba431729034f24ef3 P b5bd71dffb0a47a8b6977983bb136e2e: stopping tablet replica
I20260809 13:08:01.255992 26848 raft_consensus.cc:2258] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:08:01.256013 26845 raft_consensus.cc:2229] T 7f9e1700c1a3469ba431729034f24ef3 P b5bd71dffb0a47a8b6977983bb136e2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:08:01.256583 26845 raft_consensus.cc:2258] T 7f9e1700c1a3469ba431729034f24ef3 P b5bd71dffb0a47a8b6977983bb136e2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:08:01.258164 26848 ts_tablet_manager.cc:1905] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:08:01.258930 26845 ts_tablet_manager.cc:1905] T 7f9e1700c1a3469ba431729034f24ef3 P b5bd71dffb0a47a8b6977983bb136e2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:08:01.261739 26810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:01.239596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45324 (local address 127.28.155.193:43273)
0809 13:08:01.239793 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:01.239799 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:01.247823 (+ 8024us) server_negotiation.cc:407] Connection header received
0809 13:08:01.248081 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:01.248089 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:01.248270 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:01.248406 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:01.249229 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:01.250509 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:01.252667 (+ 2158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:01.253383 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:01.253494 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:01.259647 (+ 6153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:01.259663 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:01.259679 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:01.260709 (+ 1030us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:01.260780 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:01.260807 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:01.260930 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:01.261199 (+ 269us) server_negotiation.cc:299] Negotiation successful
0809 13:08:01.261349 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 13:08:01.263026 26378 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:08:01.265252 26848 ts_tablet_manager.cc:1918] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:08:01.265735 26848 log.cc:1196] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786280548611909-29295-0/minicluster-data/ts-2/wal/wals/7f9e1700c1a3469ba431729034f24ef3
I20260809 13:08:01.266672 26848 ts_tablet_manager.cc:1939] T 7f9e1700c1a3469ba431729034f24ef3 P 7a7b87e125754c62bd59209ab2951b5a: Deleting consensus metadata
I20260809 13:08:01.269735 26060 catalog_manager.cc:4841] TS 7a7b87e125754c62bd59209ab2951b5a (127.28.155.195:41327): tablet 7f9e1700c1a3469ba431729034f24ef3 (table test-table [id=186f323adb1f443bbff5f2e24d8c2301]) successfully deleted
I20260809 13:08:01.361117 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 26171
W20260809 13:08:01.395008 26063 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.155.193:43273 (error 108)
I20260809 13:08:01.395531 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 26388
I20260809 13:08:01.398176 26855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:01.396933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:43273 (local address 127.0.0.1:45334)
0809 13:08:01.397843 (+ 910us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:01.397987 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:43273: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":780,"thread_start_us":640,"threads_started":1}
W20260809 13:08:01.398486 26063 catalog_manager.cc:4584] TS b5bd71dffb0a47a8b6977983bb136e2e (127.28.155.193:43273): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7f9e1700c1a3469ba431729034f24ef3: Network error: Client connection negotiation failed: client connection to 127.28.155.193:43273: connect: Connection refused (error 111)
I20260809 13:08:01.404259 26815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:01.396438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40526 (local address 127.28.155.194:42813)
0809 13:08:01.396657 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:01.396661 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:01.396756 (+ 95us) server_negotiation.cc:407] Connection header received
0809 13:08:01.396970 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:01.396977 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:01.397133 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:01.397281 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:01.397813 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:01.399016 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:01.401045 (+ 2029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:01.401482 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:01.401586 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:01.402777 (+ 1191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:01.402785 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:01.402799 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:01.403432 (+ 633us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:01.403483 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:01.403505 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:01.403597 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:01.403764 (+ 167us) server_negotiation.cc:299] Negotiation successful
0809 13:08:01.403872 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260809 13:08:01.405073 26576 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:08:01.452278 26855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:01.451688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:43273 (local address 127.0.0.1:45348)
0809 13:08:01.451958 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:01.452081 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:43273: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260809 13:08:01.453634 26855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:01.453181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:43273 (local address 127.0.0.1:45364)
0809 13:08:01.453368 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:01.453460 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:43273: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 13:08:01.497776 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 26388
I20260809 13:08:01.514355 26855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:01.513859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:43273 (local address 127.0.0.1:45374)
0809 13:08:01.514088 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:01.514189 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:43273: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260809 13:08:01.515563 26855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:01.515162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:43273 (local address 127.0.0.1:45390)
0809 13:08:01.515342 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:01.515416 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:43273: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 13:08:01.533752 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 26589
I20260809 13:08:01.541530 26816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:01.534757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54582 (local address 127.28.155.195:41327)
0809 13:08:01.534969 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:01.534977 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:01.535000 (+ 23us) server_negotiation.cc:407] Connection header received
0809 13:08:01.535077 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:01.535083 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:01.535184 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:01.535305 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:01.535754 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:01.536725 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:01.538046 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:01.538542 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:01.538705 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:01.539923 (+ 1218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:01.539932 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:01.539947 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:01.540682 (+ 735us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:01.540733 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:01.540755 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:01.540874 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:01.541022 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 13:08:01.541146 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 13:08:01.542269 26782 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:08:01.596524 26855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:01.595883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:43273 (local address 127.0.0.1:45404)
0809 13:08:01.596147 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:01.596268 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:43273: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260809 13:08:01.597754 26855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:01.597256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:43273 (local address 127.0.0.1:45406)
0809 13:08:01.597485 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:01.597583 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:43273: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
I20260809 13:08:01.670850 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 26589
I20260809 13:08:01.700729 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 26038
I20260809 13:08:01.702021 26127 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:08:01.817358 26855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:01.816580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:43273 (local address 127.0.0.1:45418)
0809 13:08:01.816963 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:01.817117 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.193:43273: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218}
I20260809 13:08:01.817385 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 26038
2026-08-09T13:08:01Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (3268 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:08:01 dist-test-slave-jq4t krb5kdc[26867](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:08:01 dist-test-slave-jq4t krb5kdc[26867](info): set up 2 sockets
Aug 09 13:08:01 dist-test-slave-jq4t krb5kdc[26867](info): commencing operation
krb5kdc: starting...
W20260809 13:08:03.167523 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.300s user 0.005s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:08:03 dist-test-slave-jq4t krb5kdc[26867](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:08:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:08:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
I20260809 13:08:03.516426 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:43569
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:39399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:43569
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:08:03.904458 26883 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:03.904891 26883 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:03.905011 26883 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:03.912981 26883 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:08:03.913148 26883 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:03.913216 26883 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:03.913281 26883 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:08:03.913329 26883 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:08:03.923959 26883 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:39399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:43569
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:43569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:03.925597 26883 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:03.927013 26883 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:03.940274 26895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:03.940228 26892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:03.940330 26888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:03.946416 26883 server_base.cc:1034] running on GCE node
I20260809 13:08:03.947415 26883 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:03.949198 26883 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:03.950425 26883 hybrid_clock.cc:648] HybridClock initialized: now 1786280883950362 us; error 59 us; skew 500 ppm
I20260809 13:08:03.950832 26883 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:08:03 dist-test-slave-jq4t krb5kdc[26867](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280883, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:08:03.954454 26883 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:08:03.956295 26883 webserver.cc:460] Webserver started at http://127.28.155.254:33785/ using document root <none> and password file <none>
I20260809 13:08:03.957118 26883 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:03.957231 26883 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:03.957508 26883 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:03.960845 26883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "bc260ac69af44b818674c0acfa194e53"
format_stamp: "Formatted at 2026-08-09 13:08:03 on dist-test-slave-jq4t"
server_key: "d0dcf8a5a3e4645414f45706367db4fb"
server_key_iv: "2d7b091aaf5efbb98452e8eec95fe3dc"
server_key_version: "encryptionkey@0"
I20260809 13:08:03.961647 26883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "bc260ac69af44b818674c0acfa194e53"
format_stamp: "Formatted at 2026-08-09 13:08:03 on dist-test-slave-jq4t"
server_key: "d0dcf8a5a3e4645414f45706367db4fb"
server_key_iv: "2d7b091aaf5efbb98452e8eec95fe3dc"
server_key_version: "encryptionkey@0"
I20260809 13:08:03.967239 26883 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 13:08:03.970877 26906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:03.972304 26883 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 13:08:03.972564 26883 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "bc260ac69af44b818674c0acfa194e53"
format_stamp: "Formatted at 2026-08-09 13:08:03 on dist-test-slave-jq4t"
server_key: "d0dcf8a5a3e4645414f45706367db4fb"
server_key_iv: "2d7b091aaf5efbb98452e8eec95fe3dc"
server_key_version: "encryptionkey@0"
I20260809 13:08:03.972806 26883 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:03.990098 26883 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:03.995090 26883 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:03.995446 26883 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:04.016335 26883 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:43569
I20260809 13:08:04.016360 26982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:43569 every 8 connection(s)
I20260809 13:08:04.017921 26883 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:08:04.022150 26984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:04.026616 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 26883
I20260809 13:08:04.026826 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:08:04.027398 29295 external_mini_cluster.cc:1428] Setting key faf6d28f89ce4e7e3ede7d2c1c579ed1
I20260809 13:08:04.037122 26984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc260ac69af44b818674c0acfa194e53: Bootstrap starting.
I20260809 13:08:04.041337 26984 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bc260ac69af44b818674c0acfa194e53: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:04.042872 26984 log.cc:824] T 00000000000000000000000000000000 P bc260ac69af44b818674c0acfa194e53: Log is configured to *not* fsync() on all Append() calls
Aug 09 13:08:04 dist-test-slave-jq4t krb5kdc[26867](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:08:04.046522 26984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc260ac69af44b818674c0acfa194e53: No bootstrap required, opened a new log
I20260809 13:08:04.053906 26990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:04.029571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37762 (local address 127.28.155.254:43569)
0809 13:08:04.030470 (+ 899us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:04.030482 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:04.030526 (+ 44us) server_negotiation.cc:407] Connection header received
0809 13:08:04.032277 (+ 1751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:04.032302 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:04.032817 (+ 515us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:04.033168 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:04.035318 (+ 2150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:04.036813 (+ 1495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:04.038749 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:04.039484 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:04.039622 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:04.045259 (+ 5637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:04.045268 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:04.045285 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:04.045327 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:04.048976 (+ 3649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:04.049915 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:04.049923 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:04.049930 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:04.050131 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:04.050599 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:04.050610 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:04.050613 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:04.051298 (+ 685us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:04.051653 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:04.052181 (+ 528us) server_negotiation.cc:299] Negotiation successful
0809 13:08:04.052707 (+ 526us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":683,"thread_start_us":458,"threads_started":1}
I20260809 13:08:04.055480 26984 raft_consensus.cc:348] T 00000000000000000000000000000000 P bc260ac69af44b818674c0acfa194e53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc260ac69af44b818674c0acfa194e53" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 43569 } }
I20260809 13:08:04.055927 26984 raft_consensus.cc:374] T 00000000000000000000000000000000 P bc260ac69af44b818674c0acfa194e53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:08:04.056054 26984 raft_consensus.cc:729] T 00000000000000000000000000000000 P bc260ac69af44b818674c0acfa194e53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc260ac69af44b818674c0acfa194e53, State: Initialized, Role: FOLLOWER
I20260809 13:08:04.056735 26984 consensus_queue.cc:260] T 00000000000000000000000000000000 P bc260ac69af44b818674c0acfa194e53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc260ac69af44b818674c0acfa194e53" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 43569 } }
I20260809 13:08:04.057013 26984 raft_consensus.cc:388] T 00000000000000000000000000000000 P bc260ac69af44b818674c0acfa194e53 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:08:04.057181 26984 raft_consensus.cc:482] T 00000000000000000000000000000000 P bc260ac69af44b818674c0acfa194e53 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:08:04.057379 26984 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bc260ac69af44b818674c0acfa194e53 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:04.059687 26984 raft_consensus.cc:504] T 00000000000000000000000000000000 P bc260ac69af44b818674c0acfa194e53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc260ac69af44b818674c0acfa194e53" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 43569 } }
I20260809 13:08:04.060222 26984 leader_election.cc:302] T 00000000000000000000000000000000 P bc260ac69af44b818674c0acfa194e53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bc260ac69af44b818674c0acfa194e53; no voters:
I20260809 13:08:04.060923 26984 leader_election.cc:288] T 00000000000000000000000000000000 P bc260ac69af44b818674c0acfa194e53 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:08:04.061087 26992 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bc260ac69af44b818674c0acfa194e53 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:08:04.062377 26992 raft_consensus.cc:686] T 00000000000000000000000000000000 P bc260ac69af44b818674c0acfa194e53 [term 1 LEADER]: Becoming Leader. State: Replica: bc260ac69af44b818674c0acfa194e53, State: Running, Role: LEADER
I20260809 13:08:04.062898 26992 consensus_queue.cc:237] T 00000000000000000000000000000000 P bc260ac69af44b818674c0acfa194e53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc260ac69af44b818674c0acfa194e53" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 43569 } }
I20260809 13:08:04.063403 26984 sys_catalog.cc:564] T 00000000000000000000000000000000 P bc260ac69af44b818674c0acfa194e53 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:08:04.065802 26997 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc260ac69af44b818674c0acfa194e53 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc260ac69af44b818674c0acfa194e53. Latest consensus state: current_term: 1 leader_uuid: "bc260ac69af44b818674c0acfa194e53" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc260ac69af44b818674c0acfa194e53" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 43569 } } }
I20260809 13:08:04.065830 26993 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc260ac69af44b818674c0acfa194e53 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bc260ac69af44b818674c0acfa194e53" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc260ac69af44b818674c0acfa194e53" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 43569 } } }
I20260809 13:08:04.066342 26993 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc260ac69af44b818674c0acfa194e53 [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:04.066342 26997 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc260ac69af44b818674c0acfa194e53 [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:04.068579 27001 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:08:04.075534 27001 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:08:04.086100 27001 catalog_manager.cc:1347] Generated new cluster ID: 4fdeb189d60946dcafb5f952fcf8b886
I20260809 13:08:04.086257 27001 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:08:04.100348 27001 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:08:04.102428 27001 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:08:04.117435 27001 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bc260ac69af44b818674c0acfa194e53: Generated new TSK 0
I20260809 13:08:04.118402 27001 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
Entry for principal kudu/127.28.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab.
I20260809 13:08:04.208132 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:0
--local_ip_for_outbound_sockets=127.28.155.193
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:43569
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:39399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:08:04.599364 27020 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:04.599676 27020 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:04.599862 27020 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:04.607481 27020 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:04.607652 27020 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:04.607843 27020 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:08:04.618353 27020 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:39399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.193.keytab
--principal=kudu/127.28.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:43569
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:04.619846 27020 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:04.621368 27020 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:04.635489 27032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:04.635583 27034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:04.635571 27030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:04.641944 27020 server_base.cc:1034] running on GCE node
I20260809 13:08:04.642639 27020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:04.643654 27020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:04.644901 27020 hybrid_clock.cc:648] HybridClock initialized: now 1786280884644837 us; error 37 us; skew 500 ppm
I20260809 13:08:04.645260 27020 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:08:04 dist-test-slave-jq4t krb5kdc[26867](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280884, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:08:04.648766 27020 init.cc:377] Logged in from keytab as kudu/127.28.155.193@KRBTEST.COM (short username kudu)
I20260809 13:08:04.650483 27020 webserver.cc:460] Webserver started at http://127.28.155.193:33179/ using document root <none> and password file <none>
I20260809 13:08:04.651274 27020 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:04.651414 27020 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:04.651765 27020 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:04.654999 27020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-0/data/instance:
uuid: "ef8d70d72da444d8bbd813397d38a7b8"
format_stamp: "Formatted at 2026-08-09 13:08:04 on dist-test-slave-jq4t"
server_key: "a3b018857146f56560d9789415c5f0f3"
server_key_iv: "a00f133b4c607bbfb4d031a317a61437"
server_key_version: "encryptionkey@0"
I20260809 13:08:04.655836 27020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance:
uuid: "ef8d70d72da444d8bbd813397d38a7b8"
format_stamp: "Formatted at 2026-08-09 13:08:04 on dist-test-slave-jq4t"
server_key: "a3b018857146f56560d9789415c5f0f3"
server_key_iv: "a00f133b4c607bbfb4d031a317a61437"
server_key_version: "encryptionkey@0"
I20260809 13:08:04.661361 27020 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 13:08:04.665618 27047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:04.667119 27020 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260809 13:08:04.667321 27020 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "ef8d70d72da444d8bbd813397d38a7b8"
format_stamp: "Formatted at 2026-08-09 13:08:04 on dist-test-slave-jq4t"
server_key: "a3b018857146f56560d9789415c5f0f3"
server_key_iv: "a00f133b4c607bbfb4d031a317a61437"
server_key_version: "encryptionkey@0"
I20260809 13:08:04.667591 27020 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:04.683032 27020 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:04.687595 27020 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:04.687870 27020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:04.688939 27020 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:08:04.690434 27020 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:08:04.690511 27020 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:04.690608 27020 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:08:04.690657 27020 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:04.725965 27020 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:32783
I20260809 13:08:04.726003 27210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:32783 every 8 connection(s)
I20260809 13:08:04.727376 27020 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:08:04.731106 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 27020
I20260809 13:08:04.731312 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance
I20260809 13:08:04.731793 29295 external_mini_cluster.cc:1428] Setting key 899a32af5b6cdf4f4af352be3fefdad9
Aug 09 13:08:04 dist-test-slave-jq4t krb5kdc[26867](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280884, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.193@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:08:04.751066 27215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:04.730167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:37823 (local address 127.28.155.254:43569)
0809 13:08:04.730631 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:04.730635 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:04.731800 (+ 1165us) server_negotiation.cc:407] Connection header received
0809 13:08:04.734281 (+ 2481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:04.734286 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:04.734383 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:04.734515 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:04.736044 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:04.737301 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:04.738934 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:04.739644 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:04.739798 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:04.743612 (+ 3814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:04.743621 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:04.743628 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:04.743676 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:04.747539 (+ 3863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:04.748366 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:04.748374 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:04.748380 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:04.748586 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:04.749044 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:04.749052 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:04.749055 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:04.749375 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:04.749505 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:04.750563 (+ 1058us) server_negotiation.cc:299] Negotiation successful
0809 13:08:04.750764 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":229,"threads_started":1}
I20260809 13:08:04.752760 27216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:04.730730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:43569 (local address 127.28.155.193:37823)
0809 13:08:04.731610 (+ 880us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:04.731662 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:04.733988 (+ 2326us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:04.734708 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:04.734717 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:04.735280 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:08:04.735868 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:04.735884 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:04.737467 (+ 1583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:04.737471 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:04.738780 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:04.738793 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:04.739862 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:04.739866 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:04.740078 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:04.740853 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:08:04.740876 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:08:04.743348 (+ 2472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:08:04.747714 (+ 4366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:08:04.747722 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:08:04.747737 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:08:04.748228 (+ 491us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:08:04.748696 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:08:04.748700 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:08:04.748702 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:08:04.748927 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:08:04.749526 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:08:04.749539 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:08:04.750094 (+ 555us) client_negotiation.cc:769] Sending connection context
0809 13:08:04.750468 (+ 374us) client_negotiation.cc:240] Negotiation successful
0809 13:08:04.751136 (+ 668us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":366,"threads_started":1}
I20260809 13:08:04.754534 27212 heartbeater.cc:347] Connected to a master server at 127.28.155.254:43569
I20260809 13:08:04.754899 27212 heartbeater.cc:464] Registering TS with master...
I20260809 13:08:04.755741 27212 heartbeater.cc:511] Master 127.28.155.254:43569 requested a full tablet report, sending...
I20260809 13:08:04.758144 26929 ts_manager.cc:194] Registered new tserver with Master: ef8d70d72da444d8bbd813397d38a7b8 (127.28.155.193:32783)
I20260809 13:08:04.759745 26929 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.193@KRBTEST.COM'} at 127.28.155.193:37823
WARNING: no policy specified for kudu/127.28.155.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
Entry for principal kudu/127.28.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab.
I20260809 13:08:04.812336 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:0
--local_ip_for_outbound_sockets=127.28.155.194
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:43569
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:39399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:08:05.181607 27219 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:05.181985 27219 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:05.182163 27219 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:05.189679 27219 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:05.189850 27219 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:05.190048 27219 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:08:05.200084 27219 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:39399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.194.keytab
--principal=kudu/127.28.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:43569
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:05.201571 27219 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:05.202993 27219 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:05.216995 27227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:05.217036 27231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:05.217079 27228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:05.218428 27219 server_base.cc:1034] running on GCE node
I20260809 13:08:05.219151 27219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:05.220194 27219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:05.221428 27219 hybrid_clock.cc:648] HybridClock initialized: now 1786280885221347 us; error 80 us; skew 500 ppm
I20260809 13:08:05.221760 27219 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:08:05 dist-test-slave-jq4t krb5kdc[26867](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280885, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:08:05.224982 27219 init.cc:377] Logged in from keytab as kudu/127.28.155.194@KRBTEST.COM (short username kudu)
I20260809 13:08:05.226532 27219 webserver.cc:460] Webserver started at http://127.28.155.194:46095/ using document root <none> and password file <none>
I20260809 13:08:05.227253 27219 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:05.227406 27219 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:05.227727 27219 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:05.230881 27219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-1/data/instance:
uuid: "17687ac9cfc84de8a26014d572ff2890"
format_stamp: "Formatted at 2026-08-09 13:08:05 on dist-test-slave-jq4t"
server_key: "e09bee4a24eca8341d942c8e3b888672"
server_key_iv: "f914e06b2c1a6fe5f4c2fca285306d26"
server_key_version: "encryptionkey@0"
I20260809 13:08:05.231691 27219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance:
uuid: "17687ac9cfc84de8a26014d572ff2890"
format_stamp: "Formatted at 2026-08-09 13:08:05 on dist-test-slave-jq4t"
server_key: "e09bee4a24eca8341d942c8e3b888672"
server_key_iv: "f914e06b2c1a6fe5f4c2fca285306d26"
server_key_version: "encryptionkey@0"
I20260809 13:08:05.237546 27219 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.006s
I20260809 13:08:05.241175 27242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:05.242556 27219 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:08:05.242743 27219 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "17687ac9cfc84de8a26014d572ff2890"
format_stamp: "Formatted at 2026-08-09 13:08:05 on dist-test-slave-jq4t"
server_key: "e09bee4a24eca8341d942c8e3b888672"
server_key_iv: "f914e06b2c1a6fe5f4c2fca285306d26"
server_key_version: "encryptionkey@0"
I20260809 13:08:05.242960 27219 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:05.291332 27219 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:05.296060 27219 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:05.296398 27219 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:05.297524 27219 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:08:05.298964 27219 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:08:05.299072 27219 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:05.299222 27219 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:08:05.299304 27219 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:05.334633 27219 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:35315
I20260809 13:08:05.334685 27431 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:35315 every 8 connection(s)
I20260809 13:08:05.336035 27219 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:08:05.337778 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 27219
I20260809 13:08:05.337984 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance
I20260809 13:08:05.338461 29295 external_mini_cluster.cc:1428] Setting key cab1c4600ec6821e37be06a411a2ac58
Aug 09 13:08:05 dist-test-slave-jq4t krb5kdc[26867](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280885, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.194@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:08:05.359283 27435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:05.338888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:45419 (local address 127.28.155.254:43569)
0809 13:08:05.339417 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:05.339422 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:05.340623 (+ 1201us) server_negotiation.cc:407] Connection header received
0809 13:08:05.342601 (+ 1978us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:05.342610 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:05.342715 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:05.342843 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:05.344390 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:05.345604 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:05.347361 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:05.348147 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:05.348295 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:05.352208 (+ 3913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:05.352217 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:05.352225 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:05.352276 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:05.355755 (+ 3479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:05.356815 (+ 1060us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:05.356819 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:05.356822 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:05.356969 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:05.357462 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:05.357465 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:05.357467 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:05.357747 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:05.357861 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:05.358817 (+ 956us) server_negotiation.cc:299] Negotiation successful
0809 13:08:05.359007 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":275,"threads_started":1}
I20260809 13:08:05.360998 27436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:05.339535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:43569 (local address 127.28.155.194:45419)
0809 13:08:05.340402 (+ 867us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:05.340479 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:05.342306 (+ 1827us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:05.343084 (+ 778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:05.343093 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:05.343628 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:08:05.344209 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:05.344227 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:05.345786 (+ 1559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:05.345790 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:05.347219 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:05.347232 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:05.348376 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:05.348381 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:05.348645 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:05.349402 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:08:05.349433 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:08:05.351958 (+ 2525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:08:05.355927 (+ 3969us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:08:05.355939 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:08:05.355958 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:08:05.356696 (+ 738us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:08:05.357079 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:08:05.357087 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:08:05.357093 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:08:05.357351 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:08:05.357880 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:08:05.357891 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:08:05.358397 (+ 506us) client_negotiation.cc:769] Sending connection context
0809 13:08:05.358717 (+ 320us) client_negotiation.cc:240] Negotiation successful
0809 13:08:05.359351 (+ 634us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":319,"threads_started":1}
I20260809 13:08:05.362565 27432 heartbeater.cc:347] Connected to a master server at 127.28.155.254:43569
I20260809 13:08:05.362885 27432 heartbeater.cc:464] Registering TS with master...
I20260809 13:08:05.363686 27432 heartbeater.cc:511] Master 127.28.155.254:43569 requested a full tablet report, sending...
I20260809 13:08:05.365314 26929 ts_manager.cc:194] Registered new tserver with Master: 17687ac9cfc84de8a26014d572ff2890 (127.28.155.194:35315)
I20260809 13:08:05.366634 26929 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.194@KRBTEST.COM'} at 127.28.155.194:45419
WARNING: no policy specified for kudu/127.28.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
Entry for principal kudu/127.28.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab.
I20260809 13:08:05.419441 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:0
--local_ip_for_outbound_sockets=127.28.155.195
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:43569
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:39399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 13:08:05.763193 27212 heartbeater.cc:503] Master 127.28.155.254:43569 was elected leader, sending a full tablet report...
W20260809 13:08:05.784039 27439 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:05.784338 27439 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:05.784520 27439 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:05.792075 27439 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:05.792193 27439 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:05.792383 27439 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:08:05.802807 27439 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:39399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.195.keytab
--principal=kudu/127.28.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:43569
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:05.804353 27439 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:05.805855 27439 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:05.820663 27447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:05.820622 27449 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:05.820683 27451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:05.821841 27439 server_base.cc:1034] running on GCE node
I20260809 13:08:05.822520 27439 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:05.823498 27439 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:05.824734 27439 hybrid_clock.cc:648] HybridClock initialized: now 1786280885824692 us; error 52 us; skew 500 ppm
I20260809 13:08:05.825095 27439 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:08:05 dist-test-slave-jq4t krb5kdc[26867](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280885, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:08:05.828441 27439 init.cc:377] Logged in from keytab as kudu/127.28.155.195@KRBTEST.COM (short username kudu)
I20260809 13:08:05.830087 27439 webserver.cc:460] Webserver started at http://127.28.155.195:41355/ using document root <none> and password file <none>
I20260809 13:08:05.830782 27439 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:05.830914 27439 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:05.831199 27439 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:05.834343 27439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-2/data/instance:
uuid: "dc731353180f4add8d9d900a64c44283"
format_stamp: "Formatted at 2026-08-09 13:08:05 on dist-test-slave-jq4t"
server_key: "bf63cca55a8ced7652006e1bc978d836"
server_key_iv: "6b6d4175074f3599437fc8264ae9203f"
server_key_version: "encryptionkey@0"
I20260809 13:08:05.835112 27439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance:
uuid: "dc731353180f4add8d9d900a64c44283"
format_stamp: "Formatted at 2026-08-09 13:08:05 on dist-test-slave-jq4t"
server_key: "bf63cca55a8ced7652006e1bc978d836"
server_key_iv: "6b6d4175074f3599437fc8264ae9203f"
server_key_version: "encryptionkey@0"
I20260809 13:08:05.840373 27439 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260809 13:08:05.843955 27461 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:05.845453 27439 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:08:05.845607 27439 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "dc731353180f4add8d9d900a64c44283"
format_stamp: "Formatted at 2026-08-09 13:08:05 on dist-test-slave-jq4t"
server_key: "bf63cca55a8ced7652006e1bc978d836"
server_key_iv: "6b6d4175074f3599437fc8264ae9203f"
server_key_version: "encryptionkey@0"
I20260809 13:08:05.845825 27439 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:05.865895 27439 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:05.871019 27439 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:05.871341 27439 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:05.872526 27439 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:08:05.874140 27439 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:08:05.874245 27439 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:05.874397 27439 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:08:05.874470 27439 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:05.915704 27439 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:39957
I20260809 13:08:05.915756 27656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:39957 every 8 connection(s)
I20260809 13:08:05.917176 27439 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:08:05.924938 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 27439
I20260809 13:08:05.925159 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance
I20260809 13:08:05.925779 29295 external_mini_cluster.cc:1428] Setting key 9549e68f70a6c75c782a4431e352f21c
Aug 09 13:08:05 dist-test-slave-jq4t krb5kdc[26867](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280885, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.195@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:08:05.939311 27661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:05.919986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:52691 (local address 127.28.155.254:43569)
0809 13:08:05.920583 (+ 597us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:05.920588 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:05.921381 (+ 793us) server_negotiation.cc:407] Connection header received
0809 13:08:05.923363 (+ 1982us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:05.923369 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:05.923487 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:05.923613 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:05.925679 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:05.926734 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:05.928907 (+ 2173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:05.929357 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:05.929469 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:05.933220 (+ 3751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:05.933224 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:05.933228 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:05.933262 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:05.935959 (+ 2697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:05.936808 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:05.936812 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:05.936815 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:05.936950 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:05.937396 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:05.937400 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:05.937402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:05.937678 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:05.937849 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:05.938706 (+ 857us) server_negotiation.cc:299] Negotiation successful
0809 13:08:05.938941 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":283,"threads_started":1}
I20260809 13:08:05.940361 27664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:05.920402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:43569 (local address 127.28.155.195:52691)
0809 13:08:05.921190 (+ 788us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:05.921239 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:05.923054 (+ 1815us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:05.923883 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:05.923891 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:05.924526 (+ 635us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:08:05.925466 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:05.925497 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:05.926911 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:05.926915 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:05.928743 (+ 1828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:05.928761 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:05.929568 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:05.929573 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:05.929801 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:05.930546 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:08:05.930570 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:08:05.932987 (+ 2417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:08:05.936107 (+ 3120us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:08:05.936117 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:08:05.936136 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:08:05.936675 (+ 539us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:08:05.937065 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:08:05.937070 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:08:05.937073 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:08:05.937272 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:08:05.937820 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:08:05.937829 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:08:05.938214 (+ 385us) client_negotiation.cc:769] Sending connection context
0809 13:08:05.938561 (+ 347us) client_negotiation.cc:240] Negotiation successful
0809 13:08:05.939002 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":284,"threads_started":1}
I20260809 13:08:05.941982 27657 heartbeater.cc:347] Connected to a master server at 127.28.155.254:43569
I20260809 13:08:05.942344 27657 heartbeater.cc:464] Registering TS with master...
I20260809 13:08:05.943172 27657 heartbeater.cc:511] Master 127.28.155.254:43569 requested a full tablet report, sending...
I20260809 13:08:05.945111 26929 ts_manager.cc:194] Registered new tserver with Master: dc731353180f4add8d9d900a64c44283 (127.28.155.195:39957)
I20260809 13:08:05.946103 26929 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.155.195@KRBTEST.COM'} at 127.28.155.195:52691
I20260809 13:08:05.954633 29295 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 13:08:05.973459 27661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:05.959220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59040 (local address 127.28.155.254:43569)
0809 13:08:05.959401 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:05.959405 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:05.959817 (+ 412us) server_negotiation.cc:407] Connection header received
0809 13:08:05.959973 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:05.959977 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:05.960057 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:05.960146 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:05.961742 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:05.962523 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:05.964048 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:05.964633 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:05.964786 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:05.967389 (+ 2603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:05.967394 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:05.967397 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:05.967438 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:05.970472 (+ 3034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:05.971261 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:05.971265 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:05.971267 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:05.971427 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:05.971804 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:05.971807 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:05.971809 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:05.972291 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:05.972556 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:05.972983 (+ 427us) server_negotiation.cc:299] Negotiation successful
0809 13:08:05.973207 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 13:08:05.977882 26929 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59040:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 13:08:05.985512 26929 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:08:06.023986 27680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:05.998944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:32783 (local address 127.0.0.1:51390)
0809 13:08:06.013378 (+ 14434us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:06.013450 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:06.013774 (+ 324us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:06.015158 (+ 1384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:06.015169 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:06.015213 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:08:06.015690 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:06.015705 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:06.018000 (+ 2295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:06.018007 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:06.020541 (+ 2534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:06.020559 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:06.022917 (+ 2358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:06.022924 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:06.023163 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:06.023213 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 13:08:06.023348 (+ 135us) client_negotiation.cc:240] Negotiation successful
0809 13:08:06.023591 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13995,"thread_start_us":15109,"threads_started":1}
I20260809 13:08:06.025178 27681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:05.999187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51390 (local address 127.28.155.193:32783)
0809 13:08:06.014433 (+ 15246us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:06.014444 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:06.014478 (+ 34us) server_negotiation.cc:407] Connection header received
0809 13:08:06.014601 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:06.014610 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:06.014878 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:06.015110 (+ 232us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:08:06.015944 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:06.017818 (+ 1874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:06.020742 (+ 2924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:06.022307 (+ 1565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:06.022545 (+ 238us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:06.022768 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:06.024615 (+ 1847us) server_negotiation.cc:299] Negotiation successful
0809 13:08:06.024821 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15046,"thread_start_us":16164,"threads_started":1}
I20260809 13:08:06.034009 27682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:05.999503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:35315 (local address 127.0.0.1:57430)
0809 13:08:06.015151 (+ 15648us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:06.015171 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:06.015309 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:06.025549 (+ 10240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:06.025554 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:06.025585 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:08:06.025978 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:06.025996 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:06.028045 (+ 2049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:06.028050 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:06.030461 (+ 2411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:06.030478 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:06.033183 (+ 2705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:06.033190 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:06.033385 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:06.033416 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 13:08:06.033509 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 13:08:06.033656 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15518,"thread_start_us":15345,"threads_started":1}
I20260809 13:08:06.034950 27684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:05.999687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57430 (local address 127.28.155.194:35315)
0809 13:08:06.014605 (+ 14918us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:06.014617 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:06.015465 (+ 848us) server_negotiation.cc:407] Connection header received
0809 13:08:06.015581 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:06.015590 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:06.024713 (+ 9123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:06.024974 (+ 261us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:08:06.026221 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:06.027871 (+ 1650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:06.030673 (+ 2802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:06.032702 (+ 2029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:06.032856 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:06.033028 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:06.034435 (+ 1407us) server_negotiation.cc:299] Negotiation successful
0809 13:08:06.034629 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12318,"spinlock_wait_cycles":611072,"thread_start_us":12875,"threads_started":1}
I20260809 13:08:06.037876 27111 tablet_service.cc:1467] Processing CreateTablet for tablet d77d95033a32498f8b809da2df40e9ae (DEFAULT_TABLE table=test-table [id=2c0f52370f324f1fa575c0aed5fc4efd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:08:06.038630 27317 tablet_service.cc:1467] Processing CreateTablet for tablet d77d95033a32498f8b809da2df40e9ae (DEFAULT_TABLE table=test-table [id=2c0f52370f324f1fa575c0aed5fc4efd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:08:06.039597 27111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d77d95033a32498f8b809da2df40e9ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:06.040071 27317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d77d95033a32498f8b809da2df40e9ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:06.040555 27680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:06.015729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:39957 (local address 127.0.0.1:38340)
0809 13:08:06.024290 (+ 8561us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:06.024311 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:06.024443 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:06.032450 (+ 8007us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:06.032455 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:06.032509 (+ 54us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:08:06.032787 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:06.032799 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:06.035793 (+ 2994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:06.035801 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:06.037848 (+ 2047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:06.037866 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:06.039776 (+ 1910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:06.039782 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:06.039968 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:06.040004 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 13:08:06.040085 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 13:08:06.040240 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8456,"thread_start_us":16223,"threads_started":1}
I20260809 13:08:06.041649 27689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:06.015484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38340 (local address 127.28.155.195:39957)
0809 13:08:06.030943 (+ 15459us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:06.030958 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:06.031010 (+ 52us) server_negotiation.cc:407] Connection header received
0809 13:08:06.031158 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:06.031171 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:06.031524 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:06.033006 (+ 1482us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:08:06.033322 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:06.035597 (+ 2275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:06.038065 (+ 2468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:06.039562 (+ 1497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:06.040858 (+ 1296us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:06.041036 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:06.041109 (+ 73us) server_negotiation.cc:299] Negotiation successful
0809 13:08:06.041283 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15149,"thread_start_us":16639,"threads_started":1}
I20260809 13:08:06.045734 27542 tablet_service.cc:1467] Processing CreateTablet for tablet d77d95033a32498f8b809da2df40e9ae (DEFAULT_TABLE table=test-table [id=2c0f52370f324f1fa575c0aed5fc4efd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:08:06.047374 27542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d77d95033a32498f8b809da2df40e9ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:06.054198 27692 tablet_bootstrap.cc:492] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8: Bootstrap starting.
I20260809 13:08:06.057296 27693 tablet_bootstrap.cc:492] T d77d95033a32498f8b809da2df40e9ae P 17687ac9cfc84de8a26014d572ff2890: Bootstrap starting.
I20260809 13:08:06.059051 27692 tablet_bootstrap.cc:654] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:06.060500 27692 log.cc:824] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:06.061198 27693 tablet_bootstrap.cc:654] T d77d95033a32498f8b809da2df40e9ae P 17687ac9cfc84de8a26014d572ff2890: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:06.062319 27696 tablet_bootstrap.cc:492] T d77d95033a32498f8b809da2df40e9ae P dc731353180f4add8d9d900a64c44283: Bootstrap starting.
I20260809 13:08:06.062996 27693 log.cc:824] T d77d95033a32498f8b809da2df40e9ae P 17687ac9cfc84de8a26014d572ff2890: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:06.064141 27692 tablet_bootstrap.cc:492] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8: No bootstrap required, opened a new log
I20260809 13:08:06.064477 27692 ts_tablet_manager.cc:1397] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260809 13:08:06.065932 27696 tablet_bootstrap.cc:654] T d77d95033a32498f8b809da2df40e9ae P dc731353180f4add8d9d900a64c44283: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:06.066845 27693 tablet_bootstrap.cc:492] T d77d95033a32498f8b809da2df40e9ae P 17687ac9cfc84de8a26014d572ff2890: No bootstrap required, opened a new log
I20260809 13:08:06.066998 27696 log.cc:824] T d77d95033a32498f8b809da2df40e9ae P dc731353180f4add8d9d900a64c44283: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:06.067122 27693 ts_tablet_manager.cc:1397] T d77d95033a32498f8b809da2df40e9ae P 17687ac9cfc84de8a26014d572ff2890: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260809 13:08:06.069887 27696 tablet_bootstrap.cc:492] T d77d95033a32498f8b809da2df40e9ae P dc731353180f4add8d9d900a64c44283: No bootstrap required, opened a new log
I20260809 13:08:06.070158 27696 ts_tablet_manager.cc:1397] T d77d95033a32498f8b809da2df40e9ae P dc731353180f4add8d9d900a64c44283: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 13:08:06.075742 27692 raft_consensus.cc:348] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef8d70d72da444d8bbd813397d38a7b8" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 32783 } } peers { permanent_uuid: "dc731353180f4add8d9d900a64c44283" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 39957 } } peers { permanent_uuid: "17687ac9cfc84de8a26014d572ff2890" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35315 } }
I20260809 13:08:06.076390 27692 raft_consensus.cc:374] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:08:06.076524 27692 raft_consensus.cc:729] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef8d70d72da444d8bbd813397d38a7b8, State: Initialized, Role: FOLLOWER
I20260809 13:08:06.077255 27692 consensus_queue.cc:260] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef8d70d72da444d8bbd813397d38a7b8" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 32783 } } peers { permanent_uuid: "dc731353180f4add8d9d900a64c44283" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 39957 } } peers { permanent_uuid: "17687ac9cfc84de8a26014d572ff2890" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35315 } }
I20260809 13:08:06.078142 27693 raft_consensus.cc:348] T d77d95033a32498f8b809da2df40e9ae P 17687ac9cfc84de8a26014d572ff2890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef8d70d72da444d8bbd813397d38a7b8" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 32783 } } peers { permanent_uuid: "dc731353180f4add8d9d900a64c44283" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 39957 } } peers { permanent_uuid: "17687ac9cfc84de8a26014d572ff2890" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35315 } }
I20260809 13:08:06.078612 27693 raft_consensus.cc:374] T d77d95033a32498f8b809da2df40e9ae P 17687ac9cfc84de8a26014d572ff2890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:08:06.078711 27693 raft_consensus.cc:729] T d77d95033a32498f8b809da2df40e9ae P 17687ac9cfc84de8a26014d572ff2890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17687ac9cfc84de8a26014d572ff2890, State: Initialized, Role: FOLLOWER
I20260809 13:08:06.079340 27692 ts_tablet_manager.cc:1428] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8: Time spent starting tablet: real 0.015s user 0.011s sys 0.002s
I20260809 13:08:06.078902 27696 raft_consensus.cc:348] T d77d95033a32498f8b809da2df40e9ae P dc731353180f4add8d9d900a64c44283 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef8d70d72da444d8bbd813397d38a7b8" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 32783 } } peers { permanent_uuid: "dc731353180f4add8d9d900a64c44283" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 39957 } } peers { permanent_uuid: "17687ac9cfc84de8a26014d572ff2890" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35315 } }
I20260809 13:08:06.079514 27696 raft_consensus.cc:374] T d77d95033a32498f8b809da2df40e9ae P dc731353180f4add8d9d900a64c44283 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:08:06.079355 27693 consensus_queue.cc:260] T d77d95033a32498f8b809da2df40e9ae P 17687ac9cfc84de8a26014d572ff2890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef8d70d72da444d8bbd813397d38a7b8" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 32783 } } peers { permanent_uuid: "dc731353180f4add8d9d900a64c44283" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 39957 } } peers { permanent_uuid: "17687ac9cfc84de8a26014d572ff2890" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35315 } }
I20260809 13:08:06.079608 27696 raft_consensus.cc:729] T d77d95033a32498f8b809da2df40e9ae P dc731353180f4add8d9d900a64c44283 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc731353180f4add8d9d900a64c44283, State: Initialized, Role: FOLLOWER
I20260809 13:08:06.080274 27696 consensus_queue.cc:260] T d77d95033a32498f8b809da2df40e9ae P dc731353180f4add8d9d900a64c44283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef8d70d72da444d8bbd813397d38a7b8" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 32783 } } peers { permanent_uuid: "dc731353180f4add8d9d900a64c44283" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 39957 } } peers { permanent_uuid: "17687ac9cfc84de8a26014d572ff2890" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35315 } }
I20260809 13:08:06.080596 27432 heartbeater.cc:503] Master 127.28.155.254:43569 was elected leader, sending a full tablet report...
I20260809 13:08:06.081306 27693 ts_tablet_manager.cc:1428] T d77d95033a32498f8b809da2df40e9ae P 17687ac9cfc84de8a26014d572ff2890: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
I20260809 13:08:06.082825 27657 heartbeater.cc:503] Master 127.28.155.254:43569 was elected leader, sending a full tablet report...
I20260809 13:08:06.083495 27696 ts_tablet_manager.cc:1428] T d77d95033a32498f8b809da2df40e9ae P dc731353180f4add8d9d900a64c44283: Time spent starting tablet: real 0.013s user 0.006s sys 0.008s
W20260809 13:08:06.088194 27433 tablet.cc:2369] T d77d95033a32498f8b809da2df40e9ae P 17687ac9cfc84de8a26014d572ff2890: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:08:06.134624 27700 raft_consensus.cc:482] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:08:06.134954 27700 raft_consensus.cc:504] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef8d70d72da444d8bbd813397d38a7b8" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 32783 } } peers { permanent_uuid: "dc731353180f4add8d9d900a64c44283" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 39957 } } peers { permanent_uuid: "17687ac9cfc84de8a26014d572ff2890" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35315 } }
I20260809 13:08:06.136744 27700 leader_election.cc:288] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc731353180f4add8d9d900a64c44283 (127.28.155.195:39957), 17687ac9cfc84de8a26014d572ff2890 (127.28.155.194:35315)
I20260809 13:08:06.144310 27689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:06.137249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:33169 (local address 127.28.155.195:39957)
0809 13:08:06.137513 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:06.137522 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:06.138477 (+ 955us) server_negotiation.cc:407] Connection header received
0809 13:08:06.138736 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:06.138742 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:06.138827 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:06.138891 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:08:06.139715 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:06.140461 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:06.142488 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:06.143279 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:06.143502 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:06.143585 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:06.143892 (+ 307us) server_negotiation.cc:299] Negotiation successful
0809 13:08:06.144031 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 13:08:06.144340 27684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:06.137281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:53555 (local address 127.28.155.194:35315)
0809 13:08:06.137545 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:06.137554 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:06.138626 (+ 1072us) server_negotiation.cc:407] Connection header received
0809 13:08:06.138837 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:06.138843 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:06.138930 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:06.139030 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:08:06.139697 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:06.140449 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:06.142489 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:06.143309 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:06.143502 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:06.143590 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:06.143923 (+ 333us) server_negotiation.cc:299] Negotiation successful
0809 13:08:06.144063 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260809 13:08:06.144544 27704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:06.137343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:39957 (local address 127.28.155.193:33169)
0809 13:08:06.138350 (+ 1007us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:06.138367 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:06.138501 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:06.139110 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:06.139113 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:06.139133 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:08:06.139568 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:06.139578 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:06.140667 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:06.140671 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:06.142320 (+ 1649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:06.142334 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:06.143533 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:06.143540 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:06.143704 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:06.143748 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 13:08:06.143862 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 13:08:06.144021 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":841,"mutex_wait_us":30,"thread_start_us":488,"threads_started":1}
I20260809 13:08:06.144588 27706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:06.137362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:35315 (local address 127.28.155.193:53555)
0809 13:08:06.138501 (+ 1139us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:06.138521 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:06.138680 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:06.139049 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:06.139053 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:06.139080 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:08:06.139512 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:06.139522 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:06.140604 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:06.140610 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:06.142322 (+ 1712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:06.142335 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:06.143574 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:06.143580 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:06.143761 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:06.143784 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 13:08:06.143891 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 13:08:06.144036 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":998,"mutex_wait_us":178,"thread_start_us":606,"threads_started":1}
I20260809 13:08:06.145850 27581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d77d95033a32498f8b809da2df40e9ae" candidate_uuid: "ef8d70d72da444d8bbd813397d38a7b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc731353180f4add8d9d900a64c44283" is_pre_election: true
I20260809 13:08:06.145853 27356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d77d95033a32498f8b809da2df40e9ae" candidate_uuid: "ef8d70d72da444d8bbd813397d38a7b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17687ac9cfc84de8a26014d572ff2890" is_pre_election: true
I20260809 13:08:06.146523 27356 raft_consensus.cc:2454] T d77d95033a32498f8b809da2df40e9ae P 17687ac9cfc84de8a26014d572ff2890 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef8d70d72da444d8bbd813397d38a7b8 in term 0.
I20260809 13:08:06.146523 27581 raft_consensus.cc:2454] T d77d95033a32498f8b809da2df40e9ae P dc731353180f4add8d9d900a64c44283 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef8d70d72da444d8bbd813397d38a7b8 in term 0.
I20260809 13:08:06.147300 27050 leader_election.cc:302] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dc731353180f4add8d9d900a64c44283, ef8d70d72da444d8bbd813397d38a7b8; no voters:
I20260809 13:08:06.147734 27700 raft_consensus.cc:2781] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:08:06.147900 27700 raft_consensus.cc:482] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:08:06.148017 27700 raft_consensus.cc:3037] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:06.150482 27700 raft_consensus.cc:504] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef8d70d72da444d8bbd813397d38a7b8" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 32783 } } peers { permanent_uuid: "dc731353180f4add8d9d900a64c44283" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 39957 } } peers { permanent_uuid: "17687ac9cfc84de8a26014d572ff2890" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35315 } }
I20260809 13:08:06.151196 27700 leader_election.cc:288] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8 [CANDIDATE]: Term 1 election: Requested vote from peers dc731353180f4add8d9d900a64c44283 (127.28.155.195:39957), 17687ac9cfc84de8a26014d572ff2890 (127.28.155.194:35315)
I20260809 13:08:06.151707 27581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d77d95033a32498f8b809da2df40e9ae" candidate_uuid: "ef8d70d72da444d8bbd813397d38a7b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc731353180f4add8d9d900a64c44283"
I20260809 13:08:06.151834 27356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d77d95033a32498f8b809da2df40e9ae" candidate_uuid: "ef8d70d72da444d8bbd813397d38a7b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17687ac9cfc84de8a26014d572ff2890"
I20260809 13:08:06.151945 27581 raft_consensus.cc:3037] T d77d95033a32498f8b809da2df40e9ae P dc731353180f4add8d9d900a64c44283 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:06.152096 27356 raft_consensus.cc:3037] T d77d95033a32498f8b809da2df40e9ae P 17687ac9cfc84de8a26014d572ff2890 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:06.155458 27581 raft_consensus.cc:2454] T d77d95033a32498f8b809da2df40e9ae P dc731353180f4add8d9d900a64c44283 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef8d70d72da444d8bbd813397d38a7b8 in term 1.
I20260809 13:08:06.155452 27356 raft_consensus.cc:2454] T d77d95033a32498f8b809da2df40e9ae P 17687ac9cfc84de8a26014d572ff2890 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef8d70d72da444d8bbd813397d38a7b8 in term 1.
I20260809 13:08:06.155978 27052 leader_election.cc:302] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17687ac9cfc84de8a26014d572ff2890, ef8d70d72da444d8bbd813397d38a7b8; no voters:
I20260809 13:08:06.156378 27700 raft_consensus.cc:2781] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:08:06.156886 27700 raft_consensus.cc:686] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8 [term 1 LEADER]: Becoming Leader. State: Replica: ef8d70d72da444d8bbd813397d38a7b8, State: Running, Role: LEADER
I20260809 13:08:06.157478 27700 consensus_queue.cc:237] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef8d70d72da444d8bbd813397d38a7b8" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 32783 } } peers { permanent_uuid: "dc731353180f4add8d9d900a64c44283" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 39957 } } peers { permanent_uuid: "17687ac9cfc84de8a26014d572ff2890" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35315 } }
I20260809 13:08:06.162364 26929 catalog_manager.cc:5495] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef8d70d72da444d8bbd813397d38a7b8 (127.28.155.193). New cstate: current_term: 1 leader_uuid: "ef8d70d72da444d8bbd813397d38a7b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef8d70d72da444d8bbd813397d38a7b8" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 32783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc731353180f4add8d9d900a64c44283" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17687ac9cfc84de8a26014d572ff2890" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35315 } health_report { overall_health: UNKNOWN } } }
W20260809 13:08:06.168911 27658 tablet.cc:2369] T d77d95033a32498f8b809da2df40e9ae P dc731353180f4add8d9d900a64c44283: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:08:06.200933 27681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:06.195648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51406 (local address 127.28.155.193:32783)
0809 13:08:06.195882 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:06.195887 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:06.195906 (+ 19us) server_negotiation.cc:407] Connection header received
0809 13:08:06.196093 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:06.196097 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:06.196181 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:06.196309 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:08:06.196675 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:06.197445 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:06.198772 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:06.199184 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:06.199277 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:06.199729 (+ 452us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:08:06.200292 (+ 563us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:08:06.200412 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:06.200533 (+ 121us) server_negotiation.cc:299] Negotiation successful
0809 13:08:06.200615 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 13:08:06.209973 27581 raft_consensus.cc:1261] T d77d95033a32498f8b809da2df40e9ae P dc731353180f4add8d9d900a64c44283 [term 1 FOLLOWER]: Refusing update from remote peer ef8d70d72da444d8bbd813397d38a7b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:08:06.209976 27356 raft_consensus.cc:1261] T d77d95033a32498f8b809da2df40e9ae P 17687ac9cfc84de8a26014d572ff2890 [term 1 FOLLOWER]: Refusing update from remote peer ef8d70d72da444d8bbd813397d38a7b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:08:06.211227 27707 consensus_queue.cc:1035] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17687ac9cfc84de8a26014d572ff2890" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 35315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:08:06.211674 27700 consensus_queue.cc:1035] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc731353180f4add8d9d900a64c44283" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:08:06.225445 27717 mvcc.cc:205] Tried to move back new op lower bound from 7316606509903912960 to 7316606509705592832. Current Snapshot: MvccSnapshot[applied={T|T < 7316606509903912960}]
I20260809 13:08:06.225602 27714 mvcc.cc:205] Tried to move back new op lower bound from 7316606509903912960 to 7316606509705592832. Current Snapshot: MvccSnapshot[applied={T|T < 7316606509903912960}]
I20260809 13:08:06.239280 26928 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59040:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:08:06.239596 26928 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59040:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:08:06.243498 26928 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bc260ac69af44b818674c0acfa194e53: Sending DeleteTablet for 3 replicas of tablet d77d95033a32498f8b809da2df40e9ae
I20260809 13:08:06.244777 27111 tablet_service.cc:1514] Processing DeleteTablet for tablet d77d95033a32498f8b809da2df40e9ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:08:06 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:51390
I20260809 13:08:06.244904 27542 tablet_service.cc:1514] Processing DeleteTablet for tablet d77d95033a32498f8b809da2df40e9ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:08:06 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:38340
I20260809 13:08:06.245566 27317 tablet_service.cc:1514] Processing DeleteTablet for tablet d77d95033a32498f8b809da2df40e9ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:08:06 UTC) from {username='kudu', principal='kudu/127.28.155.254@KRBTEST.COM'} at 127.0.0.1:57430
I20260809 13:08:06.247749 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 27020
I20260809 13:08:06.256142 27736 tablet_replica.cc:330] T d77d95033a32498f8b809da2df40e9ae P 17687ac9cfc84de8a26014d572ff2890: stopping tablet replica
I20260809 13:08:06.256884 27736 raft_consensus.cc:2229] T d77d95033a32498f8b809da2df40e9ae P 17687ac9cfc84de8a26014d572ff2890 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:08:06.257567 27736 raft_consensus.cc:2258] T d77d95033a32498f8b809da2df40e9ae P 17687ac9cfc84de8a26014d572ff2890 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:08:06.260193 27736 ts_tablet_manager.cc:1905] T d77d95033a32498f8b809da2df40e9ae P 17687ac9cfc84de8a26014d572ff2890: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:08:06.260289 27730 tablet_replica.cc:330] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8: stopping tablet replica
I20260809 13:08:06.260923 27730 raft_consensus.cc:2229] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8 [term 1 LEADER]: Raft consensus shutting down.
I20260809 13:08:06.261811 27730 raft_consensus.cc:2258] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:08:06.262689 27735 tablet_replica.cc:330] T d77d95033a32498f8b809da2df40e9ae P dc731353180f4add8d9d900a64c44283: stopping tablet replica
I20260809 13:08:06.263168 27735 raft_consensus.cc:2229] T d77d95033a32498f8b809da2df40e9ae P dc731353180f4add8d9d900a64c44283 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:08:06.263762 27735 raft_consensus.cc:2258] T d77d95033a32498f8b809da2df40e9ae P dc731353180f4add8d9d900a64c44283 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:08:06.266196 27730 ts_tablet_manager.cc:1905] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:08:06.267536 27735 ts_tablet_manager.cc:1905] T d77d95033a32498f8b809da2df40e9ae P dc731353180f4add8d9d900a64c44283: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:08:06.269011 27736 ts_tablet_manager.cc:1918] T d77d95033a32498f8b809da2df40e9ae P 17687ac9cfc84de8a26014d572ff2890: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:08:06.269210 27736 log.cc:1196] T d77d95033a32498f8b809da2df40e9ae P 17687ac9cfc84de8a26014d572ff2890: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-1/wal/wals/d77d95033a32498f8b809da2df40e9ae
I20260809 13:08:06.269793 27736 ts_tablet_manager.cc:1939] T d77d95033a32498f8b809da2df40e9ae P 17687ac9cfc84de8a26014d572ff2890: Deleting consensus metadata
I20260809 13:08:06.272394 26911 catalog_manager.cc:4841] TS 17687ac9cfc84de8a26014d572ff2890 (127.28.155.194:35315): tablet d77d95033a32498f8b809da2df40e9ae (table test-table [id=2c0f52370f324f1fa575c0aed5fc4efd]) successfully deleted
I20260809 13:08:06.274149 27730 ts_tablet_manager.cc:1918] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:08:06.274355 27730 log.cc:1196] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-0/wal/wals/d77d95033a32498f8b809da2df40e9ae
I20260809 13:08:06.274940 27730 ts_tablet_manager.cc:1939] T d77d95033a32498f8b809da2df40e9ae P ef8d70d72da444d8bbd813397d38a7b8: Deleting consensus metadata
I20260809 13:08:06.276716 27735 ts_tablet_manager.cc:1918] T d77d95033a32498f8b809da2df40e9ae P dc731353180f4add8d9d900a64c44283: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:08:06.276921 27735 log.cc:1196] T d77d95033a32498f8b809da2df40e9ae P dc731353180f4add8d9d900a64c44283: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786280548611909-29295-0/minicluster-data/ts-2/wal/wals/d77d95033a32498f8b809da2df40e9ae
I20260809 13:08:06.276962 26908 catalog_manager.cc:4841] TS ef8d70d72da444d8bbd813397d38a7b8 (127.28.155.193:32783): tablet d77d95033a32498f8b809da2df40e9ae (table test-table [id=2c0f52370f324f1fa575c0aed5fc4efd]) successfully deleted
Aug 09 13:08:06 dist-test-slave-jq4t krb5kdc[26867](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.193@KRBTEST.COM
I20260809 13:08:06.277513 27735 ts_tablet_manager.cc:1939] T d77d95033a32498f8b809da2df40e9ae P dc731353180f4add8d9d900a64c44283: Deleting consensus metadata
I20260809 13:08:06.279353 26908 catalog_manager.cc:4841] TS dc731353180f4add8d9d900a64c44283 (127.28.155.195:39957): tablet d77d95033a32498f8b809da2df40e9ae (table test-table [id=2c0f52370f324f1fa575c0aed5fc4efd]) successfully deleted
I20260809 13:08:06.285485 27681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:06.250022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51422 (local address 127.28.155.193:32783)
0809 13:08:06.250265 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:06.250275 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:06.263115 (+ 12840us) server_negotiation.cc:407] Connection header received
0809 13:08:06.263475 (+ 360us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:06.263480 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:06.263574 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:06.263653 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:06.265762 (+ 2109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:06.267029 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:06.268979 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:06.269661 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:06.269757 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:06.278654 (+ 8897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:06.278671 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:06.278689 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:06.278737 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:06.282232 (+ 3495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:06.283253 (+ 1021us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:06.283261 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:06.283263 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:06.283415 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:06.283854 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:06.283857 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:06.283859 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:06.284224 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:06.284572 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:06.284987 (+ 415us) server_negotiation.cc:299] Negotiation successful
0809 13:08:06.285193 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 13:08:06.286326 27205 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:08:06.391295 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 27020
I20260809 13:08:06.421386 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 27219
Aug 09 13:08:06 dist-test-slave-jq4t krb5kdc[26867](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.194@KRBTEST.COM
I20260809 13:08:06.437158 27684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:06.422311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57438 (local address 127.28.155.194:35315)
0809 13:08:06.422525 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:06.422530 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:06.422553 (+ 23us) server_negotiation.cc:407] Connection header received
0809 13:08:06.422707 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:06.422712 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:06.422779 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:06.422884 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:06.424293 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:06.425145 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:06.426468 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:06.426880 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:06.427015 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:06.431580 (+ 4565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:06.431597 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:06.431613 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:06.431655 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:06.434447 (+ 2792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:06.435129 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:06.435137 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:06.435139 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:06.435274 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:06.435634 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:06.435636 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:06.435638 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:06.436036 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:06.436272 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:06.436713 (+ 441us) server_negotiation.cc:299] Negotiation successful
0809 13:08:06.436893 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 13:08:06.437971 27425 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:08:06.531606 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 27219
I20260809 13:08:06.558604 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 27439
Aug 09 13:08:06 dist-test-slave-jq4t krb5kdc[26867](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.195@KRBTEST.COM
I20260809 13:08:06.576224 27689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:06.559541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38356 (local address 127.28.155.195:39957)
0809 13:08:06.559733 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:06.559741 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:06.559785 (+ 44us) server_negotiation.cc:407] Connection header received
0809 13:08:06.560037 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:06.560042 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:06.560112 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:06.560237 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:06.561778 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:06.562582 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:06.563991 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:06.564406 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:06.564693 (+ 287us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:06.569915 (+ 5222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:06.569948 (+ 33us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:06.569965 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:06.570007 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:06.573016 (+ 3009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:06.573781 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:06.573797 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:06.573799 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:06.573950 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:06.574455 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:06.574470 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:06.574472 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:06.574925 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:06.575292 (+ 367us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:06.575616 (+ 324us) server_negotiation.cc:299] Negotiation successful
0809 13:08:06.575875 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 13:08:06.577005 27651 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:08:06.669857 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 27439
I20260809 13:08:06.695413 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 26883
I20260809 13:08:06.696655 26977 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:08:06.812611 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 26883
2026-08-09T13:08:06Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4996 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-09T13:08:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:08:06Z Disabled control of system clock
I20260809 13:08:06.916613 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:32847
--webserver_interface=127.28.155.254
--webserver_port=0
--builtin_ntp_servers=127.28.155.212:33515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:32847
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 13:08:07.281745 27751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:07.282059 27751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:07.282202 27751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:07.289825 27751 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:08:07.289968 27751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:07.290060 27751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:07.290148 27751 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:08:07.290225 27751 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:08:07.300998 27751 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:33515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:32847
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:32847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:07.302486 27751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:07.304430 27751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:07.316814 27757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:07.316905 27758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:07.317346 27763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:07.317970 27751 server_base.cc:1034] running on GCE node
I20260809 13:08:07.318794 27751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:07.320317 27751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:07.321522 27751 hybrid_clock.cc:648] HybridClock initialized: now 1786280887321479 us; error 38 us; skew 500 ppm
I20260809 13:08:07.321864 27751 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 13:08:07.324156 27751 webserver.cc:460] Webserver started at http://127.28.155.254:38565/ using document root <none> and password file <none>
I20260809 13:08:07.324908 27751 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:07.325001 27751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:07.325315 27751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:07.328367 27751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "c72a506d06d24f488a446d8e7a10ab0a"
format_stamp: "Formatted at 2026-08-09 13:08:07 on dist-test-slave-jq4t"
server_key: "3da35ee91a273dffe7558503cb237fda"
server_key_iv: "89ed52ce254515b030265f89d2535258"
server_key_version: "encryptionkey@0"
I20260809 13:08:07.329267 27751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "c72a506d06d24f488a446d8e7a10ab0a"
format_stamp: "Formatted at 2026-08-09 13:08:07 on dist-test-slave-jq4t"
server_key: "3da35ee91a273dffe7558503cb237fda"
server_key_iv: "89ed52ce254515b030265f89d2535258"
server_key_version: "encryptionkey@0"
I20260809 13:08:07.334865 27751 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 13:08:07.338635 27777 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:07.340186 27751 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 13:08:07.340348 27751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "c72a506d06d24f488a446d8e7a10ab0a"
format_stamp: "Formatted at 2026-08-09 13:08:07 on dist-test-slave-jq4t"
server_key: "3da35ee91a273dffe7558503cb237fda"
server_key_iv: "89ed52ce254515b030265f89d2535258"
server_key_version: "encryptionkey@0"
I20260809 13:08:07.340643 27751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:07.370352 27751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:07.371302 27751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:07.371591 27751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:07.402118 27751 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:32847
I20260809 13:08:07.402137 27857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:32847 every 8 connection(s)
I20260809 13:08:07.403633 27751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:08:07.407780 27858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:07.411984 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 27751
I20260809 13:08:07.412194 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:08:07.412809 29295 external_mini_cluster.cc:1428] Setting key 178974c3300d17d5cd7faf29e10955f0
I20260809 13:08:07.422420 27858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c72a506d06d24f488a446d8e7a10ab0a: Bootstrap starting.
I20260809 13:08:07.426445 27858 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c72a506d06d24f488a446d8e7a10ab0a: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:07.427613 27858 log.cc:824] T 00000000000000000000000000000000 P c72a506d06d24f488a446d8e7a10ab0a: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:07.427696 27863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:07.415129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47228 (local address 127.28.155.254:32847)
0809 13:08:07.416245 (+ 1116us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:07.416257 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:07.416302 (+ 45us) server_negotiation.cc:407] Connection header received
0809 13:08:07.418055 (+ 1753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:07.418079 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:07.418598 (+ 519us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:07.418960 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:07.419637 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:07.421090 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:07.423045 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:07.423752 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:07.423894 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:07.425315 (+ 1421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:07.425323 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:07.425337 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:07.425890 (+ 553us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:07.426007 (+ 117us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:07.426035 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:07.426125 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:07.426375 (+ 250us) server_negotiation.cc:299] Negotiation successful
0809 13:08:07.426707 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":690,"thread_start_us":429,"threads_started":1}
I20260809 13:08:07.430797 27858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c72a506d06d24f488a446d8e7a10ab0a: No bootstrap required, opened a new log
I20260809 13:08:07.438503 27858 raft_consensus.cc:348] T 00000000000000000000000000000000 P c72a506d06d24f488a446d8e7a10ab0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c72a506d06d24f488a446d8e7a10ab0a" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 32847 } }
I20260809 13:08:07.438948 27858 raft_consensus.cc:374] T 00000000000000000000000000000000 P c72a506d06d24f488a446d8e7a10ab0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:08:07.439062 27858 raft_consensus.cc:729] T 00000000000000000000000000000000 P c72a506d06d24f488a446d8e7a10ab0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c72a506d06d24f488a446d8e7a10ab0a, State: Initialized, Role: FOLLOWER
I20260809 13:08:07.439755 27858 consensus_queue.cc:260] T 00000000000000000000000000000000 P c72a506d06d24f488a446d8e7a10ab0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c72a506d06d24f488a446d8e7a10ab0a" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 32847 } }
I20260809 13:08:07.440052 27858 raft_consensus.cc:388] T 00000000000000000000000000000000 P c72a506d06d24f488a446d8e7a10ab0a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:08:07.440208 27858 raft_consensus.cc:482] T 00000000000000000000000000000000 P c72a506d06d24f488a446d8e7a10ab0a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:08:07.440420 27858 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c72a506d06d24f488a446d8e7a10ab0a [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:07.442716 27858 raft_consensus.cc:504] T 00000000000000000000000000000000 P c72a506d06d24f488a446d8e7a10ab0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c72a506d06d24f488a446d8e7a10ab0a" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 32847 } }
I20260809 13:08:07.443197 27858 leader_election.cc:302] T 00000000000000000000000000000000 P c72a506d06d24f488a446d8e7a10ab0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c72a506d06d24f488a446d8e7a10ab0a; no voters:
I20260809 13:08:07.443804 27858 leader_election.cc:288] T 00000000000000000000000000000000 P c72a506d06d24f488a446d8e7a10ab0a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:08:07.443974 27865 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c72a506d06d24f488a446d8e7a10ab0a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:08:07.445199 27865 raft_consensus.cc:686] T 00000000000000000000000000000000 P c72a506d06d24f488a446d8e7a10ab0a [term 1 LEADER]: Becoming Leader. State: Replica: c72a506d06d24f488a446d8e7a10ab0a, State: Running, Role: LEADER
I20260809 13:08:07.445844 27865 consensus_queue.cc:237] T 00000000000000000000000000000000 P c72a506d06d24f488a446d8e7a10ab0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c72a506d06d24f488a446d8e7a10ab0a" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 32847 } }
I20260809 13:08:07.446130 27858 sys_catalog.cc:564] T 00000000000000000000000000000000 P c72a506d06d24f488a446d8e7a10ab0a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:08:07.448800 27867 sys_catalog.cc:455] T 00000000000000000000000000000000 P c72a506d06d24f488a446d8e7a10ab0a [sys.catalog]: SysCatalogTable state changed. Reason: New leader c72a506d06d24f488a446d8e7a10ab0a. Latest consensus state: current_term: 1 leader_uuid: "c72a506d06d24f488a446d8e7a10ab0a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c72a506d06d24f488a446d8e7a10ab0a" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 32847 } } }
I20260809 13:08:07.449290 27867 sys_catalog.cc:458] T 00000000000000000000000000000000 P c72a506d06d24f488a446d8e7a10ab0a [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:07.449158 27866 sys_catalog.cc:455] T 00000000000000000000000000000000 P c72a506d06d24f488a446d8e7a10ab0a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c72a506d06d24f488a446d8e7a10ab0a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c72a506d06d24f488a446d8e7a10ab0a" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 32847 } } }
I20260809 13:08:07.449483 27866 sys_catalog.cc:458] T 00000000000000000000000000000000 P c72a506d06d24f488a446d8e7a10ab0a [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:07.452718 27873 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:08:07.458575 27873 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:08:07.468569 27873 catalog_manager.cc:1347] Generated new cluster ID: 530324ae4319418a80c8c8dab61c3597
I20260809 13:08:07.468703 27873 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:08:07.481962 27873 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:08:07.483399 27873 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:08:07.493204 27873 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c72a506d06d24f488a446d8e7a10ab0a: Generated new TSK 0
I20260809 13:08:07.494189 27873 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 13:08:07.504040 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.193:0
--local_ip_for_outbound_sockets=127.28.155.193
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:32847
--builtin_ntp_servers=127.28.155.212:33515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 13:08:07.878103 27896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:07.878474 27896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:07.878650 27896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:07.886255 27896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:07.886410 27896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:07.886605 27896 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.193
I20260809 13:08:07.896229 27896 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:33515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.155.193
--webserver_port=0
--tserver_master_addrs=127.28.155.254:32847
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.193
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:07.897739 27896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:07.899616 27896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:07.913790 27902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:07.913857 27905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:07.913882 27903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:07.915081 27896 server_base.cc:1034] running on GCE node
I20260809 13:08:07.915804 27896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:07.916877 27896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:07.918090 27896 hybrid_clock.cc:648] HybridClock initialized: now 1786280887918027 us; error 58 us; skew 500 ppm
I20260809 13:08:07.918390 27896 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 13:08:07.920909 27896 webserver.cc:460] Webserver started at http://127.28.155.193:44749/ using document root <none> and password file <none>
I20260809 13:08:07.921600 27896 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:07.921692 27896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:07.921979 27896 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:07.925122 27896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-0/data/instance:
uuid: "16d57816eb59400aae58b12bfacd1a8c"
format_stamp: "Formatted at 2026-08-09 13:08:07 on dist-test-slave-jq4t"
server_key: "0b16e1d43e341678b503e092530e7f46"
server_key_iv: "7781689aa7509db3323c82fb17cc9f5b"
server_key_version: "encryptionkey@0"
I20260809 13:08:07.925905 27896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance:
uuid: "16d57816eb59400aae58b12bfacd1a8c"
format_stamp: "Formatted at 2026-08-09 13:08:07 on dist-test-slave-jq4t"
server_key: "0b16e1d43e341678b503e092530e7f46"
server_key_iv: "7781689aa7509db3323c82fb17cc9f5b"
server_key_version: "encryptionkey@0"
I20260809 13:08:07.932214 27896 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260809 13:08:07.935863 27914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:07.937386 27896 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 13:08:07.937588 27896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-0/wal
uuid: "16d57816eb59400aae58b12bfacd1a8c"
format_stamp: "Formatted at 2026-08-09 13:08:07 on dist-test-slave-jq4t"
server_key: "0b16e1d43e341678b503e092530e7f46"
server_key_iv: "7781689aa7509db3323c82fb17cc9f5b"
server_key_version: "encryptionkey@0"
I20260809 13:08:07.937844 27896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:07.974910 27896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:07.975914 27896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:07.976277 27896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:07.977448 27896 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:08:07.979058 27896 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:08:07.979185 27896 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:07.979322 27896 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:08:07.979419 27896 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:08.015329 27896 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.193:46775
I20260809 13:08:08.015398 28097 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.193:46775 every 8 connection(s)
I20260809 13:08:08.016834 27896 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-0/data/info.pb
I20260809 13:08:08.023756 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 27896
I20260809 13:08:08.023988 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-0/wal/instance
I20260809 13:08:08.024547 29295 external_mini_cluster.cc:1428] Setting key 213ccbfe141e3c529f29cab87924556c
I20260809 13:08:08.027570 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.194:0
--local_ip_for_outbound_sockets=127.28.155.194
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:32847
--builtin_ntp_servers=127.28.155.212:33515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 13:08:08.031410 28100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:08.019577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.193:49045 (local address 127.28.155.254:32847)
0809 13:08:08.020063 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:08.020069 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:08.021486 (+ 1417us) server_negotiation.cc:407] Connection header received
0809 13:08:08.023437 (+ 1951us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:08.023445 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:08.023556 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:08.023703 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:08.025098 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:08.026007 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:08.027965 (+ 1958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:08.028722 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:08.028877 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:08.030332 (+ 1455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:08.030341 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:08.030348 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:08.030375 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:08.030434 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:08.030453 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:08.030551 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:08.030785 (+ 234us) server_negotiation.cc:299] Negotiation successful
0809 13:08:08.030920 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":222,"threads_started":1}
I20260809 13:08:08.032299 28102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:08.020293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:32847 (local address 127.28.155.193:49045)
0809 13:08:08.021301 (+ 1008us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:08.021341 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:08.023117 (+ 1776us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:08.024010 (+ 893us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:08.024019 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:08.024153 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:08:08.024874 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:08.024894 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:08.026204 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:08.026209 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:08.027808 (+ 1599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:08.027822 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:08.028944 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:08.028950 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:08.029172 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:08.029976 (+ 804us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 13:08:08.029979 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:08:08.030025 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 13:08:08.030116 (+ 91us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:08:08.030563 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:08:08.030573 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:08:08.030580 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 13:08:08.030746 (+ 166us) client_negotiation.cc:240] Negotiation successful
0809 13:08:08.031090 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":316,"threads_started":1}
I20260809 13:08:08.033901 28098 heartbeater.cc:347] Connected to a master server at 127.28.155.254:32847
I20260809 13:08:08.034268 28098 heartbeater.cc:464] Registering TS with master...
I20260809 13:08:08.035266 28098 heartbeater.cc:511] Master 127.28.155.254:32847 requested a full tablet report, sending...
I20260809 13:08:08.037597 27804 ts_manager.cc:194] Registered new tserver with Master: 16d57816eb59400aae58b12bfacd1a8c (127.28.155.193:46775)
I20260809 13:08:08.039158 27804 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.155.193:49045
W20260809 13:08:08.391856 28103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:08.392197 28103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:08.392360 28103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:08.399940 28103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:08.400080 28103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:08.400255 28103 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.194
I20260809 13:08:08.410467 28103 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:33515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.155.194
--webserver_port=0
--tserver_master_addrs=127.28.155.254:32847
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.194
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:08.411863 28103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:08.413856 28103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:08.428561 28112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:08.428670 28115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:08.428696 28113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:08.429606 28103 server_base.cc:1034] running on GCE node
I20260809 13:08:08.430308 28103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:08.431411 28103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:08.432677 28103 hybrid_clock.cc:648] HybridClock initialized: now 1786280888432613 us; error 50 us; skew 500 ppm
I20260809 13:08:08.433086 28103 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 13:08:08.435628 28103 webserver.cc:460] Webserver started at http://127.28.155.194:44297/ using document root <none> and password file <none>
I20260809 13:08:08.436388 28103 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:08.436544 28103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:08.436903 28103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:08.439980 28103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-1/data/instance:
uuid: "c69dcf281c9f40b3b372147d49c3ad87"
format_stamp: "Formatted at 2026-08-09 13:08:08 on dist-test-slave-jq4t"
server_key: "0462dd6891943eedb268773900888d9c"
server_key_iv: "2ca826a293f133c6b044614527659dfe"
server_key_version: "encryptionkey@0"
I20260809 13:08:08.440887 28103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance:
uuid: "c69dcf281c9f40b3b372147d49c3ad87"
format_stamp: "Formatted at 2026-08-09 13:08:08 on dist-test-slave-jq4t"
server_key: "0462dd6891943eedb268773900888d9c"
server_key_iv: "2ca826a293f133c6b044614527659dfe"
server_key_version: "encryptionkey@0"
I20260809 13:08:08.446521 28103 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 13:08:08.450269 28123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:08.451716 28103 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 13:08:08.451910 28103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-1/wal
uuid: "c69dcf281c9f40b3b372147d49c3ad87"
format_stamp: "Formatted at 2026-08-09 13:08:08 on dist-test-slave-jq4t"
server_key: "0462dd6891943eedb268773900888d9c"
server_key_iv: "2ca826a293f133c6b044614527659dfe"
server_key_version: "encryptionkey@0"
I20260809 13:08:08.452154 28103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:08.470381 28103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:08.471240 28103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:08.471560 28103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:08.472637 28103 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:08:08.474141 28103 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:08:08.474272 28103 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:08.474413 28103 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:08:08.474505 28103 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:08.509042 28103 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.194:37735
I20260809 13:08:08.509104 28295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.194:37735 every 8 connection(s)
I20260809 13:08:08.510478 28103 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-1/data/info.pb
I20260809 13:08:08.514923 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 28103
I20260809 13:08:08.515144 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-1/wal/instance
I20260809 13:08:08.515651 29295 external_mini_cluster.cc:1428] Setting key 2e48f742bbbe14c798425d132aa2a7b6
I20260809 13:08:08.518785 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.155.195:0
--local_ip_for_outbound_sockets=127.28.155.195
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:32847
--builtin_ntp_servers=127.28.155.212:33515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 13:08:08.523856 28100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:08.513290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.194:32809 (local address 127.28.155.254:32847)
0809 13:08:08.513522 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:08.513529 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:08.514907 (+ 1378us) server_negotiation.cc:407] Connection header received
0809 13:08:08.517168 (+ 2261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:08.517175 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:08.517268 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:08.517380 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:08.518499 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:08.519321 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:08.521000 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:08.521411 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:08.521555 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:08.523005 (+ 1450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:08.523011 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:08.523014 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:08.523034 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:08.523067 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:08.523080 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:08.523177 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:08.523405 (+ 228us) server_negotiation.cc:299] Negotiation successful
0809 13:08:08.523521 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 13:08:08.524981 28299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:08.513829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:32847 (local address 127.28.155.194:32809)
0809 13:08:08.514742 (+ 913us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:08.514784 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:08.516894 (+ 2110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:08.517630 (+ 736us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:08.517639 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:08.517726 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:08:08.518326 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:08.518343 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:08.519474 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:08.519480 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:08.520840 (+ 1360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:08.520853 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:08.521655 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:08.521663 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:08.521906 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:08.522663 (+ 757us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 13:08:08.522665 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:08:08.522709 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 13:08:08.522797 (+ 88us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:08:08.523179 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:08:08.523193 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:08:08.523204 (+ 11us) client_negotiation.cc:769] Sending connection context
0809 13:08:08.523391 (+ 187us) client_negotiation.cc:240] Negotiation successful
0809 13:08:08.523805 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":286,"threads_started":1}
I20260809 13:08:08.526470 28297 heartbeater.cc:347] Connected to a master server at 127.28.155.254:32847
I20260809 13:08:08.526819 28297 heartbeater.cc:464] Registering TS with master...
I20260809 13:08:08.527812 28297 heartbeater.cc:511] Master 127.28.155.254:32847 requested a full tablet report, sending...
I20260809 13:08:08.529528 27804 ts_manager.cc:194] Registered new tserver with Master: c69dcf281c9f40b3b372147d49c3ad87 (127.28.155.194:37735)
I20260809 13:08:08.530799 27804 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.155.194:32809
W20260809 13:08:08.876629 28300 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:08.877004 28300 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:08.877156 28300 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:08.884640 28300 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:08.884757 28300 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:08.884871 28300 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.155.195
I20260809 13:08:08.894275 28300 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:33515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.155.195
--webserver_port=0
--tserver_master_addrs=127.28.155.254:32847
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.155.195
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:08.895634 28300 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:08.897511 28300 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:08.911146 28308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:08.911137 28309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:08.911186 28312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:08.912293 28300 server_base.cc:1034] running on GCE node
I20260809 13:08:08.912998 28300 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:08.913939 28300 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:08.915184 28300 hybrid_clock.cc:648] HybridClock initialized: now 1786280888915140 us; error 35 us; skew 500 ppm
I20260809 13:08:08.915585 28300 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 13:08:08.918159 28300 webserver.cc:460] Webserver started at http://127.28.155.195:40143/ using document root <none> and password file <none>
I20260809 13:08:08.918892 28300 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:08.919016 28300 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:08.919363 28300 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:08.922429 28300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-2/data/instance:
uuid: "7a10bd11bcf443fc9500f2136b5c90f7"
format_stamp: "Formatted at 2026-08-09 13:08:08 on dist-test-slave-jq4t"
server_key: "2fffbdc435a8ca8f56ce63dd0ebf3a8e"
server_key_iv: "22315ad3eed9ab2886fafd7d041ab86a"
server_key_version: "encryptionkey@0"
I20260809 13:08:08.923246 28300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance:
uuid: "7a10bd11bcf443fc9500f2136b5c90f7"
format_stamp: "Formatted at 2026-08-09 13:08:08 on dist-test-slave-jq4t"
server_key: "2fffbdc435a8ca8f56ce63dd0ebf3a8e"
server_key_iv: "22315ad3eed9ab2886fafd7d041ab86a"
server_key_version: "encryptionkey@0"
I20260809 13:08:08.928680 28300 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 13:08:08.932394 28323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:08.933947 28300 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:08:08.934134 28300 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-2/wal
uuid: "7a10bd11bcf443fc9500f2136b5c90f7"
format_stamp: "Formatted at 2026-08-09 13:08:08 on dist-test-slave-jq4t"
server_key: "2fffbdc435a8ca8f56ce63dd0ebf3a8e"
server_key_iv: "22315ad3eed9ab2886fafd7d041ab86a"
server_key_version: "encryptionkey@0"
I20260809 13:08:08.934406 28300 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:08.956064 28300 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:08.957088 28300 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:08.957376 28300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:08.958364 28300 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 13:08:08.959918 28300 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 13:08:08.960011 28300 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:08.960095 28300 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 13:08:08.960150 28300 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:08.994582 28300 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.195:44235
I20260809 13:08:08.994691 28506 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.195:44235 every 8 connection(s)
I20260809 13:08:08.996040 28300 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-2/data/info.pb
I20260809 13:08:09.004832 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 28300
I20260809 13:08:09.005066 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-2/wal/instance
I20260809 13:08:09.005530 29295 external_mini_cluster.cc:1428] Setting key 05d597ee1f82e0a57ce449f7249510a4
I20260809 13:08:09.009781 28100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:08.998922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:55237 (local address 127.28.155.254:32847)
0809 13:08:08.999159 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:08.999163 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:09.000545 (+ 1382us) server_negotiation.cc:407] Connection header received
0809 13:08:09.002345 (+ 1800us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:09.002350 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:09.002424 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:09.002526 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:09.003649 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.004456 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.006468 (+ 2012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.007100 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.007242 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:09.008988 (+ 1746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:09.008994 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:09.008997 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:09.009034 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:09.009086 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:09.009103 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:09.009197 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:09.009418 (+ 221us) server_negotiation.cc:299] Negotiation successful
0809 13:08:09.009510 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260809 13:08:09.010954 28512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:08.999422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:32847 (local address 127.28.155.195:55237)
0809 13:08:09.000342 (+ 920us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:09.000389 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:09.002099 (+ 1710us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:09.002772 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:09.002780 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:09.002875 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:08:09.003489 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:09.003509 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.004629 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.004634 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:09.006303 (+ 1669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:09.006318 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.007369 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.007375 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:09.007738 (+ 363us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:09.008602 (+ 864us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 13:08:09.008605 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:08:09.008651 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 13:08:09.008780 (+ 129us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:08:09.009212 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:08:09.009223 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:08:09.009230 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 13:08:09.009393 (+ 163us) client_negotiation.cc:240] Negotiation successful
0809 13:08:09.009743 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":284,"threads_started":1}
I20260809 13:08:09.012560 28508 heartbeater.cc:347] Connected to a master server at 127.28.155.254:32847
I20260809 13:08:09.012876 28508 heartbeater.cc:464] Registering TS with master...
I20260809 13:08:09.013685 28508 heartbeater.cc:511] Master 127.28.155.254:32847 requested a full tablet report, sending...
I20260809 13:08:09.015177 27804 ts_manager.cc:194] Registered new tserver with Master: 7a10bd11bcf443fc9500f2136b5c90f7 (127.28.155.195:44235)
I20260809 13:08:09.016018 27804 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.155.195:55237
I20260809 13:08:09.021659 29295 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 13:08:09.032101 28100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:09.026226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47230 (local address 127.28.155.254:32847)
0809 13:08:09.026437 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:09.026442 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:09.026946 (+ 504us) server_negotiation.cc:407] Connection header received
0809 13:08:09.027120 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:09.027124 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:09.027203 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:09.027293 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:09.027761 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.028526 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.029874 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.030279 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.030376 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:09.031499 (+ 1123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:09.031504 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:09.031507 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:09.031527 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:09.031562 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:09.031574 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:09.031645 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:09.031767 (+ 122us) server_negotiation.cc:299] Negotiation successful
0809 13:08:09.031846 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 13:08:09.036021 27804 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47230:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 13:08:09.043087 28098 heartbeater.cc:503] Master 127.28.155.254:32847 was elected leader, sending a full tablet report...
W20260809 13:08:09.043757 27804 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 13:08:09.069077 28528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:09.056991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:46775 (local address 127.0.0.1:34312)
0809 13:08:09.061984 (+ 4993us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:09.062020 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:09.062231 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:09.062876 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:09.062883 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:09.062914 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:08:09.063291 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:09.063301 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.065054 (+ 1753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.065061 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:09.066643 (+ 1582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:09.066656 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.068014 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.068021 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:09.068236 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:09.068294 (+ 58us) client_negotiation.cc:769] Sending connection context
0809 13:08:09.068459 (+ 165us) client_negotiation.cc:240] Negotiation successful
0809 13:08:09.068701 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4763,"thread_start_us":11422,"threads_started":1}
I20260809 13:08:09.069830 28526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:09.057095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34312 (local address 127.28.155.193:46775)
0809 13:08:09.058199 (+ 1104us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:09.058212 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:09.062143 (+ 3931us) server_negotiation.cc:407] Connection header received
0809 13:08:09.062473 (+ 330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:09.062479 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:09.062665 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:09.062876 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:08:09.063473 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.064927 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.066828 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.067793 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.068011 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:09.068247 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:09.069210 (+ 963us) server_negotiation.cc:299] Negotiation successful
0809 13:08:09.069409 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":894,"thread_start_us":825,"threads_started":1}
I20260809 13:08:09.074522 27992 tablet_service.cc:1467] Processing CreateTablet for tablet 00a83aee9e324051b0fafbd761fa0efc (DEFAULT_TABLE table=test-table [id=ee5607616e9e476ba350f74d8eb3a813]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:08:09.076304 27992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00a83aee9e324051b0fafbd761fa0efc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:09.077268 28528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:09.070171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.195:44235 (local address 127.0.0.1:60448)
0809 13:08:09.070381 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:09.070405 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:09.070516 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:09.071221 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:09.071226 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:09.071252 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:08:09.071461 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:09.071475 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.072824 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.072829 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:09.074894 (+ 2065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:09.074910 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.076447 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.076456 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:09.076671 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:09.076706 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 13:08:09.076813 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 13:08:09.076960 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59,"mutex_wait_us":51}
I20260809 13:08:09.077431 28529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:09.069309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60448 (local address 127.28.155.195:44235)
0809 13:08:09.070108 (+ 799us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:09.070116 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:09.070667 (+ 551us) server_negotiation.cc:407] Connection header received
0809 13:08:09.070779 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:09.070786 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:09.071018 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:09.071212 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:08:09.071608 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.072683 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.075081 (+ 2398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.076257 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.076492 (+ 235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:09.076744 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:09.076871 (+ 127us) server_negotiation.cc:299] Negotiation successful
0809 13:08:09.077040 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":587,"thread_start_us":710,"threads_started":1}
I20260809 13:08:09.078699 28525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:09.057767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:37735 (local address 127.0.0.1:51918)
0809 13:08:09.068743 (+ 10976us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:09.068767 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:09.068983 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:09.069907 (+ 924us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:09.069911 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:09.069937 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:08:09.070463 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:09.070478 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.073503 (+ 3025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.073510 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:09.075500 (+ 1990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:09.075516 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.077859 (+ 2343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.077866 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:09.078039 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:09.078075 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 13:08:09.078174 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 13:08:09.078318 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10846,"mutex_wait_us":24,"thread_start_us":3860,"threads_started":1}
I20260809 13:08:09.078977 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:09.057816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51918 (local address 127.28.155.194:37735)
0809 13:08:09.061506 (+ 3690us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:09.061513 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:09.068875 (+ 7362us) server_negotiation.cc:407] Connection header received
0809 13:08:09.069207 (+ 332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:09.069216 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:09.069427 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:09.069572 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:08:09.070664 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.073318 (+ 2654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.075725 (+ 2407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.077302 (+ 1577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.077827 (+ 525us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:09.078030 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:09.078249 (+ 219us) server_negotiation.cc:299] Negotiation successful
0809 13:08:09.078416 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3536,"thread_start_us":3431,"threads_started":1}
I20260809 13:08:09.081470 28401 tablet_service.cc:1467] Processing CreateTablet for tablet 00a83aee9e324051b0fafbd761fa0efc (DEFAULT_TABLE table=test-table [id=ee5607616e9e476ba350f74d8eb3a813]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:08:09.082814 28197 tablet_service.cc:1467] Processing CreateTablet for tablet 00a83aee9e324051b0fafbd761fa0efc (DEFAULT_TABLE table=test-table [id=ee5607616e9e476ba350f74d8eb3a813]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 13:08:09.083635 28401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00a83aee9e324051b0fafbd761fa0efc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:09.084244 28197 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00a83aee9e324051b0fafbd761fa0efc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:09.090241 28530 tablet_bootstrap.cc:492] T 00a83aee9e324051b0fafbd761fa0efc P 16d57816eb59400aae58b12bfacd1a8c: Bootstrap starting.
I20260809 13:08:09.093578 28530 tablet_bootstrap.cc:654] T 00a83aee9e324051b0fafbd761fa0efc P 16d57816eb59400aae58b12bfacd1a8c: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:09.094655 28530 log.cc:824] T 00a83aee9e324051b0fafbd761fa0efc P 16d57816eb59400aae58b12bfacd1a8c: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:09.097379 28530 tablet_bootstrap.cc:492] T 00a83aee9e324051b0fafbd761fa0efc P 16d57816eb59400aae58b12bfacd1a8c: No bootstrap required, opened a new log
I20260809 13:08:09.097694 28530 ts_tablet_manager.cc:1397] T 00a83aee9e324051b0fafbd761fa0efc P 16d57816eb59400aae58b12bfacd1a8c: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.004s
I20260809 13:08:09.100168 28535 tablet_bootstrap.cc:492] T 00a83aee9e324051b0fafbd761fa0efc P c69dcf281c9f40b3b372147d49c3ad87: Bootstrap starting.
I20260809 13:08:09.104561 28535 tablet_bootstrap.cc:654] T 00a83aee9e324051b0fafbd761fa0efc P c69dcf281c9f40b3b372147d49c3ad87: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:09.106241 28535 log.cc:824] T 00a83aee9e324051b0fafbd761fa0efc P c69dcf281c9f40b3b372147d49c3ad87: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:09.108731 28536 tablet_bootstrap.cc:492] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7: Bootstrap starting.
I20260809 13:08:09.109129 28530 raft_consensus.cc:348] T 00a83aee9e324051b0fafbd761fa0efc P 16d57816eb59400aae58b12bfacd1a8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16d57816eb59400aae58b12bfacd1a8c" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46775 } } peers { permanent_uuid: "7a10bd11bcf443fc9500f2136b5c90f7" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44235 } } peers { permanent_uuid: "c69dcf281c9f40b3b372147d49c3ad87" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37735 } }
I20260809 13:08:09.109660 28530 raft_consensus.cc:374] T 00a83aee9e324051b0fafbd761fa0efc P 16d57816eb59400aae58b12bfacd1a8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:08:09.109797 28530 raft_consensus.cc:729] T 00a83aee9e324051b0fafbd761fa0efc P 16d57816eb59400aae58b12bfacd1a8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16d57816eb59400aae58b12bfacd1a8c, State: Initialized, Role: FOLLOWER
I20260809 13:08:09.109934 28535 tablet_bootstrap.cc:492] T 00a83aee9e324051b0fafbd761fa0efc P c69dcf281c9f40b3b372147d49c3ad87: No bootstrap required, opened a new log
I20260809 13:08:09.110236 28535 ts_tablet_manager.cc:1397] T 00a83aee9e324051b0fafbd761fa0efc P c69dcf281c9f40b3b372147d49c3ad87: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260809 13:08:09.110582 28530 consensus_queue.cc:260] T 00a83aee9e324051b0fafbd761fa0efc P 16d57816eb59400aae58b12bfacd1a8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16d57816eb59400aae58b12bfacd1a8c" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46775 } } peers { permanent_uuid: "7a10bd11bcf443fc9500f2136b5c90f7" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44235 } } peers { permanent_uuid: "c69dcf281c9f40b3b372147d49c3ad87" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37735 } }
I20260809 13:08:09.112907 28536 tablet_bootstrap.cc:654] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:09.113592 28530 ts_tablet_manager.cc:1428] T 00a83aee9e324051b0fafbd761fa0efc P 16d57816eb59400aae58b12bfacd1a8c: Time spent starting tablet: real 0.016s user 0.008s sys 0.007s
I20260809 13:08:09.114230 28536 log.cc:824] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:09.117857 28536 tablet_bootstrap.cc:492] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7: No bootstrap required, opened a new log
I20260809 13:08:09.118151 28536 ts_tablet_manager.cc:1397] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.005s
I20260809 13:08:09.120361 28535 raft_consensus.cc:348] T 00a83aee9e324051b0fafbd761fa0efc P c69dcf281c9f40b3b372147d49c3ad87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16d57816eb59400aae58b12bfacd1a8c" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46775 } } peers { permanent_uuid: "7a10bd11bcf443fc9500f2136b5c90f7" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44235 } } peers { permanent_uuid: "c69dcf281c9f40b3b372147d49c3ad87" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37735 } }
I20260809 13:08:09.120826 28535 raft_consensus.cc:374] T 00a83aee9e324051b0fafbd761fa0efc P c69dcf281c9f40b3b372147d49c3ad87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:08:09.120949 28535 raft_consensus.cc:729] T 00a83aee9e324051b0fafbd761fa0efc P c69dcf281c9f40b3b372147d49c3ad87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c69dcf281c9f40b3b372147d49c3ad87, State: Initialized, Role: FOLLOWER
I20260809 13:08:09.121556 28535 consensus_queue.cc:260] T 00a83aee9e324051b0fafbd761fa0efc P c69dcf281c9f40b3b372147d49c3ad87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16d57816eb59400aae58b12bfacd1a8c" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46775 } } peers { permanent_uuid: "7a10bd11bcf443fc9500f2136b5c90f7" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44235 } } peers { permanent_uuid: "c69dcf281c9f40b3b372147d49c3ad87" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37735 } }
I20260809 13:08:09.122759 28297 heartbeater.cc:503] Master 127.28.155.254:32847 was elected leader, sending a full tablet report...
I20260809 13:08:09.123410 28535 ts_tablet_manager.cc:1428] T 00a83aee9e324051b0fafbd761fa0efc P c69dcf281c9f40b3b372147d49c3ad87: Time spent starting tablet: real 0.013s user 0.011s sys 0.004s
I20260809 13:08:09.127512 28536 raft_consensus.cc:348] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16d57816eb59400aae58b12bfacd1a8c" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46775 } } peers { permanent_uuid: "7a10bd11bcf443fc9500f2136b5c90f7" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44235 } } peers { permanent_uuid: "c69dcf281c9f40b3b372147d49c3ad87" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37735 } }
I20260809 13:08:09.128084 28536 raft_consensus.cc:374] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:08:09.128221 28536 raft_consensus.cc:729] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a10bd11bcf443fc9500f2136b5c90f7, State: Initialized, Role: FOLLOWER
I20260809 13:08:09.128892 28536 consensus_queue.cc:260] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16d57816eb59400aae58b12bfacd1a8c" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46775 } } peers { permanent_uuid: "7a10bd11bcf443fc9500f2136b5c90f7" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44235 } } peers { permanent_uuid: "c69dcf281c9f40b3b372147d49c3ad87" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37735 } }
I20260809 13:08:09.129946 28508 heartbeater.cc:503] Master 127.28.155.254:32847 was elected leader, sending a full tablet report...
I20260809 13:08:09.130481 28536 ts_tablet_manager.cc:1428] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7: Time spent starting tablet: real 0.012s user 0.013s sys 0.000s
W20260809 13:08:09.248003 28510 tablet.cc:2369] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 13:08:09.262774 28298 tablet.cc:2369] T 00a83aee9e324051b0fafbd761fa0efc P c69dcf281c9f40b3b372147d49c3ad87: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 13:08:09.269543 28099 tablet.cc:2369] T 00a83aee9e324051b0fafbd761fa0efc P 16d57816eb59400aae58b12bfacd1a8c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:08:09.415589 28544 raft_consensus.cc:482] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 13:08:09.415985 28544 raft_consensus.cc:504] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16d57816eb59400aae58b12bfacd1a8c" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46775 } } peers { permanent_uuid: "7a10bd11bcf443fc9500f2136b5c90f7" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44235 } } peers { permanent_uuid: "c69dcf281c9f40b3b372147d49c3ad87" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37735 } }
I20260809 13:08:09.418079 28544 leader_election.cc:288] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16d57816eb59400aae58b12bfacd1a8c (127.28.155.193:46775), c69dcf281c9f40b3b372147d49c3ad87 (127.28.155.194:37735)
I20260809 13:08:09.425868 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:09.418843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:51185 (local address 127.28.155.194:37735)
0809 13:08:09.419110 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:09.419120 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:09.419598 (+ 478us) server_negotiation.cc:407] Connection header received
0809 13:08:09.419766 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:09.419770 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:09.419840 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:09.419913 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:08:09.420456 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.421403 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.423887 (+ 2484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.424941 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.425117 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:09.425192 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:09.425465 (+ 273us) server_negotiation.cc:299] Negotiation successful
0809 13:08:09.425596 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 13:08:09.425946 28526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:09.418603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.155.195:47041 (local address 127.28.155.193:46775)
0809 13:08:09.418830 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:09.418840 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:09.419183 (+ 343us) server_negotiation.cc:407] Connection header received
0809 13:08:09.419283 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:09.419291 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:09.419394 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:09.419481 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 13:08:09.420035 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.421095 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.423790 (+ 2695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.425004 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.425187 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:09.425268 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:09.425569 (+ 301us) server_negotiation.cc:299] Negotiation successful
0809 13:08:09.425703 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 13:08:09.425978 28545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:09.418644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.194:37735 (local address 127.28.155.195:51185)
0809 13:08:09.419467 (+ 823us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:09.419492 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:09.419635 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:09.419959 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:09.419966 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:09.419996 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:08:09.420296 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:09.420303 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.421560 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.421564 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:09.423692 (+ 2128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:09.423706 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.425115 (+ 1409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.425121 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:09.425288 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:09.425316 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 13:08:09.425423 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 13:08:09.425561 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":699,"spinlock_wait_cycles":19328,"thread_start_us":449,"threads_started":1}
I20260809 13:08:09.425981 28512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:09.418547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.193:46775 (local address 127.28.155.195:47041)
0809 13:08:09.418929 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:09.418950 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:09.419127 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:09.419562 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:09.419566 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:09.419603 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 13:08:09.419827 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:09.419843 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.421248 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.421252 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:09.423547 (+ 2295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:09.423569 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.425166 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.425173 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:09.425402 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:09.425426 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 13:08:09.425536 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 13:08:09.425686 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"mutex_wait_us":3}
I20260809 13:08:09.427242 28228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00a83aee9e324051b0fafbd761fa0efc" candidate_uuid: "7a10bd11bcf443fc9500f2136b5c90f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c69dcf281c9f40b3b372147d49c3ad87" is_pre_election: true
I20260809 13:08:09.427452 28026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00a83aee9e324051b0fafbd761fa0efc" candidate_uuid: "7a10bd11bcf443fc9500f2136b5c90f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16d57816eb59400aae58b12bfacd1a8c" is_pre_election: true
I20260809 13:08:09.427985 28026 raft_consensus.cc:2454] T 00a83aee9e324051b0fafbd761fa0efc P 16d57816eb59400aae58b12bfacd1a8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a10bd11bcf443fc9500f2136b5c90f7 in term 0.
I20260809 13:08:09.427973 28228 raft_consensus.cc:2454] T 00a83aee9e324051b0fafbd761fa0efc P c69dcf281c9f40b3b372147d49c3ad87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a10bd11bcf443fc9500f2136b5c90f7 in term 0.
I20260809 13:08:09.428834 28327 leader_election.cc:302] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 16d57816eb59400aae58b12bfacd1a8c, 7a10bd11bcf443fc9500f2136b5c90f7, c69dcf281c9f40b3b372147d49c3ad87; no voters:
I20260809 13:08:09.429276 28544 raft_consensus.cc:2781] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 13:08:09.429446 28544 raft_consensus.cc:482] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 13:08:09.429566 28544 raft_consensus.cc:3037] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:09.431852 28544 raft_consensus.cc:504] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16d57816eb59400aae58b12bfacd1a8c" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46775 } } peers { permanent_uuid: "7a10bd11bcf443fc9500f2136b5c90f7" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44235 } } peers { permanent_uuid: "c69dcf281c9f40b3b372147d49c3ad87" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37735 } }
I20260809 13:08:09.432575 28544 leader_election.cc:288] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7 [CANDIDATE]: Term 1 election: Requested vote from peers 16d57816eb59400aae58b12bfacd1a8c (127.28.155.193:46775), c69dcf281c9f40b3b372147d49c3ad87 (127.28.155.194:37735)
I20260809 13:08:09.432986 28026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00a83aee9e324051b0fafbd761fa0efc" candidate_uuid: "7a10bd11bcf443fc9500f2136b5c90f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16d57816eb59400aae58b12bfacd1a8c"
I20260809 13:08:09.433094 28228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00a83aee9e324051b0fafbd761fa0efc" candidate_uuid: "7a10bd11bcf443fc9500f2136b5c90f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c69dcf281c9f40b3b372147d49c3ad87"
I20260809 13:08:09.433202 28026 raft_consensus.cc:3037] T 00a83aee9e324051b0fafbd761fa0efc P 16d57816eb59400aae58b12bfacd1a8c [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:09.433341 28228 raft_consensus.cc:3037] T 00a83aee9e324051b0fafbd761fa0efc P c69dcf281c9f40b3b372147d49c3ad87 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:09.435582 28026 raft_consensus.cc:2454] T 00a83aee9e324051b0fafbd761fa0efc P 16d57816eb59400aae58b12bfacd1a8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a10bd11bcf443fc9500f2136b5c90f7 in term 1.
I20260809 13:08:09.435660 28228 raft_consensus.cc:2454] T 00a83aee9e324051b0fafbd761fa0efc P c69dcf281c9f40b3b372147d49c3ad87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a10bd11bcf443fc9500f2136b5c90f7 in term 1.
I20260809 13:08:09.436040 28325 leader_election.cc:302] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16d57816eb59400aae58b12bfacd1a8c, 7a10bd11bcf443fc9500f2136b5c90f7; no voters:
I20260809 13:08:09.436395 28544 raft_consensus.cc:2781] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:08:09.436846 28544 raft_consensus.cc:686] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7 [term 1 LEADER]: Becoming Leader. State: Replica: 7a10bd11bcf443fc9500f2136b5c90f7, State: Running, Role: LEADER
I20260809 13:08:09.437363 28544 consensus_queue.cc:237] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16d57816eb59400aae58b12bfacd1a8c" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46775 } } peers { permanent_uuid: "7a10bd11bcf443fc9500f2136b5c90f7" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44235 } } peers { permanent_uuid: "c69dcf281c9f40b3b372147d49c3ad87" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37735 } }
I20260809 13:08:09.442126 27802 catalog_manager.cc:5495] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a10bd11bcf443fc9500f2136b5c90f7 (127.28.155.195). New cstate: current_term: 1 leader_uuid: "7a10bd11bcf443fc9500f2136b5c90f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16d57816eb59400aae58b12bfacd1a8c" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a10bd11bcf443fc9500f2136b5c90f7" member_type: VOTER last_known_addr { host: "127.28.155.195" port: 44235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c69dcf281c9f40b3b372147d49c3ad87" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37735 } health_report { overall_health: UNKNOWN } } }
I20260809 13:08:09.530838 28529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:09.524882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60450 (local address 127.28.155.195:44235)
0809 13:08:09.525144 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:09.525151 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:09.525234 (+ 83us) server_negotiation.cc:407] Connection header received
0809 13:08:09.525521 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:09.525526 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:09.525617 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:09.525784 (+ 167us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:08:09.526203 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.526980 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.528446 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.528944 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.529079 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:09.529653 (+ 574us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:08:09.530192 (+ 539us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:08:09.530362 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:09.530447 (+ 85us) server_negotiation.cc:299] Negotiation successful
0809 13:08:09.530537 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260809 13:08:09.540362 28228 raft_consensus.cc:1261] T 00a83aee9e324051b0fafbd761fa0efc P c69dcf281c9f40b3b372147d49c3ad87 [term 1 FOLLOWER]: Refusing update from remote peer 7a10bd11bcf443fc9500f2136b5c90f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:08:09.540362 28026 raft_consensus.cc:1261] T 00a83aee9e324051b0fafbd761fa0efc P 16d57816eb59400aae58b12bfacd1a8c [term 1 FOLLOWER]: Refusing update from remote peer 7a10bd11bcf443fc9500f2136b5c90f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:08:09.541664 28547 consensus_queue.cc:1035] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16d57816eb59400aae58b12bfacd1a8c" member_type: VOTER last_known_addr { host: "127.28.155.193" port: 46775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:08:09.542044 28544 consensus_queue.cc:1035] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c69dcf281c9f40b3b372147d49c3ad87" member_type: VOTER last_known_addr { host: "127.28.155.194" port: 37735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:08:09.555738 28550 mvcc.cc:205] Tried to move back new op lower bound from 7316606523544276992 to 7316606523139403776. Current Snapshot: MvccSnapshot[applied={T|T < 7316606523544276992}]
I20260809 13:08:09.571105 27802 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47230:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:08:09.571449 27802 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47230:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 13:08:09.575259 27802 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c72a506d06d24f488a446d8e7a10ab0a: Sending DeleteTablet for 3 replicas of tablet 00a83aee9e324051b0fafbd761fa0efc
I20260809 13:08:09.576529 27992 tablet_service.cc:1514] Processing DeleteTablet for tablet 00a83aee9e324051b0fafbd761fa0efc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:08:09 UTC) from {username='slave'} at 127.0.0.1:34312
I20260809 13:08:09.576582 28401 tablet_service.cc:1514] Processing DeleteTablet for tablet 00a83aee9e324051b0fafbd761fa0efc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:08:09 UTC) from {username='slave'} at 127.0.0.1:60448
I20260809 13:08:09.577407 28197 tablet_service.cc:1514] Processing DeleteTablet for tablet 00a83aee9e324051b0fafbd761fa0efc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 13:08:09 UTC) from {username='slave'} at 127.0.0.1:51918
I20260809 13:08:09.577795 28564 tablet_replica.cc:330] T 00a83aee9e324051b0fafbd761fa0efc P 16d57816eb59400aae58b12bfacd1a8c: stopping tablet replica
I20260809 13:08:09.578351 28564 raft_consensus.cc:2229] T 00a83aee9e324051b0fafbd761fa0efc P 16d57816eb59400aae58b12bfacd1a8c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:08:09.578923 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 27896
I20260809 13:08:09.579025 28564 raft_consensus.cc:2258] T 00a83aee9e324051b0fafbd761fa0efc P 16d57816eb59400aae58b12bfacd1a8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:08:09.579874 28565 tablet_replica.cc:330] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7: stopping tablet replica
I20260809 13:08:09.580173 28565 raft_consensus.cc:2229] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7 [term 1 LEADER]: Raft consensus shutting down.
I20260809 13:08:09.580894 28565 raft_consensus.cc:2258] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:08:09.583444 28564 ts_tablet_manager.cc:1905] T 00a83aee9e324051b0fafbd761fa0efc P 16d57816eb59400aae58b12bfacd1a8c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:08:09.590306 28566 tablet_replica.cc:330] T 00a83aee9e324051b0fafbd761fa0efc P c69dcf281c9f40b3b372147d49c3ad87: stopping tablet replica
I20260809 13:08:09.590858 28566 raft_consensus.cc:2229] T 00a83aee9e324051b0fafbd761fa0efc P c69dcf281c9f40b3b372147d49c3ad87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 13:08:09.591468 28566 raft_consensus.cc:2258] T 00a83aee9e324051b0fafbd761fa0efc P c69dcf281c9f40b3b372147d49c3ad87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 13:08:09.592867 28564 ts_tablet_manager.cc:1918] T 00a83aee9e324051b0fafbd761fa0efc P 16d57816eb59400aae58b12bfacd1a8c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:08:09.593130 28564 log.cc:1196] T 00a83aee9e324051b0fafbd761fa0efc P 16d57816eb59400aae58b12bfacd1a8c: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-0/wal/wals/00a83aee9e324051b0fafbd761fa0efc
I20260809 13:08:09.593809 28564 ts_tablet_manager.cc:1939] T 00a83aee9e324051b0fafbd761fa0efc P 16d57816eb59400aae58b12bfacd1a8c: Deleting consensus metadata
I20260809 13:08:09.594429 28565 ts_tablet_manager.cc:1905] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:08:09.595993 27781 catalog_manager.cc:4841] TS 16d57816eb59400aae58b12bfacd1a8c (127.28.155.193:46775): tablet 00a83aee9e324051b0fafbd761fa0efc (table test-table [id=ee5607616e9e476ba350f74d8eb3a813]) successfully deleted
I20260809 13:08:09.598515 28566 ts_tablet_manager.cc:1905] T 00a83aee9e324051b0fafbd761fa0efc P c69dcf281c9f40b3b372147d49c3ad87: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 13:08:09.601470 28526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:09.581147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34318 (local address 127.28.155.193:46775)
0809 13:08:09.581331 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:09.581340 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:09.591501 (+ 10161us) server_negotiation.cc:407] Connection header received
0809 13:08:09.591886 (+ 385us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:09.591893 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:09.592034 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:09.592121 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:09.592890 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.594178 (+ 1288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.597118 (+ 2940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.597891 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.598006 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:09.599608 (+ 1602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:09.599619 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:09.599638 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:09.600445 (+ 807us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:09.600557 (+ 112us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:09.600587 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:09.600688 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:09.600932 (+ 244us) server_negotiation.cc:299] Negotiation successful
0809 13:08:09.601062 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 13:08:09.602111 28565 ts_tablet_manager.cc:1918] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:08:09.602360 28565 log.cc:1196] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-2/wal/wals/00a83aee9e324051b0fafbd761fa0efc
I20260809 13:08:09.602941 28090 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:08:09.603293 28565 ts_tablet_manager.cc:1939] T 00a83aee9e324051b0fafbd761fa0efc P 7a10bd11bcf443fc9500f2136b5c90f7: Deleting consensus metadata
I20260809 13:08:09.605468 27781 catalog_manager.cc:4841] TS 7a10bd11bcf443fc9500f2136b5c90f7 (127.28.155.195:44235): tablet 00a83aee9e324051b0fafbd761fa0efc (table test-table [id=ee5607616e9e476ba350f74d8eb3a813]) successfully deleted
I20260809 13:08:09.606354 28566 ts_tablet_manager.cc:1918] T 00a83aee9e324051b0fafbd761fa0efc P c69dcf281c9f40b3b372147d49c3ad87: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 13:08:09.606580 28566 log.cc:1196] T 00a83aee9e324051b0fafbd761fa0efc P c69dcf281c9f40b3b372147d49c3ad87: Deleting WAL directory at /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786280548611909-29295-0/minicluster-data/ts-1/wal/wals/00a83aee9e324051b0fafbd761fa0efc
I20260809 13:08:09.607523 28566 ts_tablet_manager.cc:1939] T 00a83aee9e324051b0fafbd761fa0efc P c69dcf281c9f40b3b372147d49c3ad87: Deleting consensus metadata
I20260809 13:08:09.610459 27783 catalog_manager.cc:4841] TS c69dcf281c9f40b3b372147d49c3ad87 (127.28.155.194:37735): tablet 00a83aee9e324051b0fafbd761fa0efc (table test-table [id=ee5607616e9e476ba350f74d8eb3a813]) successfully deleted
I20260809 13:08:09.698132 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 27896
I20260809 13:08:09.733808 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 28103
I20260809 13:08:09.742547 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:09.734777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51920 (local address 127.28.155.194:37735)
0809 13:08:09.735012 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:09.735019 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:09.735074 (+ 55us) server_negotiation.cc:407] Connection header received
0809 13:08:09.735152 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:09.735158 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:09.735284 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:09.735443 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:09.735837 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.737131 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.738473 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.739199 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.739362 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:09.740506 (+ 1144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:09.740521 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:09.740543 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:09.741430 (+ 887us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:09.741498 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:09.741525 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:09.741651 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:09.741825 (+ 174us) server_negotiation.cc:299] Negotiation successful
0809 13:08:09.741958 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 13:08:09.743409 28289 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:08:09.835376 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 28103
I20260809 13:08:09.871215 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 28300
I20260809 13:08:09.879930 28529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:09.872162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60454 (local address 127.28.155.195:44235)
0809 13:08:09.872367 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:09.872373 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:09.872396 (+ 23us) server_negotiation.cc:407] Connection header received
0809 13:08:09.872607 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:09.872614 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:09.872738 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:09.872886 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:09.873353 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.874647 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.875965 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:09.876743 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:09.876884 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:09.878044 (+ 1160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:09.878057 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:09.878077 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:09.879035 (+ 958us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:09.879110 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:09.879138 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:09.879280 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:09.879406 (+ 126us) server_negotiation.cc:299] Negotiation successful
0809 13:08:09.879525 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 13:08:09.880779 28499 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:08:10.008625 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 28300
I20260809 13:08:10.037144 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 27751
I20260809 13:08:10.038391 27852 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:08:10.153354 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 27751
2026-08-09T13:08:10Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (3343 ms)
[----------] 6 tests from EncryptionPolicyTest (24731 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:08:10 dist-test-slave-jq4t krb5kdc[28577](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:08:10 dist-test-slave-jq4t krb5kdc[28577](info): set up 2 sockets
Aug 09 13:08:10 dist-test-slave-jq4t krb5kdc[28577](info): commencing operation
krb5kdc: starting...
W20260809 13:08:11.544144 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.336s user 0.007s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:08:11 dist-test-slave-jq4t krb5kdc[28577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:08:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:08:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 13:08:11.885056 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45523
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45523
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:08:12.248701 28595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:12.249068 28595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:12.249248 28595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:12.256609 28595 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:08:12.256778 28595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:12.256889 28595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:12.257002 28595 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:08:12.257083 28595 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:08:12.267202 28595 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45523
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45523
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:12.268713 28595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:12.270068 28595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:12.282136 28603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:12.282227 28609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:12.282305 28604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:12.283310 28595 server_base.cc:1034] running on GCE node
I20260809 13:08:12.284160 28595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:12.285698 28595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:12.286959 28595 hybrid_clock.cc:648] HybridClock initialized: now 1786280892286917 us; error 58 us; skew 500 ppm
I20260809 13:08:12.287359 28595 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:08:12 dist-test-slave-jq4t krb5kdc[28577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280892, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:08:12.294229 28595 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 13:08:12.295819 28595 webserver.cc:460] Webserver started at http://127.0.0.1:44227/ using document root <none> and password file <none>
I20260809 13:08:12.296591 28595 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:12.296710 28595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:12.296983 28595 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:12.300087 28595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "ec76e6dc682c4cb8b9822fc023403a33"
format_stamp: "Formatted at 2026-08-09 13:08:12 on dist-test-slave-jq4t"
server_key: "6253fd627bfd9e9739bf54f209e6aabd"
server_key_iv: "eb30e83d9cce5e224167dcdedd234e86"
server_key_version: "encryptionkey@0"
I20260809 13:08:12.300980 28595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "ec76e6dc682c4cb8b9822fc023403a33"
format_stamp: "Formatted at 2026-08-09 13:08:12 on dist-test-slave-jq4t"
server_key: "6253fd627bfd9e9739bf54f209e6aabd"
server_key_iv: "eb30e83d9cce5e224167dcdedd234e86"
server_key_version: "encryptionkey@0"
I20260809 13:08:12.306797 28595 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 13:08:12.310482 28620 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:12.312400 28595 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 13:08:12.312644 28595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "ec76e6dc682c4cb8b9822fc023403a33"
format_stamp: "Formatted at 2026-08-09 13:08:12 on dist-test-slave-jq4t"
server_key: "6253fd627bfd9e9739bf54f209e6aabd"
server_key_iv: "eb30e83d9cce5e224167dcdedd234e86"
server_key_version: "encryptionkey@0"
I20260809 13:08:12.312892 28595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:12.327348 28595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:12.332036 28595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:12.332304 28595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:12.353111 28595 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45523
I20260809 13:08:12.353148 28700 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45523 every 8 connection(s)
I20260809 13:08:12.354750 28595 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:08:12.358901 28702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:12.359575 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 28595
I20260809 13:08:12.359825 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:08:12.360566 29295 external_mini_cluster.cc:1428] Setting key 4879d74851d7b4bd13957ed823cc8097
I20260809 13:08:12.373715 28702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec76e6dc682c4cb8b9822fc023403a33: Bootstrap starting.
Aug 09 13:08:12 dist-test-slave-jq4t krb5kdc[28577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 13:08:12.377875 28702 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec76e6dc682c4cb8b9822fc023403a33: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:12.379325 28702 log.cc:824] T 00000000000000000000000000000000 P ec76e6dc682c4cb8b9822fc023403a33: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:12.382582 28702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec76e6dc682c4cb8b9822fc023403a33: No bootstrap required, opened a new log
I20260809 13:08:12.386081 28705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:12.362664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44993 (local address 127.0.0.1:45523)
0809 13:08:12.363545 (+ 881us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:12.363558 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:12.363607 (+ 49us) server_negotiation.cc:407] Connection header received
0809 13:08:12.365443 (+ 1836us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:12.365467 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:12.365887 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:12.366240 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:12.368119 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:12.369528 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:12.371462 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:12.372155 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:12.372288 (+ 133us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:12.377596 (+ 5308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:12.377605 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:12.377621 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:12.377666 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:12.381289 (+ 3623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:12.382244 (+ 955us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:12.382251 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:12.382258 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:12.382434 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:12.383030 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:12.383034 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:12.383036 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:12.383622 (+ 586us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:12.383988 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:12.384604 (+ 616us) server_negotiation.cc:299] Negotiation successful
0809 13:08:12.384957 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":656,"thread_start_us":421,"threads_started":1}
I20260809 13:08:12.390645 29295 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 13:08:12.391506 28702 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec76e6dc682c4cb8b9822fc023403a33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec76e6dc682c4cb8b9822fc023403a33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45523 } }
I20260809 13:08:12.391922 28702 raft_consensus.cc:374] T 00000000000000000000000000000000 P ec76e6dc682c4cb8b9822fc023403a33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:08:12.392046 28702 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec76e6dc682c4cb8b9822fc023403a33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec76e6dc682c4cb8b9822fc023403a33, State: Initialized, Role: FOLLOWER
I20260809 13:08:12.392709 28702 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec76e6dc682c4cb8b9822fc023403a33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec76e6dc682c4cb8b9822fc023403a33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45523 } }
I20260809 13:08:12.393002 28702 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec76e6dc682c4cb8b9822fc023403a33 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:08:12.393157 28702 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec76e6dc682c4cb8b9822fc023403a33 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:08:12.393339 28702 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec76e6dc682c4cb8b9822fc023403a33 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:12.396086 28702 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec76e6dc682c4cb8b9822fc023403a33 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec76e6dc682c4cb8b9822fc023403a33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45523 } }
I20260809 13:08:12.396884 28702 leader_election.cc:302] T 00000000000000000000000000000000 P ec76e6dc682c4cb8b9822fc023403a33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec76e6dc682c4cb8b9822fc023403a33; no voters:
I20260809 13:08:12.397732 28702 leader_election.cc:288] T 00000000000000000000000000000000 P ec76e6dc682c4cb8b9822fc023403a33 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:08:12.397830 28716 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec76e6dc682c4cb8b9822fc023403a33 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:08:12.400628 28702 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec76e6dc682c4cb8b9822fc023403a33 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:08:12.404780 28716 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec76e6dc682c4cb8b9822fc023403a33 [term 1 LEADER]: Becoming Leader. State: Replica: ec76e6dc682c4cb8b9822fc023403a33, State: Running, Role: LEADER
I20260809 13:08:12.405589 28716 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec76e6dc682c4cb8b9822fc023403a33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec76e6dc682c4cb8b9822fc023403a33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45523 } }
I20260809 13:08:12.409227 28719 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec76e6dc682c4cb8b9822fc023403a33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec76e6dc682c4cb8b9822fc023403a33. Latest consensus state: current_term: 1 leader_uuid: "ec76e6dc682c4cb8b9822fc023403a33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec76e6dc682c4cb8b9822fc023403a33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45523 } } }
I20260809 13:08:12.409202 28717 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec76e6dc682c4cb8b9822fc023403a33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ec76e6dc682c4cb8b9822fc023403a33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec76e6dc682c4cb8b9822fc023403a33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45523 } } }
I20260809 13:08:12.409729 28717 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec76e6dc682c4cb8b9822fc023403a33 [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:12.409729 28719 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec76e6dc682c4cb8b9822fc023403a33 [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:12.413466 28731 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:08:12.423218 28705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:12.396397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39191 (local address 127.0.0.1:45523)
0809 13:08:12.396615 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:12.396620 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:12.403337 (+ 6717us) server_negotiation.cc:407] Connection header received
0809 13:08:12.403571 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:12.403579 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:12.403698 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:12.403796 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:12.406324 (+ 2528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:12.407348 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:12.409365 (+ 2017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:12.410119 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:12.410256 (+ 137us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:12.413829 (+ 3573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:12.413837 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:12.413844 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:12.413896 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:12.419034 (+ 5138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:12.420428 (+ 1394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:12.420436 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:12.420443 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:12.420690 (+ 247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:12.421374 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:12.421380 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:12.421383 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:12.421756 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:12.422071 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:12.422511 (+ 440us) server_negotiation.cc:299] Negotiation successful
0809 13:08:12.422709 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 13:08:12.425143 28731 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:08:12.435034 28731 catalog_manager.cc:1347] Generated new cluster ID: e08396dd4c5f498081118e1228fba8f8
I20260809 13:08:12.435184 28731 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:08:12.444922 28731 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:08:12.446206 28731 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:08:12.458325 28731 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ec76e6dc682c4cb8b9822fc023403a33: Generated new TSK 0
I20260809 13:08:12.459576 28731 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 13:08:12.475181 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 28595
I20260809 13:08:12.476804 28694 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:08:12.572544 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 28595
W20260809 13:08:12.600751 28574 connection.cc:535] client connection to 127.0.0.1:45523 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45523): Connection reset by peer (error 104)
2026-08-09T13:08:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2412 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:08:12 dist-test-slave-jq4t krb5kdc[28747](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:08:12 dist-test-slave-jq4t krb5kdc[28747](info): set up 2 sockets
Aug 09 13:08:12 dist-test-slave-jq4t krb5kdc[28747](info): commencing operation
krb5kdc: starting...
W20260809 13:08:13.965512 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.345s user 0.000s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:08:14 dist-test-slave-jq4t krb5kdc[28747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280894, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:08:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:08:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 13:08:14.316702 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35977
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35977
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:08:14.691286 28768 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:14.691607 28768 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:14.691705 28768 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:14.699290 28768 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:08:14.699455 28768 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:14.699507 28768 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:14.699580 28768 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:08:14.699628 28768 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:08:14.710203 28768 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35977
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35977
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:14.711654 28768 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:14.713133 28768 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:14.726291 28778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:14.726338 28780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:14.726388 28782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:14.727849 28768 server_base.cc:1034] running on GCE node
I20260809 13:08:14.728811 28768 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:14.730435 28768 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:14.731669 28768 hybrid_clock.cc:648] HybridClock initialized: now 1786280894731609 us; error 37 us; skew 500 ppm
I20260809 13:08:14.732036 28768 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:08:14 dist-test-slave-jq4t krb5kdc[28747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280894, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:08:14.735670 28768 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 13:08:14.737524 28768 webserver.cc:460] Webserver started at http://127.0.0.1:37491/ using document root <none> and password file <none>
I20260809 13:08:14.738309 28768 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:14.738472 28768 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:14.738816 28768 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:14.742308 28768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "d4abf68375aa471d9d25845049d6acf6"
format_stamp: "Formatted at 2026-08-09 13:08:14 on dist-test-slave-jq4t"
server_key: "257cc95b6f871e9d2f5695d94d41c049"
server_key_iv: "67b91db0130f383eeab512b6500b1896"
server_key_version: "encryptionkey@0"
I20260809 13:08:14.743213 28768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "d4abf68375aa471d9d25845049d6acf6"
format_stamp: "Formatted at 2026-08-09 13:08:14 on dist-test-slave-jq4t"
server_key: "257cc95b6f871e9d2f5695d94d41c049"
server_key_iv: "67b91db0130f383eeab512b6500b1896"
server_key_version: "encryptionkey@0"
I20260809 13:08:14.749603 28768 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.008s
I20260809 13:08:14.753701 28794 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:14.755151 28768 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260809 13:08:14.755376 28768 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "d4abf68375aa471d9d25845049d6acf6"
format_stamp: "Formatted at 2026-08-09 13:08:14 on dist-test-slave-jq4t"
server_key: "257cc95b6f871e9d2f5695d94d41c049"
server_key_iv: "67b91db0130f383eeab512b6500b1896"
server_key_version: "encryptionkey@0"
I20260809 13:08:14.755612 28768 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:14.769613 28768 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:14.774020 28768 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:14.774336 28768 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:14.794874 28768 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35977
I20260809 13:08:14.794910 28883 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35977 every 8 connection(s)
I20260809 13:08:14.796366 28768 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:08:14.800338 28885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:14.804682 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 28768
I20260809 13:08:14.804893 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:08:14.805493 29295 external_mini_cluster.cc:1428] Setting key 0f56e37145ad34b7057cbff3676bea63
I20260809 13:08:14.814477 28885 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4abf68375aa471d9d25845049d6acf6: Bootstrap starting.
I20260809 13:08:14.818485 28885 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d4abf68375aa471d9d25845049d6acf6: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:14.819725 28888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:14.807416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43001 (local address 127.0.0.1:35977)
0809 13:08:14.808296 (+ 880us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:14.808309 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:14.808353 (+ 44us) server_negotiation.cc:407] Connection header received
0809 13:08:14.810108 (+ 1755us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:14.810132 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:14.810588 (+ 456us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:14.810956 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:14.811637 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:14.813111 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:14.815095 (+ 1984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:14.815773 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:14.815904 (+ 131us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:14.817330 (+ 1426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:14.817337 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:14.817350 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:14.817894 (+ 544us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:14.817975 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:14.818005 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:14.818132 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:14.818431 (+ 299us) server_negotiation.cc:299] Negotiation successful
0809 13:08:14.818642 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":669,"thread_start_us":441,"threads_started":1}
I20260809 13:08:14.819753 28885 log.cc:824] T 00000000000000000000000000000000 P d4abf68375aa471d9d25845049d6acf6: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:14.823385 28885 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4abf68375aa471d9d25845049d6acf6: No bootstrap required, opened a new log
I20260809 13:08:14.824283 29295 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 13:08:14.832912 28885 raft_consensus.cc:348] T 00000000000000000000000000000000 P d4abf68375aa471d9d25845049d6acf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4abf68375aa471d9d25845049d6acf6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35977 } }
I20260809 13:08:14.833467 28885 raft_consensus.cc:374] T 00000000000000000000000000000000 P d4abf68375aa471d9d25845049d6acf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:08:14.833576 28885 raft_consensus.cc:729] T 00000000000000000000000000000000 P d4abf68375aa471d9d25845049d6acf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4abf68375aa471d9d25845049d6acf6, State: Initialized, Role: FOLLOWER
I20260809 13:08:14.834273 28885 consensus_queue.cc:260] T 00000000000000000000000000000000 P d4abf68375aa471d9d25845049d6acf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4abf68375aa471d9d25845049d6acf6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35977 } }
I20260809 13:08:14.834569 28885 raft_consensus.cc:388] T 00000000000000000000000000000000 P d4abf68375aa471d9d25845049d6acf6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:08:14.834733 28885 raft_consensus.cc:482] T 00000000000000000000000000000000 P d4abf68375aa471d9d25845049d6acf6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:08:14.834950 28885 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d4abf68375aa471d9d25845049d6acf6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:14.836845 28888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:14.829604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39385 (local address 127.0.0.1:35977)
0809 13:08:14.829842 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:14.829858 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:14.830160 (+ 302us) server_negotiation.cc:407] Connection header received
0809 13:08:14.830437 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:14.830442 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:14.830518 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:14.830608 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:14.831315 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:14.832108 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:14.834075 (+ 1967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:14.834570 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:14.834725 (+ 155us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:14.835998 (+ 1273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:14.836015 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:14.836018 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:14.836040 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:14.836102 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:14.836121 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:14.836260 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:14.836470 (+ 210us) server_negotiation.cc:299] Negotiation successful
0809 13:08:14.836559 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260809 13:08:14.837697 28885 raft_consensus.cc:504] T 00000000000000000000000000000000 P d4abf68375aa471d9d25845049d6acf6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4abf68375aa471d9d25845049d6acf6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35977 } }
I20260809 13:08:14.838313 28885 leader_election.cc:302] T 00000000000000000000000000000000 P d4abf68375aa471d9d25845049d6acf6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d4abf68375aa471d9d25845049d6acf6; no voters:
I20260809 13:08:14.838930 28885 leader_election.cc:288] T 00000000000000000000000000000000 P d4abf68375aa471d9d25845049d6acf6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:08:14.839082 28897 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d4abf68375aa471d9d25845049d6acf6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:08:14.839848 28897 raft_consensus.cc:686] T 00000000000000000000000000000000 P d4abf68375aa471d9d25845049d6acf6 [term 1 LEADER]: Becoming Leader. State: Replica: d4abf68375aa471d9d25845049d6acf6, State: Running, Role: LEADER
I20260809 13:08:14.840421 28897 consensus_queue.cc:237] T 00000000000000000000000000000000 P d4abf68375aa471d9d25845049d6acf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4abf68375aa471d9d25845049d6acf6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35977 } }
I20260809 13:08:14.841245 28885 sys_catalog.cc:564] T 00000000000000000000000000000000 P d4abf68375aa471d9d25845049d6acf6 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:08:14.843485 28898 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4abf68375aa471d9d25845049d6acf6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d4abf68375aa471d9d25845049d6acf6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4abf68375aa471d9d25845049d6acf6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35977 } } }
I20260809 13:08:14.843457 28900 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4abf68375aa471d9d25845049d6acf6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d4abf68375aa471d9d25845049d6acf6. Latest consensus state: current_term: 1 leader_uuid: "d4abf68375aa471d9d25845049d6acf6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4abf68375aa471d9d25845049d6acf6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35977 } } }
I20260809 13:08:14.844614 28898 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4abf68375aa471d9d25845049d6acf6 [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:14.845050 28900 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4abf68375aa471d9d25845049d6acf6 [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:14.849738 28906 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:08:14.855135 28906 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:08:14.867085 28906 catalog_manager.cc:1347] Generated new cluster ID: 180a182df087454dbf37c088ff77798d
I20260809 13:08:14.867223 28906 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:08:14.880788 28906 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:08:14.882145 28906 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:08:14.890990 28906 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d4abf68375aa471d9d25845049d6acf6: Generated new TSK 0
I20260809 13:08:14.891876 28906 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 13:08:14.901742 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 28768
W20260809 13:08:14.902932 28877 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:43001
W20260809 13:08:14.903926 29295 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 28768: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 13:08:14.904131 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 28768
W20260809 13:08:14.932052 28744 connection.cc:535] client connection to 127.0.0.1:35977 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35977): Connection reset by peer (error 104)
2026-08-09T13:08:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2331 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:08:15 dist-test-slave-jq4t krb5kdc[28929](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:08:15 dist-test-slave-jq4t krb5kdc[28929](info): set up 2 sockets
Aug 09 13:08:15 dist-test-slave-jq4t krb5kdc[28929](info): commencing operation
krb5kdc: starting...
W20260809 13:08:16.265537 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.314s user 0.002s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:08:16 dist-test-slave-jq4t krb5kdc[28929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280896, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:08:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:08:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 13:08:16.612319 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42315
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42315
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:08:16.973670 28950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:16.974053 28950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:16.974220 28950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:16.981709 28950 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:08:16.981886 28950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:16.981993 28950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:16.982112 28950 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:08:16.982203 28950 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:08:16.992683 28950 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42315
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42315
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:16.994136 28950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:16.995528 28950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:17.008302 28962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:17.008280 28964 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:17.008360 28959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:17.009196 28950 server_base.cc:1034] running on GCE node
I20260809 13:08:17.010059 28950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:17.011616 28950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:17.012859 28950 hybrid_clock.cc:648] HybridClock initialized: now 1786280897012815 us; error 38 us; skew 500 ppm
I20260809 13:08:17.013253 28950 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:08:17 dist-test-slave-jq4t krb5kdc[28929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280897, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:08:17.016669 28950 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 13:08:17.018175 28950 webserver.cc:460] Webserver started at http://127.0.0.1:36905/ using document root <none> and password file <none>
I20260809 13:08:17.018843 28950 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:17.018962 28950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:17.019238 28950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:17.022528 28950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "4b6d52efc070483ca050e15f091750ee"
format_stamp: "Formatted at 2026-08-09 13:08:17 on dist-test-slave-jq4t"
server_key: "c47349df24e0b10ae93e147a089eb380"
server_key_iv: "055e3c8702bd90c9df930656de814fce"
server_key_version: "encryptionkey@0"
I20260809 13:08:17.023356 28950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "4b6d52efc070483ca050e15f091750ee"
format_stamp: "Formatted at 2026-08-09 13:08:17 on dist-test-slave-jq4t"
server_key: "c47349df24e0b10ae93e147a089eb380"
server_key_iv: "055e3c8702bd90c9df930656de814fce"
server_key_version: "encryptionkey@0"
I20260809 13:08:17.029047 28950 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260809 13:08:17.032672 28973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:17.034116 28950 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:08:17.034332 28950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "4b6d52efc070483ca050e15f091750ee"
format_stamp: "Formatted at 2026-08-09 13:08:17 on dist-test-slave-jq4t"
server_key: "c47349df24e0b10ae93e147a089eb380"
server_key_iv: "055e3c8702bd90c9df930656de814fce"
server_key_version: "encryptionkey@0"
I20260809 13:08:17.034564 28950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:17.040846 28950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:17.045651 28950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:17.046005 28950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:17.066727 28950 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42315
I20260809 13:08:17.066823 29049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42315 every 8 connection(s)
I20260809 13:08:17.068264 28950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:08:17.072625 29050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:17.076637 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 28950
I20260809 13:08:17.076830 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:08:17.077430 29295 external_mini_cluster.cc:1428] Setting key ee5963f50eca9b20c3143e5022b499aa
I20260809 13:08:17.085388 29055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:17.079328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38469 (local address 127.0.0.1:42315)
0809 13:08:17.080150 (+ 822us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:17.080161 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:17.080203 (+ 42us) server_negotiation.cc:407] Connection header received
0809 13:08:17.081924 (+ 1721us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:17.081950 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:17.082294 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:17.082634 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:17.083793 (+ 1159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:17.083799 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:17.083811 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:17.083825 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:17.083884 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:17.083906 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:17.084081 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:17.084220 (+ 139us) server_negotiation.cc:299] Negotiation successful
0809 13:08:17.084418 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":615,"thread_start_us":375,"threads_started":1}
I20260809 13:08:17.086200 29050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b6d52efc070483ca050e15f091750ee: Bootstrap starting.
I20260809 13:08:17.089112 29295 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 13:08:17.089690 29050 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b6d52efc070483ca050e15f091750ee: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:17.090983 29050 log.cc:824] T 00000000000000000000000000000000 P 4b6d52efc070483ca050e15f091750ee: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:17.094494 29050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b6d52efc070483ca050e15f091750ee: No bootstrap required, opened a new log
I20260809 13:08:17.097133 29055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:17.094494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34117 (local address 127.0.0.1:42315)
0809 13:08:17.094692 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:17.094698 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:17.095127 (+ 429us) server_negotiation.cc:407] Connection header received
0809 13:08:17.095261 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:17.095267 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:17.095344 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:17.095472 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:17.096387 (+ 915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:17.096395 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:17.096404 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:17.096428 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:17.096510 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:17.096533 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:17.096660 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:17.096743 (+ 83us) server_negotiation.cc:299] Negotiation successful
0809 13:08:17.096809 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 13:08:17.102866 29050 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b6d52efc070483ca050e15f091750ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b6d52efc070483ca050e15f091750ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42315 } }
I20260809 13:08:17.103281 29050 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4b6d52efc070483ca050e15f091750ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:08:17.103412 29050 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b6d52efc070483ca050e15f091750ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b6d52efc070483ca050e15f091750ee, State: Initialized, Role: FOLLOWER
I20260809 13:08:17.104053 29050 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b6d52efc070483ca050e15f091750ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b6d52efc070483ca050e15f091750ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42315 } }
I20260809 13:08:17.104322 29050 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4b6d52efc070483ca050e15f091750ee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:08:17.104524 29050 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4b6d52efc070483ca050e15f091750ee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:08:17.104730 29050 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b6d52efc070483ca050e15f091750ee [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:17.106988 29050 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4b6d52efc070483ca050e15f091750ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b6d52efc070483ca050e15f091750ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42315 } }
I20260809 13:08:17.107503 29050 leader_election.cc:302] T 00000000000000000000000000000000 P 4b6d52efc070483ca050e15f091750ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b6d52efc070483ca050e15f091750ee; no voters:
I20260809 13:08:17.108220 29050 leader_election.cc:288] T 00000000000000000000000000000000 P 4b6d52efc070483ca050e15f091750ee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:08:17.108333 29067 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4b6d52efc070483ca050e15f091750ee [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:08:17.109660 29067 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4b6d52efc070483ca050e15f091750ee [term 1 LEADER]: Becoming Leader. State: Replica: 4b6d52efc070483ca050e15f091750ee, State: Running, Role: LEADER
I20260809 13:08:17.110347 29067 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b6d52efc070483ca050e15f091750ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b6d52efc070483ca050e15f091750ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42315 } }
I20260809 13:08:17.110674 29050 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b6d52efc070483ca050e15f091750ee [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:08:17.113546 29068 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b6d52efc070483ca050e15f091750ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b6d52efc070483ca050e15f091750ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b6d52efc070483ca050e15f091750ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42315 } } }
I20260809 13:08:17.114089 29068 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b6d52efc070483ca050e15f091750ee [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:17.114624 29070 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b6d52efc070483ca050e15f091750ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b6d52efc070483ca050e15f091750ee. Latest consensus state: current_term: 1 leader_uuid: "4b6d52efc070483ca050e15f091750ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b6d52efc070483ca050e15f091750ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42315 } } }
I20260809 13:08:17.114941 29070 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b6d52efc070483ca050e15f091750ee [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:17.116315 29077 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:08:17.121394 29077 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:08:17.131943 29077 catalog_manager.cc:1347] Generated new cluster ID: 0713ee42109b420e91ec0de50416e40d
I20260809 13:08:17.132076 29077 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:08:17.142495 29077 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:08:17.142944 29077 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:08:17.153987 29077 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4b6d52efc070483ca050e15f091750ee: Generated new TSK 0
I20260809 13:08:17.154973 29077 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 13:08:17.171211 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 28950
W20260809 13:08:17.172425 29042 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:38469
W20260809 13:08:17.173223 29295 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 28950: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 13:08:17.173353 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 28950
2026-08-09T13:08:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2267 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:08:17 dist-test-slave-jq4t krb5kdc[29092](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:08:17 dist-test-slave-jq4t krb5kdc[29092](info): set up 2 sockets
Aug 09 13:08:17 dist-test-slave-jq4t krb5kdc[29092](info): commencing operation
krb5kdc: starting...
W20260809 13:08:18.534391 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.315s user 0.003s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:08:18 dist-test-slave-jq4t krb5kdc[29092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280898, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:08:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:08:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 13:08:18.875877 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40555
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40555
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:08:19.233698 29111 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:19.234030 29111 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:19.234261 29111 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:19.241667 29111 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:08:19.241777 29111 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:19.241894 29111 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:19.242013 29111 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:08:19.242079 29111 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:08:19.252082 29111 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40555
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40555
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:19.253484 29111 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:19.254899 29111 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:19.267589 29119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:19.267704 29123 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:19.267608 29118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:19.268620 29111 server_base.cc:1034] running on GCE node
I20260809 13:08:19.269474 29111 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:19.271025 29111 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:19.272270 29111 hybrid_clock.cc:648] HybridClock initialized: now 1786280899272226 us; error 59 us; skew 500 ppm
I20260809 13:08:19.272708 29111 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:08:19 dist-test-slave-jq4t krb5kdc[29092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280899, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:08:19.279721 29111 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 13:08:19.281275 29111 webserver.cc:460] Webserver started at http://127.0.0.1:41709/ using document root <none> and password file <none>
I20260809 13:08:19.281958 29111 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:19.282065 29111 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:19.282330 29111 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:19.285558 29111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "344b303833d943f183c175cb6d1e57cd"
format_stamp: "Formatted at 2026-08-09 13:08:19 on dist-test-slave-jq4t"
server_key: "d09cd544553362695716800cafac7c00"
server_key_iv: "864925caa6884d391ca075dd2ad66167"
server_key_version: "encryptionkey@0"
I20260809 13:08:19.286334 29111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "344b303833d943f183c175cb6d1e57cd"
format_stamp: "Formatted at 2026-08-09 13:08:19 on dist-test-slave-jq4t"
server_key: "d09cd544553362695716800cafac7c00"
server_key_iv: "864925caa6884d391ca075dd2ad66167"
server_key_version: "encryptionkey@0"
I20260809 13:08:19.291836 29111 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 13:08:19.295754 29135 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:19.297225 29111 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 13:08:19.297435 29111 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "344b303833d943f183c175cb6d1e57cd"
format_stamp: "Formatted at 2026-08-09 13:08:19 on dist-test-slave-jq4t"
server_key: "d09cd544553362695716800cafac7c00"
server_key_iv: "864925caa6884d391ca075dd2ad66167"
server_key_version: "encryptionkey@0"
I20260809 13:08:19.297665 29111 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:19.314164 29111 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:19.318581 29111 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:19.318912 29111 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:19.339133 29111 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40555
I20260809 13:08:19.339171 29215 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40555 every 8 connection(s)
I20260809 13:08:19.340744 29111 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:08:19.345638 29218 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:19.350200 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 29111
I20260809 13:08:19.350410 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:08:19.350890 29295 external_mini_cluster.cc:1428] Setting key fab6ff6e7f1948437d3caa268586562a
I20260809 13:08:19.359002 29218 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 344b303833d943f183c175cb6d1e57cd: Bootstrap starting.
I20260809 13:08:19.363013 29218 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 344b303833d943f183c175cb6d1e57cd: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:19.364451 29218 log.cc:824] T 00000000000000000000000000000000 P 344b303833d943f183c175cb6d1e57cd: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:19.367666 29218 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 344b303833d943f183c175cb6d1e57cd: No bootstrap required, opened a new log
Aug 09 13:08:19 dist-test-slave-jq4t krb5kdc[29092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280898, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 13:08:19.379338 29221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:19.352941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48579 (local address 127.0.0.1:40555)
0809 13:08:19.353824 (+ 883us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:19.353842 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:19.353924 (+ 82us) server_negotiation.cc:407] Connection header received
0809 13:08:19.357149 (+ 3225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:19.357181 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:19.357733 (+ 552us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:19.358201 (+ 468us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:19.359805 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:19.362003 (+ 2198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:19.363456 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:19.364622 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:19.364816 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:19.369334 (+ 4518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:19.369344 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:19.369366 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:19.369428 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:19.373938 (+ 4510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:19.374859 (+ 921us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:19.374868 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:19.374886 (+ 18us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:19.375140 (+ 254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:19.375592 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:19.375597 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:19.375601 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:19.376414 (+ 813us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:19.376796 (+ 382us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:19.377240 (+ 444us) server_negotiation.cc:299] Negotiation successful
0809 13:08:19.377768 (+ 528us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":624,"thread_start_us":380,"threads_started":1}
I20260809 13:08:19.379283 29218 raft_consensus.cc:348] T 00000000000000000000000000000000 P 344b303833d943f183c175cb6d1e57cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "344b303833d943f183c175cb6d1e57cd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40555 } }
I20260809 13:08:19.379864 29218 raft_consensus.cc:374] T 00000000000000000000000000000000 P 344b303833d943f183c175cb6d1e57cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:08:19.380000 29218 raft_consensus.cc:729] T 00000000000000000000000000000000 P 344b303833d943f183c175cb6d1e57cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 344b303833d943f183c175cb6d1e57cd, State: Initialized, Role: FOLLOWER
I20260809 13:08:19.380796 29218 consensus_queue.cc:260] T 00000000000000000000000000000000 P 344b303833d943f183c175cb6d1e57cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "344b303833d943f183c175cb6d1e57cd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40555 } }
I20260809 13:08:19.381160 29218 raft_consensus.cc:388] T 00000000000000000000000000000000 P 344b303833d943f183c175cb6d1e57cd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:08:19.381337 29218 raft_consensus.cc:482] T 00000000000000000000000000000000 P 344b303833d943f183c175cb6d1e57cd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:08:19.381569 29218 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 344b303833d943f183c175cb6d1e57cd [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:19.384405 29218 raft_consensus.cc:504] T 00000000000000000000000000000000 P 344b303833d943f183c175cb6d1e57cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "344b303833d943f183c175cb6d1e57cd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40555 } }
I20260809 13:08:19.385146 29218 leader_election.cc:302] T 00000000000000000000000000000000 P 344b303833d943f183c175cb6d1e57cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 344b303833d943f183c175cb6d1e57cd; no voters:
I20260809 13:08:19.385950 29218 leader_election.cc:288] T 00000000000000000000000000000000 P 344b303833d943f183c175cb6d1e57cd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:08:19.386088 29225 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 344b303833d943f183c175cb6d1e57cd [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:08:19.388589 29295 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 13:08:19.389240 29218 sys_catalog.cc:564] T 00000000000000000000000000000000 P 344b303833d943f183c175cb6d1e57cd [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:08:19.401363 29225 raft_consensus.cc:686] T 00000000000000000000000000000000 P 344b303833d943f183c175cb6d1e57cd [term 1 LEADER]: Becoming Leader. State: Replica: 344b303833d943f183c175cb6d1e57cd, State: Running, Role: LEADER
I20260809 13:08:19.402312 29225 consensus_queue.cc:237] T 00000000000000000000000000000000 P 344b303833d943f183c175cb6d1e57cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "344b303833d943f183c175cb6d1e57cd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40555 } }
I20260809 13:08:19.406337 29226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 344b303833d943f183c175cb6d1e57cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "344b303833d943f183c175cb6d1e57cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "344b303833d943f183c175cb6d1e57cd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40555 } } }
I20260809 13:08:19.406863 29226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 344b303833d943f183c175cb6d1e57cd [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:19.407518 29227 sys_catalog.cc:455] T 00000000000000000000000000000000 P 344b303833d943f183c175cb6d1e57cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 344b303833d943f183c175cb6d1e57cd. Latest consensus state: current_term: 1 leader_uuid: "344b303833d943f183c175cb6d1e57cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "344b303833d943f183c175cb6d1e57cd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40555 } } }
I20260809 13:08:19.407887 29227 sys_catalog.cc:458] T 00000000000000000000000000000000 P 344b303833d943f183c175cb6d1e57cd [sys.catalog]: This master's current role is: LEADER
W20260809 13:08:19.415550 29251 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 344b303833d943f183c175cb6d1e57cd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 13:08:19.415714 29251 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 13:08:19.415835 29252 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:08:19.418255 29252 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:08:19.423813 29221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:19.405752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43197 (local address 127.0.0.1:40555)
0809 13:08:19.405955 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:19.405961 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:19.408749 (+ 2788us) server_negotiation.cc:407] Connection header received
0809 13:08:19.409086 (+ 337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:19.409094 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:19.409208 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:19.409300 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:19.411727 (+ 2427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:19.412577 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:19.413922 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:19.414458 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:19.414644 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:19.417497 (+ 2853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:19.417502 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:19.417506 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:19.417540 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:19.420808 (+ 3268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:19.421548 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:19.421554 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:19.421558 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:19.421717 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:19.422128 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:19.422134 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:19.422138 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:19.422554 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:19.422818 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:19.423233 (+ 415us) server_negotiation.cc:299] Negotiation successful
0809 13:08:19.423468 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 13:08:19.428941 29252 catalog_manager.cc:1347] Generated new cluster ID: f0808a7cbf1a4e3987eefeaaed066334
I20260809 13:08:19.429068 29252 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:08:19.448053 29252 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:08:19.449530 29252 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:08:19.465613 29252 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 344b303833d943f183c175cb6d1e57cd: Generated new TSK 0
I20260809 13:08:19.466849 29252 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 13:08:19.482507 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 29111
I20260809 13:08:19.483728 29211 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:08:19.582248 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 29111
2026-08-09T13:08:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2411 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:08:19 dist-test-slave-jq4t krb5kdc[29261](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:08:19 dist-test-slave-jq4t krb5kdc[29261](info): set up 2 sockets
Aug 09 13:08:19 dist-test-slave-jq4t krb5kdc[29261](info): commencing operation
krb5kdc: starting...
W20260809 13:08:20.933651 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.303s user 0.001s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:08:21 dist-test-slave-jq4t krb5kdc[29261](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280901, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:08:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:08:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 13:08:21.289419 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46521
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46521
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:08:21.655892 29279 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:21.656229 29279 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:21.656414 29279 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:21.663759 29279 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:08:21.663872 29279 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:21.663918 29279 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:21.664048 29279 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:08:21.664135 29279 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:08:21.674295 29279 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46521
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:21.675696 29279 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:21.677127 29279 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:21.689633 29285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:21.689594 29286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:21.689548 29289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:21.690681 29279 server_base.cc:1034] running on GCE node
I20260809 13:08:21.691556 29279 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:21.693008 29279 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:21.694242 29279 hybrid_clock.cc:648] HybridClock initialized: now 1786280901694196 us; error 42 us; skew 500 ppm
I20260809 13:08:21.694629 29279 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:08:21 dist-test-slave-jq4t krb5kdc[29261](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280901, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:08:21.697952 29279 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 13:08:21.699592 29279 webserver.cc:460] Webserver started at http://127.0.0.1:35719/ using document root <none> and password file <none>
I20260809 13:08:21.700292 29279 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:21.700405 29279 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:21.700767 29279 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:21.703908 29279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "1591c8d2e20347ddb249000bd1f706c0"
format_stamp: "Formatted at 2026-08-09 13:08:21 on dist-test-slave-jq4t"
server_key: "ee3402d2c221f5e81a857d9851ef8ae4"
server_key_iv: "b72b4b01490bb4fd145a9de3b1c47756"
server_key_version: "encryptionkey@0"
I20260809 13:08:21.704804 29279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "1591c8d2e20347ddb249000bd1f706c0"
format_stamp: "Formatted at 2026-08-09 13:08:21 on dist-test-slave-jq4t"
server_key: "ee3402d2c221f5e81a857d9851ef8ae4"
server_key_iv: "b72b4b01490bb4fd145a9de3b1c47756"
server_key_version: "encryptionkey@0"
I20260809 13:08:21.710232 29279 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 13:08:21.713865 29302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:21.715268 29279 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:08:21.715485 29279 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "1591c8d2e20347ddb249000bd1f706c0"
format_stamp: "Formatted at 2026-08-09 13:08:21 on dist-test-slave-jq4t"
server_key: "ee3402d2c221f5e81a857d9851ef8ae4"
server_key_iv: "b72b4b01490bb4fd145a9de3b1c47756"
server_key_version: "encryptionkey@0"
I20260809 13:08:21.715691 29279 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:21.737463 29279 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:21.741727 29279 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:21.742043 29279 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:21.762645 29279 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46521
I20260809 13:08:21.762681 29373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46521 every 8 connection(s)
I20260809 13:08:21.764087 29279 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:08:21.764712 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 29279
I20260809 13:08:21.764921 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:08:21.765620 29295 external_mini_cluster.cc:1428] Setting key c41e28f8e80bdfc230af57b27bc5a0ce
I20260809 13:08:21.769100 29374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:21.782228 29379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:21.767673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40065 (local address 127.0.0.1:46521)
0809 13:08:21.768560 (+ 887us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:21.768576 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:21.768628 (+ 52us) server_negotiation.cc:407] Connection header received
0809 13:08:21.771100 (+ 2472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:21.771129 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:21.771630 (+ 501us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:21.772091 (+ 461us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:21.772643 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:21.774743 (+ 2100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:21.776732 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:21.777809 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:21.778001 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:21.779247 (+ 1246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:21.779257 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:21.779280 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:21.780064 (+ 784us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:21.780164 (+ 100us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:21.780202 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:21.780340 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:21.780580 (+ 240us) server_negotiation.cc:299] Negotiation successful
0809 13:08:21.780863 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":598,"thread_start_us":353,"threads_started":1}
I20260809 13:08:21.783524 29374 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1591c8d2e20347ddb249000bd1f706c0: Bootstrap starting.
I20260809 13:08:21.786268 29295 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 13:08:21.787209 29374 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1591c8d2e20347ddb249000bd1f706c0: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:21.788264 29374 log.cc:824] T 00000000000000000000000000000000 P 1591c8d2e20347ddb249000bd1f706c0: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:21.791986 29374 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1591c8d2e20347ddb249000bd1f706c0: No bootstrap required, opened a new log
I20260809 13:08:21.797478 29379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:21.790974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51287 (local address 127.0.0.1:46521)
0809 13:08:21.791134 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:21.791139 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:21.791677 (+ 538us) server_negotiation.cc:407] Connection header received
0809 13:08:21.791905 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:21.791909 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:21.791974 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:21.792088 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:21.792677 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:21.793447 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:21.794813 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:21.795312 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:21.795465 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:21.796653 (+ 1188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:21.796659 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:21.796664 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:21.796686 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:21.796745 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:21.796766 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:21.796878 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:21.797017 (+ 139us) server_negotiation.cc:299] Negotiation successful
0809 13:08:21.797119 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 13:08:21.800626 29374 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1591c8d2e20347ddb249000bd1f706c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1591c8d2e20347ddb249000bd1f706c0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46521 } }
I20260809 13:08:21.801028 29374 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1591c8d2e20347ddb249000bd1f706c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:08:21.801155 29374 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1591c8d2e20347ddb249000bd1f706c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1591c8d2e20347ddb249000bd1f706c0, State: Initialized, Role: FOLLOWER
I20260809 13:08:21.801740 29374 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1591c8d2e20347ddb249000bd1f706c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1591c8d2e20347ddb249000bd1f706c0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46521 } }
I20260809 13:08:21.802174 29374 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1591c8d2e20347ddb249000bd1f706c0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:08:21.802459 29374 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1591c8d2e20347ddb249000bd1f706c0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:08:21.802692 29374 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1591c8d2e20347ddb249000bd1f706c0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:21.805272 29374 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1591c8d2e20347ddb249000bd1f706c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1591c8d2e20347ddb249000bd1f706c0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46521 } }
I20260809 13:08:21.805758 29374 leader_election.cc:302] T 00000000000000000000000000000000 P 1591c8d2e20347ddb249000bd1f706c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1591c8d2e20347ddb249000bd1f706c0; no voters:
I20260809 13:08:21.806344 29374 leader_election.cc:288] T 00000000000000000000000000000000 P 1591c8d2e20347ddb249000bd1f706c0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:08:21.806514 29393 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1591c8d2e20347ddb249000bd1f706c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:08:21.807341 29393 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1591c8d2e20347ddb249000bd1f706c0 [term 1 LEADER]: Becoming Leader. State: Replica: 1591c8d2e20347ddb249000bd1f706c0, State: Running, Role: LEADER
I20260809 13:08:21.807904 29393 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1591c8d2e20347ddb249000bd1f706c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1591c8d2e20347ddb249000bd1f706c0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46521 } }
I20260809 13:08:21.808743 29374 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1591c8d2e20347ddb249000bd1f706c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:08:21.810796 29396 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1591c8d2e20347ddb249000bd1f706c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1591c8d2e20347ddb249000bd1f706c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1591c8d2e20347ddb249000bd1f706c0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46521 } } }
I20260809 13:08:21.811223 29396 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1591c8d2e20347ddb249000bd1f706c0 [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:21.812938 29403 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:08:21.812800 29397 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1591c8d2e20347ddb249000bd1f706c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1591c8d2e20347ddb249000bd1f706c0. Latest consensus state: current_term: 1 leader_uuid: "1591c8d2e20347ddb249000bd1f706c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1591c8d2e20347ddb249000bd1f706c0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46521 } } }
I20260809 13:08:21.813265 29397 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1591c8d2e20347ddb249000bd1f706c0 [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:21.818617 29403 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:08:21.829182 29403 catalog_manager.cc:1347] Generated new cluster ID: 2a7b74c5869947b2a84fd121cc4f180c
I20260809 13:08:21.829346 29403 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:08:21.844331 29403 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:08:21.845731 29403 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:08:21.855923 29403 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1591c8d2e20347ddb249000bd1f706c0: Generated new TSK 0
I20260809 13:08:21.857180 29403 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 13:08:21.871058 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 29279
W20260809 13:08:21.872593 29365 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:40065
W20260809 13:08:21.873469 29295 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 29279: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 13:08:21.873647 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 29279
2026-08-09T13:08:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2290 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:08:22 dist-test-slave-jq4t krb5kdc[29432](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:08:22 dist-test-slave-jq4t krb5kdc[29432](info): set up 2 sockets
Aug 09 13:08:22 dist-test-slave-jq4t krb5kdc[29432](info): commencing operation
krb5kdc: starting...
W20260809 13:08:23.225214 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.304s user 0.005s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:08:23 dist-test-slave-jq4t krb5kdc[29432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280903, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:08:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:08:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 13:08:23.580101 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34699
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38385
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34699
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:08:23.960269 29448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:23.960703 29448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:23.960903 29448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:23.968518 29448 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:08:23.968662 29448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:23.968756 29448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:23.968878 29448 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:08:23.968945 29448 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:08:23.979543 29448 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38385
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34699
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34699
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:23.981047 29448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:23.982479 29448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:23.994915 29454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:23.995002 29456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:23.995042 29453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:23.995764 29448 server_base.cc:1034] running on GCE node
I20260809 13:08:23.996785 29448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:23.998373 29448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:23.999655 29448 hybrid_clock.cc:648] HybridClock initialized: now 1786280903999610 us; error 44 us; skew 500 ppm
I20260809 13:08:24.000118 29448 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:08:23 dist-test-slave-jq4t krb5kdc[29432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280903, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:08:24.003690 29448 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 13:08:24.005489 29448 webserver.cc:460] Webserver started at http://127.0.0.1:42663/ using document root <none> and password file <none>
I20260809 13:08:24.006263 29448 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:24.006425 29448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:24.006762 29448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:24.010176 29448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "5cca7305458c4d20bc16314fc8a96cb6"
format_stamp: "Formatted at 2026-08-09 13:08:24 on dist-test-slave-jq4t"
server_key: "0a1242b57c75e6a4b089b77d89962cce"
server_key_iv: "e2567450fc7340aee84a7c0b1154aff6"
server_key_version: "encryptionkey@0"
I20260809 13:08:24.011085 29448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "5cca7305458c4d20bc16314fc8a96cb6"
format_stamp: "Formatted at 2026-08-09 13:08:24 on dist-test-slave-jq4t"
server_key: "0a1242b57c75e6a4b089b77d89962cce"
server_key_iv: "e2567450fc7340aee84a7c0b1154aff6"
server_key_version: "encryptionkey@0"
I20260809 13:08:24.016801 29448 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260809 13:08:24.020682 29463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:24.022324 29448 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:08:24.022567 29448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "5cca7305458c4d20bc16314fc8a96cb6"
format_stamp: "Formatted at 2026-08-09 13:08:24 on dist-test-slave-jq4t"
server_key: "0a1242b57c75e6a4b089b77d89962cce"
server_key_iv: "e2567450fc7340aee84a7c0b1154aff6"
server_key_version: "encryptionkey@0"
I20260809 13:08:24.022812 29448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:24.029192 29448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:24.033716 29448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:24.034081 29448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:24.054033 29448 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34699
I20260809 13:08:24.054082 29546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34699 every 8 connection(s)
I20260809 13:08:24.055583 29448 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:08:24.059638 29547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:24.059998 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 29448
I20260809 13:08:24.060200 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:08:24.060848 29295 external_mini_cluster.cc:1428] Setting key 2038689f565fcc8e9aa39d57a3bc06e4
I20260809 13:08:24.070058 29552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:24.062733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53875 (local address 127.0.0.1:34699)
0809 13:08:24.063708 (+ 975us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:24.063719 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:24.063767 (+ 48us) server_negotiation.cc:407] Connection header received
0809 13:08:24.066262 (+ 2495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:24.066289 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:24.066687 (+ 398us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:24.067050 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:24.068324 (+ 1274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:24.068332 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:24.068345 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:24.068359 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:24.068436 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:24.068461 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:24.068710 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:24.068837 (+ 127us) server_negotiation.cc:299] Negotiation successful
0809 13:08:24.069048 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":741,"thread_start_us":488,"threads_started":1}
I20260809 13:08:24.073698 29547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5cca7305458c4d20bc16314fc8a96cb6: Bootstrap starting.
I20260809 13:08:24.073926 29295 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 13:08:24.077878 29547 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5cca7305458c4d20bc16314fc8a96cb6: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:24.079375 29547 log.cc:824] T 00000000000000000000000000000000 P 5cca7305458c4d20bc16314fc8a96cb6: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:24.082202 29552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:24.079704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58723 (local address 127.0.0.1:34699)
0809 13:08:24.079856 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:24.079860 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:24.080284 (+ 424us) server_negotiation.cc:407] Connection header received
0809 13:08:24.080415 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:24.080422 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:24.080521 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:24.080647 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:24.081534 (+ 887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:24.081538 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:24.081541 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:24.081556 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:24.081594 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:24.081609 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:24.081697 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:24.081843 (+ 146us) server_negotiation.cc:299] Negotiation successful
0809 13:08:24.081891 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 13:08:24.083043 29547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5cca7305458c4d20bc16314fc8a96cb6: No bootstrap required, opened a new log
I20260809 13:08:24.090662 29547 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5cca7305458c4d20bc16314fc8a96cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cca7305458c4d20bc16314fc8a96cb6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34699 } }
I20260809 13:08:24.091135 29547 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5cca7305458c4d20bc16314fc8a96cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:08:24.091267 29547 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5cca7305458c4d20bc16314fc8a96cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cca7305458c4d20bc16314fc8a96cb6, State: Initialized, Role: FOLLOWER
I20260809 13:08:24.091967 29547 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5cca7305458c4d20bc16314fc8a96cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cca7305458c4d20bc16314fc8a96cb6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34699 } }
I20260809 13:08:24.092250 29547 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5cca7305458c4d20bc16314fc8a96cb6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:08:24.092412 29547 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5cca7305458c4d20bc16314fc8a96cb6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:08:24.092646 29547 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5cca7305458c4d20bc16314fc8a96cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:24.094954 29547 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5cca7305458c4d20bc16314fc8a96cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cca7305458c4d20bc16314fc8a96cb6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34699 } }
I20260809 13:08:24.095516 29547 leader_election.cc:302] T 00000000000000000000000000000000 P 5cca7305458c4d20bc16314fc8a96cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5cca7305458c4d20bc16314fc8a96cb6; no voters:
I20260809 13:08:24.096251 29547 leader_election.cc:288] T 00000000000000000000000000000000 P 5cca7305458c4d20bc16314fc8a96cb6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:08:24.096357 29563 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5cca7305458c4d20bc16314fc8a96cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:08:24.097343 29563 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5cca7305458c4d20bc16314fc8a96cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 5cca7305458c4d20bc16314fc8a96cb6, State: Running, Role: LEADER
I20260809 13:08:24.098014 29563 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5cca7305458c4d20bc16314fc8a96cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cca7305458c4d20bc16314fc8a96cb6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34699 } }
I20260809 13:08:24.099077 29547 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5cca7305458c4d20bc16314fc8a96cb6 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:08:24.101369 29566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5cca7305458c4d20bc16314fc8a96cb6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5cca7305458c4d20bc16314fc8a96cb6. Latest consensus state: current_term: 1 leader_uuid: "5cca7305458c4d20bc16314fc8a96cb6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cca7305458c4d20bc16314fc8a96cb6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34699 } } }
I20260809 13:08:24.101854 29566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5cca7305458c4d20bc16314fc8a96cb6 [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:24.102653 29564 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5cca7305458c4d20bc16314fc8a96cb6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5cca7305458c4d20bc16314fc8a96cb6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cca7305458c4d20bc16314fc8a96cb6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34699 } } }
I20260809 13:08:24.102981 29576 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:08:24.103065 29564 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5cca7305458c4d20bc16314fc8a96cb6 [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:24.112227 29576 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:08:24.121588 29576 catalog_manager.cc:1347] Generated new cluster ID: 6f208886004c4ece9eb37032d030c777
I20260809 13:08:24.121732 29576 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:08:24.142216 29576 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:08:24.142725 29576 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:08:24.154143 29576 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5cca7305458c4d20bc16314fc8a96cb6: Generated new TSK 0
I20260809 13:08:24.155257 29576 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 13:08:24.173399 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 29448
W20260809 13:08:24.174609 29542 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:53875
W20260809 13:08:24.175357 29295 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 29448: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 13:08:24.175526 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 29448
2026-08-09T13:08:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2300 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:08:24 dist-test-slave-jq4t krb5kdc[29601](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:08:24 dist-test-slave-jq4t krb5kdc[29601](info): set up 2 sockets
Aug 09 13:08:24 dist-test-slave-jq4t krb5kdc[29601](info): commencing operation
krb5kdc: starting...
W20260809 13:08:25.539940 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.317s user 0.003s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:08:25 dist-test-slave-jq4t krb5kdc[29601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280905, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:08:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:08:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 13:08:25.892081 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39807
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39807
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:08:26.259471 29621 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:26.259865 29621 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:26.260039 29621 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:26.267539 29621 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:08:26.267720 29621 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:26.267835 29621 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:26.267938 29621 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:08:26.268009 29621 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:08:26.278278 29621 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39807
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:26.279857 29621 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:26.281318 29621 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:26.294189 29629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:26.294235 29631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:26.294126 29627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:26.295090 29621 server_base.cc:1034] running on GCE node
I20260809 13:08:26.295943 29621 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:26.297633 29621 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:26.298893 29621 hybrid_clock.cc:648] HybridClock initialized: now 1786280906298832 us; error 72 us; skew 500 ppm
I20260809 13:08:26.299274 29621 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:08:26 dist-test-slave-jq4t krb5kdc[29601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280906, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:08:26.307024 29621 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 13:08:26.308845 29621 webserver.cc:460] Webserver started at http://127.0.0.1:43203/ using document root <none> and password file <none>
I20260809 13:08:26.309690 29621 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:26.309868 29621 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:26.310245 29621 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:26.313819 29621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "a148074906964ac2902d21e1b4b2ca5c"
format_stamp: "Formatted at 2026-08-09 13:08:26 on dist-test-slave-jq4t"
server_key: "491ba6b398351fa777ba4311b5ce7e32"
server_key_iv: "1d22a42d2cee54f4f82d7c30fd3aa196"
server_key_version: "encryptionkey@0"
I20260809 13:08:26.314729 29621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "a148074906964ac2902d21e1b4b2ca5c"
format_stamp: "Formatted at 2026-08-09 13:08:26 on dist-test-slave-jq4t"
server_key: "491ba6b398351fa777ba4311b5ce7e32"
server_key_iv: "1d22a42d2cee54f4f82d7c30fd3aa196"
server_key_version: "encryptionkey@0"
I20260809 13:08:26.320781 29621 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260809 13:08:26.324764 29645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:26.326238 29621 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:08:26.326493 29621 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "a148074906964ac2902d21e1b4b2ca5c"
format_stamp: "Formatted at 2026-08-09 13:08:26 on dist-test-slave-jq4t"
server_key: "491ba6b398351fa777ba4311b5ce7e32"
server_key_iv: "1d22a42d2cee54f4f82d7c30fd3aa196"
server_key_version: "encryptionkey@0"
I20260809 13:08:26.326743 29621 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:26.343678 29621 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:26.348029 29621 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:26.348349 29621 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:26.369218 29621 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39807
I20260809 13:08:26.369282 29724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39807 every 8 connection(s)
I20260809 13:08:26.371603 29621 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:08:26.377408 29726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:26.377497 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 29621
I20260809 13:08:26.377725 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:08:26.378516 29295 external_mini_cluster.cc:1428] Setting key 63318c99b21f358d5d90693b9fe45418
I20260809 13:08:26.396203 29726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a148074906964ac2902d21e1b4b2ca5c: Bootstrap starting.
I20260809 13:08:26.399662 29726 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a148074906964ac2902d21e1b4b2ca5c: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:26.400871 29726 log.cc:824] T 00000000000000000000000000000000 P a148074906964ac2902d21e1b4b2ca5c: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:26.404829 29726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a148074906964ac2902d21e1b4b2ca5c: No bootstrap required, opened a new log
Aug 09 13:08:26 dist-test-slave-jq4t krb5kdc[29601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280905, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 13:08:26.416298 29726 raft_consensus.cc:348] T 00000000000000000000000000000000 P a148074906964ac2902d21e1b4b2ca5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a148074906964ac2902d21e1b4b2ca5c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39807 } }
I20260809 13:08:26.416899 29726 raft_consensus.cc:374] T 00000000000000000000000000000000 P a148074906964ac2902d21e1b4b2ca5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:08:26.417030 29726 raft_consensus.cc:729] T 00000000000000000000000000000000 P a148074906964ac2902d21e1b4b2ca5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a148074906964ac2902d21e1b4b2ca5c, State: Initialized, Role: FOLLOWER
I20260809 13:08:26.417748 29733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:26.381048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:36217 (local address 127.0.0.1:39807)
0809 13:08:26.382043 (+ 995us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:26.382071 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:26.393187 (+ 11116us) server_negotiation.cc:407] Connection header received
0809 13:08:26.395373 (+ 2186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:26.395402 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:26.395881 (+ 479us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:26.396330 (+ 449us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:26.397987 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:26.399343 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:26.400833 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:26.401900 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:26.402134 (+ 234us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:26.407364 (+ 5230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:26.407381 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:26.407403 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:26.407456 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:26.411978 (+ 4522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:26.413070 (+ 1092us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:26.413081 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:26.413091 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:26.413338 (+ 247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:26.413934 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:26.413939 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:26.413944 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:26.414856 (+ 912us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:26.415232 (+ 376us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:26.415742 (+ 510us) server_negotiation.cc:299] Negotiation successful
0809 13:08:26.416157 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":696,"thread_start_us":414,"threads_started":1}
I20260809 13:08:26.417812 29726 consensus_queue.cc:260] T 00000000000000000000000000000000 P a148074906964ac2902d21e1b4b2ca5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a148074906964ac2902d21e1b4b2ca5c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39807 } }
I20260809 13:08:26.418233 29726 raft_consensus.cc:388] T 00000000000000000000000000000000 P a148074906964ac2902d21e1b4b2ca5c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:08:26.418417 29726 raft_consensus.cc:482] T 00000000000000000000000000000000 P a148074906964ac2902d21e1b4b2ca5c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:08:26.418646 29726 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a148074906964ac2902d21e1b4b2ca5c [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:26.422089 29726 raft_consensus.cc:504] T 00000000000000000000000000000000 P a148074906964ac2902d21e1b4b2ca5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a148074906964ac2902d21e1b4b2ca5c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39807 } }
I20260809 13:08:26.422729 29726 leader_election.cc:302] T 00000000000000000000000000000000 P a148074906964ac2902d21e1b4b2ca5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a148074906964ac2902d21e1b4b2ca5c; no voters:
I20260809 13:08:26.422878 29295 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 13:08:26.423483 29726 leader_election.cc:288] T 00000000000000000000000000000000 P a148074906964ac2902d21e1b4b2ca5c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:08:26.423631 29735 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a148074906964ac2902d21e1b4b2ca5c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:08:26.425148 29735 raft_consensus.cc:686] T 00000000000000000000000000000000 P a148074906964ac2902d21e1b4b2ca5c [term 1 LEADER]: Becoming Leader. State: Replica: a148074906964ac2902d21e1b4b2ca5c, State: Running, Role: LEADER
I20260809 13:08:26.425765 29735 consensus_queue.cc:237] T 00000000000000000000000000000000 P a148074906964ac2902d21e1b4b2ca5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a148074906964ac2902d21e1b4b2ca5c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39807 } }
I20260809 13:08:26.425949 29726 sys_catalog.cc:564] T 00000000000000000000000000000000 P a148074906964ac2902d21e1b4b2ca5c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:08:26.429391 29737 sys_catalog.cc:455] T 00000000000000000000000000000000 P a148074906964ac2902d21e1b4b2ca5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a148074906964ac2902d21e1b4b2ca5c. Latest consensus state: current_term: 1 leader_uuid: "a148074906964ac2902d21e1b4b2ca5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a148074906964ac2902d21e1b4b2ca5c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39807 } } }
I20260809 13:08:26.429932 29736 sys_catalog.cc:455] T 00000000000000000000000000000000 P a148074906964ac2902d21e1b4b2ca5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a148074906964ac2902d21e1b4b2ca5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a148074906964ac2902d21e1b4b2ca5c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39807 } } }
I20260809 13:08:26.430285 29736 sys_catalog.cc:458] T 00000000000000000000000000000000 P a148074906964ac2902d21e1b4b2ca5c [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:26.430763 29737 sys_catalog.cc:458] T 00000000000000000000000000000000 P a148074906964ac2902d21e1b4b2ca5c [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:26.433485 29745 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:08:26.441810 29745 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:08:26.456079 29733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:26.435512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:50363 (local address 127.0.0.1:39807)
0809 13:08:26.435759 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:26.435769 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:26.436823 (+ 1054us) server_negotiation.cc:407] Connection header received
0809 13:08:26.437210 (+ 387us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:26.437219 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:26.437330 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:26.437414 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:26.439799 (+ 2385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:26.441148 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:26.443184 (+ 2036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:26.443914 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:26.444110 (+ 196us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:26.447759 (+ 3649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:26.447766 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:26.447772 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:26.447814 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:26.451897 (+ 4083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:26.453106 (+ 1209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:26.453112 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:26.453115 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:26.453278 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:26.453943 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:26.453950 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:26.453953 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:26.454408 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:26.454677 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:26.455437 (+ 760us) server_negotiation.cc:299] Negotiation successful
0809 13:08:26.455644 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":44}
I20260809 13:08:26.460259 29745 catalog_manager.cc:1347] Generated new cluster ID: 7f63f03489a5433abcbff148590d839d
I20260809 13:08:26.460505 29745 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:08:26.488793 29745 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:08:26.490226 29745 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:08:26.502733 29745 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a148074906964ac2902d21e1b4b2ca5c: Generated new TSK 0
I20260809 13:08:26.503647 29745 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 13:08:26.517477 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 29621
I20260809 13:08:26.519369 29719 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:08:26.617312 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 29621
W20260809 13:08:26.645221 29598 connection.cc:535] client connection to 127.0.0.1:39807 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39807): Connection reset by peer (error 104)
2026-08-09T13:08:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2442 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:08:26 dist-test-slave-jq4t krb5kdc[29771](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:08:26 dist-test-slave-jq4t krb5kdc[29771](info): set up 2 sockets
Aug 09 13:08:26 dist-test-slave-jq4t krb5kdc[29771](info): commencing operation
krb5kdc: starting...
W20260809 13:08:27.978291 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.313s user 0.004s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:08:28 dist-test-slave-jq4t krb5kdc[29771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280908, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:08:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:08:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 13:08:28.335860 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42053
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42053
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:08:28.706079 29793 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:28.706399 29793 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:28.706585 29793 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:28.714042 29793 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:08:28.714162 29793 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:28.714264 29793 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:28.714385 29793 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:08:28.714473 29793 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:08:28.724728 29793 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42053
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42053
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:28.726194 29793 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:28.727631 29793 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:28.740693 29803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:28.740618 29806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:28.740662 29804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:28.742142 29793 server_base.cc:1034] running on GCE node
I20260809 13:08:28.743000 29793 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:28.744619 29793 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:28.745834 29793 hybrid_clock.cc:648] HybridClock initialized: now 1786280908745793 us; error 32 us; skew 500 ppm
I20260809 13:08:28.746171 29793 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:08:28 dist-test-slave-jq4t krb5kdc[29771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280908, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:08:28.749509 29793 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 13:08:28.751178 29793 webserver.cc:460] Webserver started at http://127.0.0.1:45605/ using document root <none> and password file <none>
I20260809 13:08:28.751875 29793 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:28.751986 29793 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:28.752255 29793 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:28.755463 29793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "6f3ebaee5f0a4c7a87e6f73adb24ae8e"
format_stamp: "Formatted at 2026-08-09 13:08:28 on dist-test-slave-jq4t"
server_key: "ee113ed2b76be4d7621507b6fee16b4f"
server_key_iv: "783722ecfd720cae35aa290265e9b3ef"
server_key_version: "encryptionkey@0"
I20260809 13:08:28.756237 29793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "6f3ebaee5f0a4c7a87e6f73adb24ae8e"
format_stamp: "Formatted at 2026-08-09 13:08:28 on dist-test-slave-jq4t"
server_key: "ee113ed2b76be4d7621507b6fee16b4f"
server_key_iv: "783722ecfd720cae35aa290265e9b3ef"
server_key_version: "encryptionkey@0"
I20260809 13:08:28.761924 29793 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260809 13:08:28.765723 29822 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:28.767342 29793 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:08:28.767524 29793 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "6f3ebaee5f0a4c7a87e6f73adb24ae8e"
format_stamp: "Formatted at 2026-08-09 13:08:28 on dist-test-slave-jq4t"
server_key: "ee113ed2b76be4d7621507b6fee16b4f"
server_key_iv: "783722ecfd720cae35aa290265e9b3ef"
server_key_version: "encryptionkey@0"
I20260809 13:08:28.767714 29793 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:28.785451 29793 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:28.790470 29793 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:28.790735 29793 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:28.810774 29793 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42053
I20260809 13:08:28.810832 29896 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42053 every 8 connection(s)
I20260809 13:08:28.812283 29793 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:08:28.816319 29897 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:28.822121 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 29793
I20260809 13:08:28.822311 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:08:28.822870 29295 external_mini_cluster.cc:1428] Setting key c43b14f89d41cefd483f2d9cd4cb4165
I20260809 13:08:28.828254 29897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f3ebaee5f0a4c7a87e6f73adb24ae8e: Bootstrap starting.
I20260809 13:08:28.831585 29897 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f3ebaee5f0a4c7a87e6f73adb24ae8e: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:28.832762 29897 log.cc:824] T 00000000000000000000000000000000 P 6f3ebaee5f0a4c7a87e6f73adb24ae8e: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:28.836109 29897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f3ebaee5f0a4c7a87e6f73adb24ae8e: No bootstrap required, opened a new log
I20260809 13:08:28.837064 29906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:28.824985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:58227 (local address 127.0.0.1:42053)
0809 13:08:28.825933 (+ 948us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:28.825948 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:28.825998 (+ 50us) server_negotiation.cc:407] Connection header received
0809 13:08:28.827749 (+ 1751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:28.827772 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:28.828175 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:28.828577 (+ 402us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:28.829145 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:28.830513 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:28.831940 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:28.832677 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:28.832886 (+ 209us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:28.834209 (+ 1323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:28.834217 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:28.834231 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:28.834889 (+ 658us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:28.835002 (+ 113us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:28.835041 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:28.835216 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:28.835799 (+ 583us) server_negotiation.cc:299] Negotiation successful
0809 13:08:28.835953 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":661,"thread_start_us":401,"threads_started":1}
I20260809 13:08:28.841077 29295 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 13:08:28.844802 29897 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f3ebaee5f0a4c7a87e6f73adb24ae8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f3ebaee5f0a4c7a87e6f73adb24ae8e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42053 } }
I20260809 13:08:28.845207 29897 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6f3ebaee5f0a4c7a87e6f73adb24ae8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:08:28.845330 29897 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f3ebaee5f0a4c7a87e6f73adb24ae8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3ebaee5f0a4c7a87e6f73adb24ae8e, State: Initialized, Role: FOLLOWER
I20260809 13:08:28.846279 29897 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f3ebaee5f0a4c7a87e6f73adb24ae8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f3ebaee5f0a4c7a87e6f73adb24ae8e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42053 } }
I20260809 13:08:28.846618 29897 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6f3ebaee5f0a4c7a87e6f73adb24ae8e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:08:28.846813 29897 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6f3ebaee5f0a4c7a87e6f73adb24ae8e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:08:28.847014 29897 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f3ebaee5f0a4c7a87e6f73adb24ae8e [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:28.850016 29897 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6f3ebaee5f0a4c7a87e6f73adb24ae8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f3ebaee5f0a4c7a87e6f73adb24ae8e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42053 } }
I20260809 13:08:28.850665 29897 leader_election.cc:302] T 00000000000000000000000000000000 P 6f3ebaee5f0a4c7a87e6f73adb24ae8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6f3ebaee5f0a4c7a87e6f73adb24ae8e; no voters:
I20260809 13:08:28.851447 29897 leader_election.cc:288] T 00000000000000000000000000000000 P 6f3ebaee5f0a4c7a87e6f73adb24ae8e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:08:28.851552 29916 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6f3ebaee5f0a4c7a87e6f73adb24ae8e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:08:28.852993 29916 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6f3ebaee5f0a4c7a87e6f73adb24ae8e [term 1 LEADER]: Becoming Leader. State: Replica: 6f3ebaee5f0a4c7a87e6f73adb24ae8e, State: Running, Role: LEADER
I20260809 13:08:28.853276 29906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:28.845648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:51657 (local address 127.0.0.1:42053)
0809 13:08:28.845811 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:28.845817 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:28.846281 (+ 464us) server_negotiation.cc:407] Connection header received
0809 13:08:28.846429 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:28.846436 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:28.846521 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:28.846658 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:28.847234 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:28.848455 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:28.849859 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:28.850565 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:28.850712 (+ 147us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:28.852133 (+ 1421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:28.852139 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:28.852146 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:28.852177 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:28.852264 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:28.852292 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:28.852384 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:28.852774 (+ 390us) server_negotiation.cc:299] Negotiation successful
0809 13:08:28.852837 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 13:08:28.853699 29916 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f3ebaee5f0a4c7a87e6f73adb24ae8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f3ebaee5f0a4c7a87e6f73adb24ae8e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42053 } }
I20260809 13:08:28.854307 29897 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f3ebaee5f0a4c7a87e6f73adb24ae8e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:08:28.856722 29917 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f3ebaee5f0a4c7a87e6f73adb24ae8e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6f3ebaee5f0a4c7a87e6f73adb24ae8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f3ebaee5f0a4c7a87e6f73adb24ae8e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42053 } } }
I20260809 13:08:28.857124 29917 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f3ebaee5f0a4c7a87e6f73adb24ae8e [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:28.860905 29918 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f3ebaee5f0a4c7a87e6f73adb24ae8e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f3ebaee5f0a4c7a87e6f73adb24ae8e. Latest consensus state: current_term: 1 leader_uuid: "6f3ebaee5f0a4c7a87e6f73adb24ae8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f3ebaee5f0a4c7a87e6f73adb24ae8e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42053 } } }
I20260809 13:08:28.861356 29918 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f3ebaee5f0a4c7a87e6f73adb24ae8e [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:28.861670 29928 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:08:28.867761 29928 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:08:28.879864 29928 catalog_manager.cc:1347] Generated new cluster ID: f76f5292a21e48ba82c66f2848dec756
I20260809 13:08:28.879995 29928 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:08:28.915532 29928 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:08:28.917061 29928 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:08:28.924512 29928 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6f3ebaee5f0a4c7a87e6f73adb24ae8e: Generated new TSK 0
I20260809 13:08:28.925408 29928 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 13:08:28.943475 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 29793
W20260809 13:08:28.944775 29891 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.48:58227
W20260809 13:08:28.945793 29295 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 29793: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 13:08:28.946000 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 29793
W20260809 13:08:28.974589 29768 connection.cc:535] client connection to 127.0.0.1:42053 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42053): Connection reset by peer (error 104)
2026-08-09T13:08:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2329 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:08:29 dist-test-slave-jq4t krb5kdc[29945](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:08:29 dist-test-slave-jq4t krb5kdc[29945](info): set up 2 sockets
Aug 09 13:08:29 dist-test-slave-jq4t krb5kdc[29945](info): commencing operation
krb5kdc: starting...
W20260809 13:08:30.316603 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.322s user 0.001s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:08:30 dist-test-slave-jq4t krb5kdc[29945](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280910, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:08:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:08:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 13:08:30.673108 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35635
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35635
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:08:31.041920 29967 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:31.042327 29967 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:31.042503 29967 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:31.050303 29967 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:08:31.050491 29967 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:31.050614 29967 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:31.050732 29967 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:08:31.050817 29967 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:08:31.061689 29967 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35635
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35635
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:31.063243 29967 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:31.064738 29967 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:31.078258 29977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:31.078140 29978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:31.078382 29983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:31.079304 29967 server_base.cc:1034] running on GCE node
I20260809 13:08:31.080214 29967 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:31.081884 29967 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:31.083124 29967 hybrid_clock.cc:648] HybridClock initialized: now 1786280911083073 us; error 56 us; skew 500 ppm
I20260809 13:08:31.083485 29967 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:08:31 dist-test-slave-jq4t krb5kdc[29945](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280911, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:08:31.086836 29967 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 13:08:31.088609 29967 webserver.cc:460] Webserver started at http://127.0.0.1:34441/ using document root <none> and password file <none>
I20260809 13:08:31.089347 29967 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:31.089507 29967 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:31.089850 29967 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:31.093225 29967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "0d2c65065d774d6ab0fae2eefc254c55"
format_stamp: "Formatted at 2026-08-09 13:08:31 on dist-test-slave-jq4t"
server_key: "0d0c233eea3cd39c49a75178ce5a324a"
server_key_iv: "8f3bf50200772f2660e9c0c2d4e94167"
server_key_version: "encryptionkey@0"
I20260809 13:08:31.094084 29967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "0d2c65065d774d6ab0fae2eefc254c55"
format_stamp: "Formatted at 2026-08-09 13:08:31 on dist-test-slave-jq4t"
server_key: "0d0c233eea3cd39c49a75178ce5a324a"
server_key_iv: "8f3bf50200772f2660e9c0c2d4e94167"
server_key_version: "encryptionkey@0"
I20260809 13:08:31.099753 29967 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260809 13:08:31.103575 29991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:31.105111 29967 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:08:31.105325 29967 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "0d2c65065d774d6ab0fae2eefc254c55"
format_stamp: "Formatted at 2026-08-09 13:08:31 on dist-test-slave-jq4t"
server_key: "0d0c233eea3cd39c49a75178ce5a324a"
server_key_iv: "8f3bf50200772f2660e9c0c2d4e94167"
server_key_version: "encryptionkey@0"
I20260809 13:08:31.105562 29967 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:31.111816 29967 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:31.116065 29967 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:31.116387 29967 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:31.136897 29967 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35635
I20260809 13:08:31.136996 30085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35635 every 8 connection(s)
I20260809 13:08:31.138437 29967 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:08:31.142478 30086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:31.148078 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 29967
I20260809 13:08:31.148303 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:08:31.148819 29295 external_mini_cluster.cc:1428] Setting key 27260914c016f9b6638d7b52e4701860
I20260809 13:08:31.155728 30086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d2c65065d774d6ab0fae2eefc254c55: Bootstrap starting.
I20260809 13:08:31.158901 30091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:31.151058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:57605 (local address 127.0.0.1:35635)
0809 13:08:31.151979 (+ 921us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:31.151999 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:31.152053 (+ 54us) server_negotiation.cc:407] Connection header received
0809 13:08:31.154626 (+ 2573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:31.154655 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:31.155128 (+ 473us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:31.155611 (+ 483us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:31.156802 (+ 1191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:31.156810 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:31.156831 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:31.156859 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:31.156932 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:31.156959 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:31.157188 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:31.157335 (+ 147us) server_negotiation.cc:299] Negotiation successful
0809 13:08:31.157554 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":384,"threads_started":1}
I20260809 13:08:31.160041 30086 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0d2c65065d774d6ab0fae2eefc254c55: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:31.161578 30086 log.cc:824] T 00000000000000000000000000000000 P 0d2c65065d774d6ab0fae2eefc254c55: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:31.163949 29295 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 13:08:31.165387 30086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d2c65065d774d6ab0fae2eefc254c55: No bootstrap required, opened a new log
I20260809 13:08:31.172381 30091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:31.169718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:36751 (local address 127.0.0.1:35635)
0809 13:08:31.169938 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:31.169945 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:31.170285 (+ 340us) server_negotiation.cc:407] Connection header received
0809 13:08:31.170436 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:31.170441 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:31.170508 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:31.170627 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:31.171637 (+ 1010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:31.171647 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:31.171653 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:31.171674 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:31.171731 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:31.171750 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:31.171871 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:31.171985 (+ 114us) server_negotiation.cc:299] Negotiation successful
0809 13:08:31.172050 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 13:08:31.175989 30086 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0d2c65065d774d6ab0fae2eefc254c55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d2c65065d774d6ab0fae2eefc254c55" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35635 } }
I20260809 13:08:31.176368 30086 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0d2c65065d774d6ab0fae2eefc254c55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:08:31.176458 30086 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0d2c65065d774d6ab0fae2eefc254c55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d2c65065d774d6ab0fae2eefc254c55, State: Initialized, Role: FOLLOWER
I20260809 13:08:31.177138 30086 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0d2c65065d774d6ab0fae2eefc254c55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d2c65065d774d6ab0fae2eefc254c55" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35635 } }
I20260809 13:08:31.177400 30086 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0d2c65065d774d6ab0fae2eefc254c55 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:08:31.177587 30086 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0d2c65065d774d6ab0fae2eefc254c55 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:08:31.177815 30086 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0d2c65065d774d6ab0fae2eefc254c55 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:31.180189 30086 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0d2c65065d774d6ab0fae2eefc254c55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d2c65065d774d6ab0fae2eefc254c55" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35635 } }
I20260809 13:08:31.180725 30086 leader_election.cc:302] T 00000000000000000000000000000000 P 0d2c65065d774d6ab0fae2eefc254c55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0d2c65065d774d6ab0fae2eefc254c55; no voters:
I20260809 13:08:31.181295 30086 leader_election.cc:288] T 00000000000000000000000000000000 P 0d2c65065d774d6ab0fae2eefc254c55 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:08:31.181456 30099 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0d2c65065d774d6ab0fae2eefc254c55 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:08:31.182250 30099 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0d2c65065d774d6ab0fae2eefc254c55 [term 1 LEADER]: Becoming Leader. State: Replica: 0d2c65065d774d6ab0fae2eefc254c55, State: Running, Role: LEADER
I20260809 13:08:31.182915 30099 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0d2c65065d774d6ab0fae2eefc254c55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d2c65065d774d6ab0fae2eefc254c55" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35635 } }
I20260809 13:08:31.183714 30086 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0d2c65065d774d6ab0fae2eefc254c55 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:08:31.185915 30101 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d2c65065d774d6ab0fae2eefc254c55 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0d2c65065d774d6ab0fae2eefc254c55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d2c65065d774d6ab0fae2eefc254c55" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35635 } } }
I20260809 13:08:31.186429 30101 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d2c65065d774d6ab0fae2eefc254c55 [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:31.186931 30102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d2c65065d774d6ab0fae2eefc254c55 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0d2c65065d774d6ab0fae2eefc254c55. Latest consensus state: current_term: 1 leader_uuid: "0d2c65065d774d6ab0fae2eefc254c55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d2c65065d774d6ab0fae2eefc254c55" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35635 } } }
I20260809 13:08:31.189354 30102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d2c65065d774d6ab0fae2eefc254c55 [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:31.197005 30114 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:08:31.201929 30114 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:08:31.211756 30114 catalog_manager.cc:1347] Generated new cluster ID: c1a54cd2eb774b55b5fecc003fa9f62d
I20260809 13:08:31.211910 30114 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:08:31.225189 30114 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:08:31.225765 30114 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:08:31.237800 30114 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0d2c65065d774d6ab0fae2eefc254c55: Generated new TSK 0
I20260809 13:08:31.238783 30114 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 13:08:31.243244 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 29967
W20260809 13:08:31.244554 30076 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.48:57605
W20260809 13:08:31.245344 29295 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 29967: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 13:08:31.245515 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 29967
2026-08-09T13:08:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2300 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:08:31 dist-test-slave-jq4t krb5kdc[30130](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:08:31 dist-test-slave-jq4t krb5kdc[30130](info): set up 2 sockets
Aug 09 13:08:31 dist-test-slave-jq4t krb5kdc[30130](info): commencing operation
krb5kdc: starting...
W20260809 13:08:32.646895 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.351s user 0.001s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:08:32 dist-test-slave-jq4t krb5kdc[30130](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280912, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:08:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:08:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 13:08:33.000914 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45649
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45649
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:08:33.369310 30151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:33.369701 30151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:33.369891 30151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:33.377575 30151 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:08:33.377750 30151 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:33.377856 30151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:33.377974 30151 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:08:33.378053 30151 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:08:33.390880 30151 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45649
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45649
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:33.392422 30151 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:33.393934 30151 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:33.408049 30158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:33.408069 30159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:33.408689 30151 server_base.cc:1034] running on GCE node
W20260809 13:08:33.409034 30162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:33.409919 30151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:33.411583 30151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:33.412847 30151 hybrid_clock.cc:648] HybridClock initialized: now 1786280913412783 us; error 83 us; skew 500 ppm
I20260809 13:08:33.413291 30151 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:08:33 dist-test-slave-jq4t krb5kdc[30130](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280913, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:08:33.417006 30151 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 13:08:33.418797 30151 webserver.cc:460] Webserver started at http://127.0.0.1:43395/ using document root <none> and password file <none>
I20260809 13:08:33.419605 30151 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:33.419788 30151 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:33.420149 30151 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:33.423558 30151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "dfa8ecb72ba1493e827e3890e261678e"
format_stamp: "Formatted at 2026-08-09 13:08:33 on dist-test-slave-jq4t"
server_key: "5b53baa8d3e920f437a8501c127772cc"
server_key_iv: "1cab40f711c4f0b807080c223f410b90"
server_key_version: "encryptionkey@0"
I20260809 13:08:33.424464 30151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "dfa8ecb72ba1493e827e3890e261678e"
format_stamp: "Formatted at 2026-08-09 13:08:33 on dist-test-slave-jq4t"
server_key: "5b53baa8d3e920f437a8501c127772cc"
server_key_iv: "1cab40f711c4f0b807080c223f410b90"
server_key_version: "encryptionkey@0"
I20260809 13:08:33.430429 30151 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 13:08:33.434276 30171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:33.435735 30151 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 13:08:33.435969 30151 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "dfa8ecb72ba1493e827e3890e261678e"
format_stamp: "Formatted at 2026-08-09 13:08:33 on dist-test-slave-jq4t"
server_key: "5b53baa8d3e920f437a8501c127772cc"
server_key_iv: "1cab40f711c4f0b807080c223f410b90"
server_key_version: "encryptionkey@0"
I20260809 13:08:33.436214 30151 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:33.467248 30151 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:33.471637 30151 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:33.471992 30151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:33.492547 30151 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45649
I20260809 13:08:33.492647 30248 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45649 every 8 connection(s)
I20260809 13:08:33.494189 30151 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:08:33.497884 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 30151
I20260809 13:08:33.498085 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:08:33.498549 30249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:33.498700 29295 external_mini_cluster.cc:1428] Setting key 71799082f9c30ade1d827a36385d58e6
I20260809 13:08:33.511713 30249 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfa8ecb72ba1493e827e3890e261678e: Bootstrap starting.
Aug 09 13:08:33 dist-test-slave-jq4t krb5kdc[30130](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280912, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 13:08:33.515820 30249 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dfa8ecb72ba1493e827e3890e261678e: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:33.517227 30249 log.cc:824] T 00000000000000000000000000000000 P dfa8ecb72ba1493e827e3890e261678e: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:33.521100 30249 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfa8ecb72ba1493e827e3890e261678e: No bootstrap required, opened a new log
I20260809 13:08:33.523520 30253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:33.500751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:48455 (local address 127.0.0.1:45649)
0809 13:08:33.501610 (+ 859us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:33.501623 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:33.501666 (+ 43us) server_negotiation.cc:407] Connection header received
0809 13:08:33.503608 (+ 1942us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:33.503631 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:33.504024 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:33.504452 (+ 428us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:33.506064 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:33.507370 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:33.508732 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:33.509456 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:33.509723 (+ 267us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:33.514854 (+ 5131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:33.514864 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:33.514878 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:33.514925 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:33.518815 (+ 3890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:33.519927 (+ 1112us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:33.519934 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:33.519940 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:33.520120 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:33.520692 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:33.520695 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:33.520697 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:33.521292 (+ 595us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:33.521567 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:33.522108 (+ 541us) server_negotiation.cc:299] Negotiation successful
0809 13:08:33.522414 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":636,"thread_start_us":363,"threads_started":1}
I20260809 13:08:33.527714 29295 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 13:08:33.530794 30249 raft_consensus.cc:348] T 00000000000000000000000000000000 P dfa8ecb72ba1493e827e3890e261678e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfa8ecb72ba1493e827e3890e261678e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45649 } }
I20260809 13:08:33.531376 30249 raft_consensus.cc:374] T 00000000000000000000000000000000 P dfa8ecb72ba1493e827e3890e261678e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:08:33.531510 30249 raft_consensus.cc:729] T 00000000000000000000000000000000 P dfa8ecb72ba1493e827e3890e261678e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfa8ecb72ba1493e827e3890e261678e, State: Initialized, Role: FOLLOWER
I20260809 13:08:33.532338 30249 consensus_queue.cc:260] T 00000000000000000000000000000000 P dfa8ecb72ba1493e827e3890e261678e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfa8ecb72ba1493e827e3890e261678e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45649 } }
I20260809 13:08:33.532712 30249 raft_consensus.cc:388] T 00000000000000000000000000000000 P dfa8ecb72ba1493e827e3890e261678e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:08:33.532871 30249 raft_consensus.cc:482] T 00000000000000000000000000000000 P dfa8ecb72ba1493e827e3890e261678e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:08:33.533051 30249 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dfa8ecb72ba1493e827e3890e261678e [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:33.536541 30249 raft_consensus.cc:504] T 00000000000000000000000000000000 P dfa8ecb72ba1493e827e3890e261678e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfa8ecb72ba1493e827e3890e261678e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45649 } }
I20260809 13:08:33.537218 30249 leader_election.cc:302] T 00000000000000000000000000000000 P dfa8ecb72ba1493e827e3890e261678e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dfa8ecb72ba1493e827e3890e261678e; no voters:
I20260809 13:08:33.537863 30249 leader_election.cc:288] T 00000000000000000000000000000000 P dfa8ecb72ba1493e827e3890e261678e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:08:33.538034 30267 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dfa8ecb72ba1493e827e3890e261678e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:08:33.538755 30267 raft_consensus.cc:686] T 00000000000000000000000000000000 P dfa8ecb72ba1493e827e3890e261678e [term 1 LEADER]: Becoming Leader. State: Replica: dfa8ecb72ba1493e827e3890e261678e, State: Running, Role: LEADER
I20260809 13:08:33.539435 30267 consensus_queue.cc:237] T 00000000000000000000000000000000 P dfa8ecb72ba1493e827e3890e261678e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfa8ecb72ba1493e827e3890e261678e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45649 } }
I20260809 13:08:33.542655 30249 sys_catalog.cc:564] T 00000000000000000000000000000000 P dfa8ecb72ba1493e827e3890e261678e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:08:33.542842 30268 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfa8ecb72ba1493e827e3890e261678e [sys.catalog]: SysCatalogTable state changed. Reason: New leader dfa8ecb72ba1493e827e3890e261678e. Latest consensus state: current_term: 1 leader_uuid: "dfa8ecb72ba1493e827e3890e261678e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfa8ecb72ba1493e827e3890e261678e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45649 } } }
I20260809 13:08:33.543262 30268 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfa8ecb72ba1493e827e3890e261678e [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:33.542794 30269 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfa8ecb72ba1493e827e3890e261678e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dfa8ecb72ba1493e827e3890e261678e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfa8ecb72ba1493e827e3890e261678e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45649 } } }
I20260809 13:08:33.545385 30269 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfa8ecb72ba1493e827e3890e261678e [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:33.548983 30271 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:08:33.554883 30253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:33.533630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:50633 (local address 127.0.0.1:45649)
0809 13:08:33.533846 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:33.533857 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:33.534511 (+ 654us) server_negotiation.cc:407] Connection header received
0809 13:08:33.534690 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:33.534694 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:33.534763 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:33.534854 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:33.536989 (+ 2135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:33.537995 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:33.540429 (+ 2434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:33.541295 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:33.541448 (+ 153us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:33.545113 (+ 3665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:33.545123 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:33.545132 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:33.545193 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:33.550143 (+ 4950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:33.551387 (+ 1244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:33.551396 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:33.551399 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:33.551558 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:33.552208 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:33.552213 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:33.552216 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:33.552696 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:33.553003 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:33.554249 (+ 1246us) server_negotiation.cc:299] Negotiation successful
0809 13:08:33.554447 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 13:08:33.554952 30271 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:08:33.564929 30271 catalog_manager.cc:1347] Generated new cluster ID: 4500e4884dcf42f19985b91b037112cb
I20260809 13:08:33.565070 30271 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:08:33.576105 30271 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:08:33.577512 30271 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:08:33.585922 30271 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dfa8ecb72ba1493e827e3890e261678e: Generated new TSK 0
I20260809 13:08:33.587082 30271 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 13:08:33.595003 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 30151
I20260809 13:08:33.596695 30241 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:08:33.689040 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 30151
W20260809 13:08:33.713974 30127 connection.cc:535] client connection to 127.0.0.1:45649 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45649): Connection reset by peer (error 104)
2026-08-09T13:08:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2438 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:08:33 dist-test-slave-jq4t krb5kdc[30303](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:08:33 dist-test-slave-jq4t krb5kdc[30303](info): set up 2 sockets
Aug 09 13:08:33 dist-test-slave-jq4t krb5kdc[30303](info): commencing operation
krb5kdc: starting...
W20260809 13:08:35.071300 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.337s user 0.008s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:08:35 dist-test-slave-jq4t krb5kdc[30303](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280915, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:08:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:08:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 13:08:35.423767 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41841
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41841
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:08:35.785010 30323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:35.785374 30323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:35.785573 30323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:35.792908 30323 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:08:35.793071 30323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:35.793184 30323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:35.793283 30323 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:08:35.793365 30323 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:08:35.803215 30323 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41841
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41841
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:35.804730 30323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:35.806097 30323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:35.818992 30333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:35.819025 30332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:35.818986 30338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:35.820305 30323 server_base.cc:1034] running on GCE node
I20260809 13:08:35.821175 30323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:35.822733 30323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:35.823975 30323 hybrid_clock.cc:648] HybridClock initialized: now 1786280915823929 us; error 48 us; skew 500 ppm
I20260809 13:08:35.824348 30323 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:08:35 dist-test-slave-jq4t krb5kdc[30303](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280915, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:08:35.827800 30323 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 13:08:35.829414 30323 webserver.cc:460] Webserver started at http://127.0.0.1:44975/ using document root <none> and password file <none>
I20260809 13:08:35.830154 30323 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:35.830309 30323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:35.830668 30323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:35.833900 30323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "11a9626a8b9c4981ae6dae6fb8a86b7d"
format_stamp: "Formatted at 2026-08-09 13:08:35 on dist-test-slave-jq4t"
server_key: "07bdf5976d3ebbc2c91364f6f5ea4e81"
server_key_iv: "d0f9fd48b25b10050b66a2933a53d6e3"
server_key_version: "encryptionkey@0"
I20260809 13:08:35.834729 30323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "11a9626a8b9c4981ae6dae6fb8a86b7d"
format_stamp: "Formatted at 2026-08-09 13:08:35 on dist-test-slave-jq4t"
server_key: "07bdf5976d3ebbc2c91364f6f5ea4e81"
server_key_iv: "d0f9fd48b25b10050b66a2933a53d6e3"
server_key_version: "encryptionkey@0"
I20260809 13:08:35.840349 30323 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 13:08:35.843926 30351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:35.845326 30323 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:08:35.845530 30323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "11a9626a8b9c4981ae6dae6fb8a86b7d"
format_stamp: "Formatted at 2026-08-09 13:08:35 on dist-test-slave-jq4t"
server_key: "07bdf5976d3ebbc2c91364f6f5ea4e81"
server_key_iv: "d0f9fd48b25b10050b66a2933a53d6e3"
server_key_version: "encryptionkey@0"
I20260809 13:08:35.845739 30323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:35.867666 30323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:35.871924 30323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:35.872239 30323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:35.892688 30323 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41841
I20260809 13:08:35.892728 30432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41841 every 8 connection(s)
I20260809 13:08:35.894115 30323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:08:35.897931 30434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:35.899700 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 30323
I20260809 13:08:35.899909 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:08:35.900395 29295 external_mini_cluster.cc:1428] Setting key 2d97dfbd471491e8e3394edcdfc064ab
I20260809 13:08:35.913458 30434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11a9626a8b9c4981ae6dae6fb8a86b7d: Bootstrap starting.
I20260809 13:08:35.915015 30438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:35.902483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:39649 (local address 127.0.0.1:41841)
0809 13:08:35.903354 (+ 871us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:35.903369 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:35.903413 (+ 44us) server_negotiation.cc:407] Connection header received
0809 13:08:35.905307 (+ 1894us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:35.905332 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:35.905759 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:35.906193 (+ 434us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:35.906839 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:35.908149 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:35.910213 (+ 2064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:35.910983 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:35.911118 (+ 135us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:35.912568 (+ 1450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:35.912577 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:35.912591 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:35.913171 (+ 580us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:35.913252 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:35.913278 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:35.913408 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:35.913800 (+ 392us) server_negotiation.cc:299] Negotiation successful
0809 13:08:35.914000 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":634,"thread_start_us":403,"threads_started":1}
I20260809 13:08:35.917091 30434 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11a9626a8b9c4981ae6dae6fb8a86b7d: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:35.918417 30434 log.cc:824] T 00000000000000000000000000000000 P 11a9626a8b9c4981ae6dae6fb8a86b7d: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:35.919150 29295 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 13:08:35.921417 30434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11a9626a8b9c4981ae6dae6fb8a86b7d: No bootstrap required, opened a new log
I20260809 13:08:35.931177 30438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:35.924066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:46845 (local address 127.0.0.1:41841)
0809 13:08:35.924314 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:35.924320 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:35.924688 (+ 368us) server_negotiation.cc:407] Connection header received
0809 13:08:35.924898 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:35.924905 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:35.924970 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:35.925061 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:35.925662 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:35.926466 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:35.928403 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:35.928936 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:35.929064 (+ 128us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:35.930344 (+ 1280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:35.930349 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:35.930352 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:35.930371 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:35.930413 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:35.930428 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:35.930511 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:35.930746 (+ 235us) server_negotiation.cc:299] Negotiation successful
0809 13:08:35.930837 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 13:08:35.931499 30434 raft_consensus.cc:348] T 00000000000000000000000000000000 P 11a9626a8b9c4981ae6dae6fb8a86b7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11a9626a8b9c4981ae6dae6fb8a86b7d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41841 } }
I20260809 13:08:35.931934 30434 raft_consensus.cc:374] T 00000000000000000000000000000000 P 11a9626a8b9c4981ae6dae6fb8a86b7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:08:35.932044 30434 raft_consensus.cc:729] T 00000000000000000000000000000000 P 11a9626a8b9c4981ae6dae6fb8a86b7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11a9626a8b9c4981ae6dae6fb8a86b7d, State: Initialized, Role: FOLLOWER
I20260809 13:08:35.932770 30434 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11a9626a8b9c4981ae6dae6fb8a86b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11a9626a8b9c4981ae6dae6fb8a86b7d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41841 } }
I20260809 13:08:35.933022 30434 raft_consensus.cc:388] T 00000000000000000000000000000000 P 11a9626a8b9c4981ae6dae6fb8a86b7d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:08:35.933180 30434 raft_consensus.cc:482] T 00000000000000000000000000000000 P 11a9626a8b9c4981ae6dae6fb8a86b7d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:08:35.933375 30434 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 11a9626a8b9c4981ae6dae6fb8a86b7d [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:35.935712 30434 raft_consensus.cc:504] T 00000000000000000000000000000000 P 11a9626a8b9c4981ae6dae6fb8a86b7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11a9626a8b9c4981ae6dae6fb8a86b7d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41841 } }
I20260809 13:08:35.936261 30434 leader_election.cc:302] T 00000000000000000000000000000000 P 11a9626a8b9c4981ae6dae6fb8a86b7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 11a9626a8b9c4981ae6dae6fb8a86b7d; no voters:
I20260809 13:08:35.936934 30434 leader_election.cc:288] T 00000000000000000000000000000000 P 11a9626a8b9c4981ae6dae6fb8a86b7d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:08:35.937109 30448 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 11a9626a8b9c4981ae6dae6fb8a86b7d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:08:35.937861 30448 raft_consensus.cc:686] T 00000000000000000000000000000000 P 11a9626a8b9c4981ae6dae6fb8a86b7d [term 1 LEADER]: Becoming Leader. State: Replica: 11a9626a8b9c4981ae6dae6fb8a86b7d, State: Running, Role: LEADER
I20260809 13:08:35.938464 30448 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11a9626a8b9c4981ae6dae6fb8a86b7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11a9626a8b9c4981ae6dae6fb8a86b7d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41841 } }
I20260809 13:08:35.939318 30434 sys_catalog.cc:564] T 00000000000000000000000000000000 P 11a9626a8b9c4981ae6dae6fb8a86b7d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:08:35.941395 30449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11a9626a8b9c4981ae6dae6fb8a86b7d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "11a9626a8b9c4981ae6dae6fb8a86b7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11a9626a8b9c4981ae6dae6fb8a86b7d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41841 } } }
I20260809 13:08:35.941356 30453 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11a9626a8b9c4981ae6dae6fb8a86b7d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11a9626a8b9c4981ae6dae6fb8a86b7d. Latest consensus state: current_term: 1 leader_uuid: "11a9626a8b9c4981ae6dae6fb8a86b7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11a9626a8b9c4981ae6dae6fb8a86b7d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41841 } } }
I20260809 13:08:35.941993 30449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11a9626a8b9c4981ae6dae6fb8a86b7d [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:35.942027 30453 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11a9626a8b9c4981ae6dae6fb8a86b7d [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:35.943006 30458 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:08:35.949822 30458 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:08:35.960808 30458 catalog_manager.cc:1347] Generated new cluster ID: f49cf3ad470743bfb045f1661a66c49a
I20260809 13:08:35.960963 30458 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:08:35.974123 30458 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:08:35.975492 30458 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:08:35.989181 30458 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 11a9626a8b9c4981ae6dae6fb8a86b7d: Generated new TSK 0
I20260809 13:08:35.990419 30458 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 13:08:36.000861 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 30323
W20260809 13:08:36.003034 30428 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.48:39649
W20260809 13:08:36.003925 29295 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 30323: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 13:08:36.004112 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 30323
W20260809 13:08:36.031423 30301 connection.cc:535] client connection to 127.0.0.1:41841 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41841): Connection reset by peer (error 104)
2026-08-09T13:08:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2317 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:08:36 dist-test-slave-jq4t krb5kdc[30478](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:08:36 dist-test-slave-jq4t krb5kdc[30478](info): set up 2 sockets
Aug 09 13:08:36 dist-test-slave-jq4t krb5kdc[30478](info): commencing operation
krb5kdc: starting...
W20260809 13:08:37.359583 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.308s user 0.002s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:08:37 dist-test-slave-jq4t krb5kdc[30478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280917, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:08:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:08:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 13:08:37.708544 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37545
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37545
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:08:38.069386 30498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:38.069700 30498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:38.069888 30498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:38.077278 30498 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:08:38.077394 30498 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:38.077524 30498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:38.077641 30498 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:08:38.077723 30498 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:08:38.087868 30498 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37545
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786280548611909-29295-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37545
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:38.089370 30498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:38.090781 30498 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:38.103632 30510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:38.103691 30509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:38.103730 30512 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:38.104463 30498 server_base.cc:1034] running on GCE node
I20260809 13:08:38.105357 30498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:38.106878 30498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:38.108143 30498 hybrid_clock.cc:648] HybridClock initialized: now 1786280918108096 us; error 56 us; skew 500 ppm
I20260809 13:08:38.108590 30498 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:08:38 dist-test-slave-jq4t krb5kdc[30478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280918, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:08:38.116150 30498 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 13:08:38.117890 30498 webserver.cc:460] Webserver started at http://127.0.0.1:35305/ using document root <none> and password file <none>
I20260809 13:08:38.118664 30498 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:38.118824 30498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:38.119164 30498 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:38.122454 30498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "f4cc7bb958b94bf88788508b32e727cf"
format_stamp: "Formatted at 2026-08-09 13:08:38 on dist-test-slave-jq4t"
server_key: "a3c69255c44b08bbcd7bb2498ef1b371"
server_key_iv: "d21d476ab00b3ee648bde22733910e8e"
server_key_version: "encryptionkey@0"
I20260809 13:08:38.123282 30498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "f4cc7bb958b94bf88788508b32e727cf"
format_stamp: "Formatted at 2026-08-09 13:08:38 on dist-test-slave-jq4t"
server_key: "a3c69255c44b08bbcd7bb2498ef1b371"
server_key_iv: "d21d476ab00b3ee648bde22733910e8e"
server_key_version: "encryptionkey@0"
I20260809 13:08:38.128968 30498 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260809 13:08:38.132658 30522 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:38.134071 30498 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:08:38.134276 30498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "f4cc7bb958b94bf88788508b32e727cf"
format_stamp: "Formatted at 2026-08-09 13:08:38 on dist-test-slave-jq4t"
server_key: "a3c69255c44b08bbcd7bb2498ef1b371"
server_key_iv: "d21d476ab00b3ee648bde22733910e8e"
server_key_version: "encryptionkey@0"
I20260809 13:08:38.134490 30498 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:38.140547 30498 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:38.145272 30498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:38.145596 30498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:38.164817 30498 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37545
I20260809 13:08:38.164849 30608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37545 every 8 connection(s)
I20260809 13:08:38.166321 30498 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:08:38.170421 30609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:38.173146 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 30498
I20260809 13:08:38.173354 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:08:38.173828 29295 external_mini_cluster.cc:1428] Setting key 89ecb87fee612291e7519863a4db995b
I20260809 13:08:38.182253 30616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:38.175861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:36105 (local address 127.0.0.1:37545)
0809 13:08:38.176820 (+ 959us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:38.176833 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:38.176878 (+ 45us) server_negotiation.cc:407] Connection header received
0809 13:08:38.178596 (+ 1718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:38.178620 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:38.178962 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:38.179309 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:38.180587 (+ 1278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:38.180594 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:38.180610 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:38.180628 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:38.180691 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:38.180716 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:38.180903 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:38.181022 (+ 119us) server_negotiation.cc:299] Negotiation successful
0809 13:08:38.181250 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":750,"thread_start_us":419,"threads_started":1}
I20260809 13:08:38.183391 30609 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4cc7bb958b94bf88788508b32e727cf: Bootstrap starting.
I20260809 13:08:38.186159 29295 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 13:08:38.186968 30609 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f4cc7bb958b94bf88788508b32e727cf: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:38.188021 30609 log.cc:824] T 00000000000000000000000000000000 P f4cc7bb958b94bf88788508b32e727cf: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:38.191493 30609 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4cc7bb958b94bf88788508b32e727cf: No bootstrap required, opened a new log
I20260809 13:08:38.193718 30616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:38.190859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:37677 (local address 127.0.0.1:37545)
0809 13:08:38.191022 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:38.191027 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:38.191539 (+ 512us) server_negotiation.cc:407] Connection header received
0809 13:08:38.191803 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:38.191808 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:38.191857 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:38.191976 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:38.193027 (+ 1051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:38.193033 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:38.193038 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:38.193056 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:38.193105 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:38.193120 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:38.193265 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:38.193359 (+ 94us) server_negotiation.cc:299] Negotiation successful
0809 13:08:38.193432 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 13:08:38.200194 30609 raft_consensus.cc:348] T 00000000000000000000000000000000 P f4cc7bb958b94bf88788508b32e727cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4cc7bb958b94bf88788508b32e727cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37545 } }
I20260809 13:08:38.200692 30609 raft_consensus.cc:374] T 00000000000000000000000000000000 P f4cc7bb958b94bf88788508b32e727cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:08:38.200816 30609 raft_consensus.cc:729] T 00000000000000000000000000000000 P f4cc7bb958b94bf88788508b32e727cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4cc7bb958b94bf88788508b32e727cf, State: Initialized, Role: FOLLOWER
I20260809 13:08:38.201534 30609 consensus_queue.cc:260] T 00000000000000000000000000000000 P f4cc7bb958b94bf88788508b32e727cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4cc7bb958b94bf88788508b32e727cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37545 } }
I20260809 13:08:38.201880 30609 raft_consensus.cc:388] T 00000000000000000000000000000000 P f4cc7bb958b94bf88788508b32e727cf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:08:38.202009 30609 raft_consensus.cc:482] T 00000000000000000000000000000000 P f4cc7bb958b94bf88788508b32e727cf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:08:38.202138 30609 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f4cc7bb958b94bf88788508b32e727cf [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:38.204416 30609 raft_consensus.cc:504] T 00000000000000000000000000000000 P f4cc7bb958b94bf88788508b32e727cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4cc7bb958b94bf88788508b32e727cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37545 } }
I20260809 13:08:38.205003 30609 leader_election.cc:302] T 00000000000000000000000000000000 P f4cc7bb958b94bf88788508b32e727cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f4cc7bb958b94bf88788508b32e727cf; no voters:
I20260809 13:08:38.205608 30609 leader_election.cc:288] T 00000000000000000000000000000000 P f4cc7bb958b94bf88788508b32e727cf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:08:38.205780 30625 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f4cc7bb958b94bf88788508b32e727cf [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:08:38.206557 30625 raft_consensus.cc:686] T 00000000000000000000000000000000 P f4cc7bb958b94bf88788508b32e727cf [term 1 LEADER]: Becoming Leader. State: Replica: f4cc7bb958b94bf88788508b32e727cf, State: Running, Role: LEADER
I20260809 13:08:38.207165 30625 consensus_queue.cc:237] T 00000000000000000000000000000000 P f4cc7bb958b94bf88788508b32e727cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4cc7bb958b94bf88788508b32e727cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37545 } }
I20260809 13:08:38.208101 30609 sys_catalog.cc:564] T 00000000000000000000000000000000 P f4cc7bb958b94bf88788508b32e727cf [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:08:38.210417 30628 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4cc7bb958b94bf88788508b32e727cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader f4cc7bb958b94bf88788508b32e727cf. Latest consensus state: current_term: 1 leader_uuid: "f4cc7bb958b94bf88788508b32e727cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4cc7bb958b94bf88788508b32e727cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37545 } } }
I20260809 13:08:38.211192 30628 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4cc7bb958b94bf88788508b32e727cf [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:38.210922 30626 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4cc7bb958b94bf88788508b32e727cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f4cc7bb958b94bf88788508b32e727cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4cc7bb958b94bf88788508b32e727cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37545 } } }
I20260809 13:08:38.211486 30626 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4cc7bb958b94bf88788508b32e727cf [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:38.214535 30637 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:08:38.220155 30637 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:08:38.230298 30637 catalog_manager.cc:1347] Generated new cluster ID: c1b82c4b744f44e391e9d64e3787234c
I20260809 13:08:38.230448 30637 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:08:38.258675 30637 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:08:38.259204 30637 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:08:38.266717 30637 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f4cc7bb958b94bf88788508b32e727cf: Generated new TSK 0
I20260809 13:08:38.267612 30637 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 13:08:38.278995 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 30498
W20260809 13:08:38.280210 30601 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.48:36105
W20260809 13:08:38.281064 29295 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 30498: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 13:08:38.281234 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 30498
2026-08-09T13:08:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2280 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:08:38 dist-test-slave-jq4t krb5kdc[30657](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:08:38 dist-test-slave-jq4t krb5kdc[30657](info): set up 2 sockets
Aug 09 13:08:38 dist-test-slave-jq4t krb5kdc[30657](info): commencing operation
krb5kdc: starting...
W20260809 13:08:39.652210 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.321s user 0.000s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:08:39 dist-test-slave-jq4t krb5kdc[30657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280919, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:08:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:08:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
I20260809 13:08:39.998265 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:45565
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:34803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:45565
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:08:40.363407 30675 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:40.363830 30675 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:40.364012 30675 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:40.371552 30675 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:08:40.371738 30675 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:40.371858 30675 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:40.371970 30675 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:08:40.372054 30675 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:08:40.382746 30675 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:34803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:45565
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:45565
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:40.384310 30675 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:40.385835 30675 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:40.399320 30683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:40.399258 30686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:40.399376 30682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:40.400321 30675 server_base.cc:1034] running on GCE node
I20260809 13:08:40.401288 30675 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:40.402944 30675 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:40.404211 30675 hybrid_clock.cc:648] HybridClock initialized: now 1786280920404147 us; error 41 us; skew 500 ppm
I20260809 13:08:40.404742 30675 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:08:40 dist-test-slave-jq4t krb5kdc[30657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280920, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:08:40.408211 30675 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:08:40.410035 30675 webserver.cc:460] Webserver started at http://127.28.155.254:37701/ using document root <none> and password file <none>
I20260809 13:08:40.410845 30675 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:40.411012 30675 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:40.411384 30675 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:40.414824 30675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "cd4d447148c94930bfc1f79099da0ad4"
format_stamp: "Formatted at 2026-08-09 13:08:40 on dist-test-slave-jq4t"
server_key: "60f23456356f25c0a5df92f521673f29"
server_key_iv: "19f1fc3c0b8298f289896708397dd035"
server_key_version: "encryptionkey@0"
I20260809 13:08:40.415704 30675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "cd4d447148c94930bfc1f79099da0ad4"
format_stamp: "Formatted at 2026-08-09 13:08:40 on dist-test-slave-jq4t"
server_key: "60f23456356f25c0a5df92f521673f29"
server_key_iv: "19f1fc3c0b8298f289896708397dd035"
server_key_version: "encryptionkey@0"
I20260809 13:08:40.421656 30675 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260809 13:08:40.425360 30694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:40.426817 30675 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:08:40.427047 30675 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "cd4d447148c94930bfc1f79099da0ad4"
format_stamp: "Formatted at 2026-08-09 13:08:40 on dist-test-slave-jq4t"
server_key: "60f23456356f25c0a5df92f521673f29"
server_key_iv: "19f1fc3c0b8298f289896708397dd035"
server_key_version: "encryptionkey@0"
I20260809 13:08:40.427289 30675 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:40.458087 30675 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:40.463097 30675 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:40.463483 30675 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:40.484804 30675 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:45565
I20260809 13:08:40.484829 30775 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:45565 every 8 connection(s)
I20260809 13:08:40.486378 30675 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:08:40.490456 30777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:40.495168 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 30675
I20260809 13:08:40.495380 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:08:40.495983 29295 external_mini_cluster.cc:1428] Setting key 4ad81e7c1f450fea8ff5b8df0b4d1503
I20260809 13:08:40.503134 30777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd4d447148c94930bfc1f79099da0ad4: Bootstrap starting.
I20260809 13:08:40.507153 30777 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd4d447148c94930bfc1f79099da0ad4: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:40.508448 30777 log.cc:824] T 00000000000000000000000000000000 P cd4d447148c94930bfc1f79099da0ad4: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:40.512408 30777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd4d447148c94930bfc1f79099da0ad4: No bootstrap required, opened a new log
Aug 09 13:08:40 dist-test-slave-jq4t krb5kdc[30657](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280919, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:08:40.523921 30783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:40.498159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47279 (local address 127.28.155.254:45565)
0809 13:08:40.499024 (+ 865us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:40.499037 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:40.499082 (+ 45us) server_negotiation.cc:407] Connection header received
0809 13:08:40.501496 (+ 2414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:40.501523 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:40.501927 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:40.502259 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:40.504311 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:40.505781 (+ 1470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:40.507628 (+ 1847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:40.508343 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:40.508557 (+ 214us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:40.514063 (+ 5506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:40.514075 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:40.514097 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:40.514176 (+ 79us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:40.518611 (+ 4435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:40.519508 (+ 897us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:40.519518 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:40.519527 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:40.519771 (+ 244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:40.520250 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:40.520261 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:40.520264 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:40.521086 (+ 822us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:40.521468 (+ 382us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:40.521945 (+ 477us) server_negotiation.cc:299] Negotiation successful
0809 13:08:40.522354 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":635,"thread_start_us":409,"threads_started":1}
I20260809 13:08:40.524000 30777 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd4d447148c94930bfc1f79099da0ad4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd4d447148c94930bfc1f79099da0ad4" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 45565 } }
I20260809 13:08:40.524542 30777 raft_consensus.cc:374] T 00000000000000000000000000000000 P cd4d447148c94930bfc1f79099da0ad4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:08:40.524698 30777 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd4d447148c94930bfc1f79099da0ad4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd4d447148c94930bfc1f79099da0ad4, State: Initialized, Role: FOLLOWER
I20260809 13:08:40.525378 30777 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd4d447148c94930bfc1f79099da0ad4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd4d447148c94930bfc1f79099da0ad4" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 45565 } }
I20260809 13:08:40.525671 30777 raft_consensus.cc:388] T 00000000000000000000000000000000 P cd4d447148c94930bfc1f79099da0ad4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:08:40.525873 30777 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd4d447148c94930bfc1f79099da0ad4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:08:40.526070 30777 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd4d447148c94930bfc1f79099da0ad4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:40.528576 29295 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 13:08:40.528936 30777 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd4d447148c94930bfc1f79099da0ad4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd4d447148c94930bfc1f79099da0ad4" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 45565 } }
I20260809 13:08:40.529542 30777 leader_election.cc:302] T 00000000000000000000000000000000 P cd4d447148c94930bfc1f79099da0ad4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd4d447148c94930bfc1f79099da0ad4; no voters:
I20260809 13:08:40.530228 30777 leader_election.cc:288] T 00000000000000000000000000000000 P cd4d447148c94930bfc1f79099da0ad4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:08:40.530381 30786 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cd4d447148c94930bfc1f79099da0ad4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:08:40.532904 30777 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd4d447148c94930bfc1f79099da0ad4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:08:40.536845 30786 raft_consensus.cc:686] T 00000000000000000000000000000000 P cd4d447148c94930bfc1f79099da0ad4 [term 1 LEADER]: Becoming Leader. State: Replica: cd4d447148c94930bfc1f79099da0ad4, State: Running, Role: LEADER
I20260809 13:08:40.537535 30786 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd4d447148c94930bfc1f79099da0ad4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd4d447148c94930bfc1f79099da0ad4" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 45565 } }
I20260809 13:08:40.540339 30787 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd4d447148c94930bfc1f79099da0ad4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cd4d447148c94930bfc1f79099da0ad4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd4d447148c94930bfc1f79099da0ad4" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 45565 } } }
I20260809 13:08:40.540796 30787 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd4d447148c94930bfc1f79099da0ad4 [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:40.541400 30788 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd4d447148c94930bfc1f79099da0ad4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd4d447148c94930bfc1f79099da0ad4. Latest consensus state: current_term: 1 leader_uuid: "cd4d447148c94930bfc1f79099da0ad4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd4d447148c94930bfc1f79099da0ad4" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 45565 } } }
I20260809 13:08:40.541710 30788 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd4d447148c94930bfc1f79099da0ad4 [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:40.551111 30795 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:08:40.557489 30795 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:08:40.575328 30783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:40.552450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36589 (local address 127.28.155.254:45565)
0809 13:08:40.552682 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:40.552688 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:40.552882 (+ 194us) server_negotiation.cc:407] Connection header received
0809 13:08:40.553240 (+ 358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:40.553247 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:40.553369 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:40.553527 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:40.556019 (+ 2492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:40.557232 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:40.559161 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:40.559679 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:40.559836 (+ 157us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:40.563319 (+ 3483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:40.563325 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:40.563328 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:40.563362 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:40.570021 (+ 6659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:40.571531 (+ 1510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:40.571541 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:40.571547 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:40.571753 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:40.572606 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:40.572614 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:40.572619 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:40.573210 (+ 591us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:40.573552 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:40.574486 (+ 934us) server_negotiation.cc:299] Negotiation successful
0809 13:08:40.574754 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260809 13:08:40.577740 30795 catalog_manager.cc:1347] Generated new cluster ID: 0bcf7eac358d473bb4cd60a14e80c47b
I20260809 13:08:40.577944 30795 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:08:40.603966 30795 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:08:40.605465 30795 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:08:40.619412 30795 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cd4d447148c94930bfc1f79099da0ad4: Generated new TSK 0
I20260809 13:08:40.620409 30795 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 13:08:40.626066 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 30675
I20260809 13:08:40.627364 30768 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:08:40.723271 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 30675
W20260809 13:08:40.749536 30654 connection.cc:535] client connection to 127.28.155.254:45565 recv error: Network error: failed to read from TLS socket (remote: 127.28.155.254:45565): Connection reset by peer (error 104)
2026-08-09T13:08:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2437 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:08:40 dist-test-slave-jq4t krb5kdc[30822](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:08:40 dist-test-slave-jq4t krb5kdc[30822](info): set up 2 sockets
Aug 09 13:08:40 dist-test-slave-jq4t krb5kdc[30822](info): commencing operation
krb5kdc: starting...
W20260809 13:08:42.070736 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.302s user 0.001s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:08:42 dist-test-slave-jq4t krb5kdc[30822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280922, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:08:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:08:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
I20260809 13:08:42.420959 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:34779
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:44127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:34779
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:08:42.786572 30839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:42.786890 30839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:42.787066 30839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:42.794826 30839 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:08:42.794986 30839 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:42.795094 30839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:42.795221 30839 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:08:42.795320 30839 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:08:42.806113 30839 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:44127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:34779
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:34779
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:42.807590 30839 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:42.809109 30839 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:42.821990 30845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:42.822082 30844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:42.822072 30852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:42.823453 30839 server_base.cc:1034] running on GCE node
I20260809 13:08:42.824379 30839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:42.826090 30839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:42.827348 30839 hybrid_clock.cc:648] HybridClock initialized: now 1786280922827305 us; error 50 us; skew 500 ppm
I20260809 13:08:42.827754 30839 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:08:42 dist-test-slave-jq4t krb5kdc[30822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280922, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:08:42.831411 30839 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:08:42.833218 30839 webserver.cc:460] Webserver started at http://127.28.155.254:46427/ using document root <none> and password file <none>
I20260809 13:08:42.833984 30839 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:42.834148 30839 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:42.834487 30839 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:42.838331 30839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "0918be6796d5432887fdb102e272837a"
format_stamp: "Formatted at 2026-08-09 13:08:42 on dist-test-slave-jq4t"
server_key: "8ef409b73c96f1042f2f5488b6f2772e"
server_key_iv: "187ff13de56028f7e9441301aefca098"
server_key_version: "encryptionkey@0"
I20260809 13:08:42.839187 30839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "0918be6796d5432887fdb102e272837a"
format_stamp: "Formatted at 2026-08-09 13:08:42 on dist-test-slave-jq4t"
server_key: "8ef409b73c96f1042f2f5488b6f2772e"
server_key_iv: "187ff13de56028f7e9441301aefca098"
server_key_version: "encryptionkey@0"
I20260809 13:08:42.845101 30839 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 13:08:42.849121 30865 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:42.850591 30839 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 13:08:42.850795 30839 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "0918be6796d5432887fdb102e272837a"
format_stamp: "Formatted at 2026-08-09 13:08:42 on dist-test-slave-jq4t"
server_key: "8ef409b73c96f1042f2f5488b6f2772e"
server_key_iv: "187ff13de56028f7e9441301aefca098"
server_key_version: "encryptionkey@0"
I20260809 13:08:42.851048 30839 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:42.864257 30839 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:42.869360 30839 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:42.869719 30839 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:42.890407 30839 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:34779
I20260809 13:08:42.890486 30938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:34779 every 8 connection(s)
I20260809 13:08:42.892313 30839 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:08:42.896312 30939 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:42.898085 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 30839
I20260809 13:08:42.898309 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:08:42.898782 29295 external_mini_cluster.cc:1428] Setting key a4de239d16bcdb2e05057ea29cd85d04
I20260809 13:08:42.911849 30939 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0918be6796d5432887fdb102e272837a: Bootstrap starting.
I20260809 13:08:42.913360 30944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:42.900781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44533 (local address 127.28.155.254:34779)
0809 13:08:42.901665 (+ 884us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:42.901680 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:42.901724 (+ 44us) server_negotiation.cc:407] Connection header received
0809 13:08:42.903421 (+ 1697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:42.903446 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:42.903960 (+ 514us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:42.904320 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:42.905041 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:42.906462 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:42.908457 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:42.909255 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:42.909402 (+ 147us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:42.910870 (+ 1468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:42.910878 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:42.910893 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:42.911468 (+ 575us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:42.911555 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:42.911582 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:42.911706 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:42.912084 (+ 378us) server_negotiation.cc:299] Negotiation successful
0809 13:08:42.912245 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":649,"thread_start_us":418,"threads_started":1}
I20260809 13:08:42.915516 30939 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0918be6796d5432887fdb102e272837a: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:42.916867 30939 log.cc:824] T 00000000000000000000000000000000 P 0918be6796d5432887fdb102e272837a: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:42.917441 29295 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 13:08:42.920425 30939 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0918be6796d5432887fdb102e272837a: No bootstrap required, opened a new log
I20260809 13:08:42.931597 30939 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0918be6796d5432887fdb102e272837a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0918be6796d5432887fdb102e272837a" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 34779 } }
I20260809 13:08:42.932191 30939 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0918be6796d5432887fdb102e272837a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:08:42.932322 30939 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0918be6796d5432887fdb102e272837a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0918be6796d5432887fdb102e272837a, State: Initialized, Role: FOLLOWER
I20260809 13:08:42.932390 30944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:42.924908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32967 (local address 127.28.155.254:34779)
0809 13:08:42.925129 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:42.925136 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:42.925717 (+ 581us) server_negotiation.cc:407] Connection header received
0809 13:08:42.925883 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:42.925888 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:42.925969 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:42.926076 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:42.926619 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:42.927902 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:42.929433 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:42.930206 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:42.930345 (+ 139us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:42.931512 (+ 1167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:42.931519 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:42.931525 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:42.931547 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:42.931623 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:42.931650 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:42.931777 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:42.931961 (+ 184us) server_negotiation.cc:299] Negotiation successful
0809 13:08:42.932027 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 13:08:42.933122 30939 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0918be6796d5432887fdb102e272837a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0918be6796d5432887fdb102e272837a" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 34779 } }
I20260809 13:08:42.933431 30939 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0918be6796d5432887fdb102e272837a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:08:42.933598 30939 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0918be6796d5432887fdb102e272837a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:08:42.933801 30939 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0918be6796d5432887fdb102e272837a [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:42.936364 30939 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0918be6796d5432887fdb102e272837a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0918be6796d5432887fdb102e272837a" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 34779 } }
I20260809 13:08:42.937014 30939 leader_election.cc:302] T 00000000000000000000000000000000 P 0918be6796d5432887fdb102e272837a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0918be6796d5432887fdb102e272837a; no voters:
I20260809 13:08:42.937618 30939 leader_election.cc:288] T 00000000000000000000000000000000 P 0918be6796d5432887fdb102e272837a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:08:42.937783 30951 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0918be6796d5432887fdb102e272837a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:08:42.938966 30951 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0918be6796d5432887fdb102e272837a [term 1 LEADER]: Becoming Leader. State: Replica: 0918be6796d5432887fdb102e272837a, State: Running, Role: LEADER
I20260809 13:08:42.939543 30951 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0918be6796d5432887fdb102e272837a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0918be6796d5432887fdb102e272837a" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 34779 } }
I20260809 13:08:42.940016 30939 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0918be6796d5432887fdb102e272837a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:08:42.942798 30952 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0918be6796d5432887fdb102e272837a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0918be6796d5432887fdb102e272837a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0918be6796d5432887fdb102e272837a" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 34779 } } }
I20260809 13:08:42.942904 30954 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0918be6796d5432887fdb102e272837a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0918be6796d5432887fdb102e272837a. Latest consensus state: current_term: 1 leader_uuid: "0918be6796d5432887fdb102e272837a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0918be6796d5432887fdb102e272837a" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 34779 } } }
I20260809 13:08:42.943259 30952 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0918be6796d5432887fdb102e272837a [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:42.943337 30954 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0918be6796d5432887fdb102e272837a [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:42.946594 30969 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:08:42.952171 30969 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:08:42.967294 30969 catalog_manager.cc:1347] Generated new cluster ID: 8d6b6e3450ec4c07916a443fd8578e75
I20260809 13:08:42.967454 30969 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:08:42.989593 30969 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:08:42.991650 30969 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:08:43.002521 30969 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0918be6796d5432887fdb102e272837a: Generated new TSK 0
I20260809 13:08:43.003486 30969 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 13:08:43.016995 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 30839
W20260809 13:08:43.018796 30931 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:44533
W20260809 13:08:43.019688 29295 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 30839: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 13:08:43.019838 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 30839
W20260809 13:08:43.046195 30820 connection.cc:535] client connection to 127.28.155.254:34779 recv error: Network error: failed to read from TLS socket (remote: 127.28.155.254:34779): Connection reset by peer (error 104)
2026-08-09T13:08:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2296 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:08:43 dist-test-slave-jq4t krb5kdc[30990](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:08:43 dist-test-slave-jq4t krb5kdc[30990](info): set up 2 sockets
Aug 09 13:08:43 dist-test-slave-jq4t krb5kdc[30990](info): commencing operation
krb5kdc: starting...
W20260809 13:08:44.385648 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.320s user 0.000s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:08:44 dist-test-slave-jq4t krb5kdc[30990](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280924, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:08:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:08:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
I20260809 13:08:44.736421 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:40951
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:40527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:40951
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:08:45.105387 31013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:45.105721 31013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:45.105903 31013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:45.113590 31013 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:08:45.113713 31013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:45.113809 31013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:45.113932 31013 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:08:45.114002 31013 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:08:45.124876 31013 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:40527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:40951
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:40951
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:45.126350 31013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:45.127774 31013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:45.140043 31020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:45.140193 31021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:45.140218 31024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:45.141567 31013 server_base.cc:1034] running on GCE node
I20260809 13:08:45.142454 31013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:45.144043 31013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:45.145290 31013 hybrid_clock.cc:648] HybridClock initialized: now 1786280925145243 us; error 66 us; skew 500 ppm
I20260809 13:08:45.145680 31013 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:08:45 dist-test-slave-jq4t krb5kdc[30990](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280925, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:08:45.149125 31013 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:08:45.150633 31013 webserver.cc:460] Webserver started at http://127.28.155.254:32839/ using document root <none> and password file <none>
I20260809 13:08:45.151355 31013 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:45.151543 31013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:45.151885 31013 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:45.155184 31013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "63aef8338b7f48048eed40cc709291e6"
format_stamp: "Formatted at 2026-08-09 13:08:45 on dist-test-slave-jq4t"
server_key: "a230111c207d8099dfb166c797d6fe5a"
server_key_iv: "c011e80e911ef07d521b6f02e47ba162"
server_key_version: "encryptionkey@0"
I20260809 13:08:45.156032 31013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "63aef8338b7f48048eed40cc709291e6"
format_stamp: "Formatted at 2026-08-09 13:08:45 on dist-test-slave-jq4t"
server_key: "a230111c207d8099dfb166c797d6fe5a"
server_key_iv: "c011e80e911ef07d521b6f02e47ba162"
server_key_version: "encryptionkey@0"
I20260809 13:08:45.161666 31013 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260809 13:08:45.165460 31035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:45.166926 31013 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:08:45.167147 31013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "63aef8338b7f48048eed40cc709291e6"
format_stamp: "Formatted at 2026-08-09 13:08:45 on dist-test-slave-jq4t"
server_key: "a230111c207d8099dfb166c797d6fe5a"
server_key_iv: "c011e80e911ef07d521b6f02e47ba162"
server_key_version: "encryptionkey@0"
I20260809 13:08:45.167378 31013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:45.173470 31013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:45.177626 31013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:45.177955 31013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:45.199630 31013 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:40951
I20260809 13:08:45.199677 31106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:40951 every 8 connection(s)
I20260809 13:08:45.201196 31013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:08:45.205237 31108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:45.205323 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 31013
I20260809 13:08:45.205554 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:08:45.206059 29295 external_mini_cluster.cc:1428] Setting key 881a3b360a57aab3f59b4cedbdfcd470
I20260809 13:08:45.215065 31111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:45.208030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43791 (local address 127.28.155.254:40951)
0809 13:08:45.209118 (+ 1088us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:45.209133 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:45.209189 (+ 56us) server_negotiation.cc:407] Connection header received
0809 13:08:45.210936 (+ 1747us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:45.210982 (+ 46us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:45.211449 (+ 467us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:45.211934 (+ 485us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:45.213038 (+ 1104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:45.213049 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:45.213071 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:45.213091 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:45.213164 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:45.213189 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:45.213440 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:45.213575 (+ 135us) server_negotiation.cc:299] Negotiation successful
0809 13:08:45.213784 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":777,"thread_start_us":434,"threads_started":1}
I20260809 13:08:45.219255 29295 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 13:08:45.220937 31108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63aef8338b7f48048eed40cc709291e6: Bootstrap starting.
I20260809 13:08:45.224871 31108 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 63aef8338b7f48048eed40cc709291e6: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:45.226020 31108 log.cc:824] T 00000000000000000000000000000000 P 63aef8338b7f48048eed40cc709291e6: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:45.226991 31111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:45.224147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56581 (local address 127.28.155.254:40951)
0809 13:08:45.224352 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:45.224359 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:45.224821 (+ 462us) server_negotiation.cc:407] Connection header received
0809 13:08:45.225047 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:45.225051 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:45.225108 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:45.225220 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:45.226238 (+ 1018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:45.226244 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:45.226249 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:45.226275 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:45.226315 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:45.226330 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:45.226455 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:45.226597 (+ 142us) server_negotiation.cc:299] Negotiation successful
0809 13:08:45.226664 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 13:08:45.229238 31108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63aef8338b7f48048eed40cc709291e6: No bootstrap required, opened a new log
I20260809 13:08:45.237440 31108 raft_consensus.cc:348] T 00000000000000000000000000000000 P 63aef8338b7f48048eed40cc709291e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63aef8338b7f48048eed40cc709291e6" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 40951 } }
I20260809 13:08:45.237807 31108 raft_consensus.cc:374] T 00000000000000000000000000000000 P 63aef8338b7f48048eed40cc709291e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:08:45.237883 31108 raft_consensus.cc:729] T 00000000000000000000000000000000 P 63aef8338b7f48048eed40cc709291e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63aef8338b7f48048eed40cc709291e6, State: Initialized, Role: FOLLOWER
I20260809 13:08:45.238394 31108 consensus_queue.cc:260] T 00000000000000000000000000000000 P 63aef8338b7f48048eed40cc709291e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63aef8338b7f48048eed40cc709291e6" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 40951 } }
I20260809 13:08:45.238619 31108 raft_consensus.cc:388] T 00000000000000000000000000000000 P 63aef8338b7f48048eed40cc709291e6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:08:45.238720 31108 raft_consensus.cc:482] T 00000000000000000000000000000000 P 63aef8338b7f48048eed40cc709291e6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:08:45.238847 31108 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 63aef8338b7f48048eed40cc709291e6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:45.241209 31108 raft_consensus.cc:504] T 00000000000000000000000000000000 P 63aef8338b7f48048eed40cc709291e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63aef8338b7f48048eed40cc709291e6" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 40951 } }
I20260809 13:08:45.241842 31108 leader_election.cc:302] T 00000000000000000000000000000000 P 63aef8338b7f48048eed40cc709291e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 63aef8338b7f48048eed40cc709291e6; no voters:
I20260809 13:08:45.242590 31108 leader_election.cc:288] T 00000000000000000000000000000000 P 63aef8338b7f48048eed40cc709291e6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:08:45.242707 31123 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 63aef8338b7f48048eed40cc709291e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:08:45.243481 31123 raft_consensus.cc:686] T 00000000000000000000000000000000 P 63aef8338b7f48048eed40cc709291e6 [term 1 LEADER]: Becoming Leader. State: Replica: 63aef8338b7f48048eed40cc709291e6, State: Running, Role: LEADER
I20260809 13:08:45.244159 31123 consensus_queue.cc:237] T 00000000000000000000000000000000 P 63aef8338b7f48048eed40cc709291e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63aef8338b7f48048eed40cc709291e6" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 40951 } }
I20260809 13:08:45.245095 31108 sys_catalog.cc:564] T 00000000000000000000000000000000 P 63aef8338b7f48048eed40cc709291e6 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:08:45.247316 31125 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63aef8338b7f48048eed40cc709291e6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "63aef8338b7f48048eed40cc709291e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63aef8338b7f48048eed40cc709291e6" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 40951 } } }
I20260809 13:08:45.247915 31125 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63aef8338b7f48048eed40cc709291e6 [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:45.247838 31126 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63aef8338b7f48048eed40cc709291e6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 63aef8338b7f48048eed40cc709291e6. Latest consensus state: current_term: 1 leader_uuid: "63aef8338b7f48048eed40cc709291e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63aef8338b7f48048eed40cc709291e6" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 40951 } } }
I20260809 13:08:45.248214 31126 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63aef8338b7f48048eed40cc709291e6 [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:45.249790 31134 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:08:45.255378 31134 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:08:45.265683 31134 catalog_manager.cc:1347] Generated new cluster ID: 81841781de354eb2a5645d133e578d61
I20260809 13:08:45.265807 31134 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:08:45.285375 31134 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:08:45.285950 31134 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:08:45.298564 31134 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 63aef8338b7f48048eed40cc709291e6: Generated new TSK 0
I20260809 13:08:45.299701 31134 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 13:08:45.314615 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 31013
W20260809 13:08:45.315912 31100 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:43791
W20260809 13:08:45.316675 29295 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 31013: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 13:08:45.316838 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 31013
2026-08-09T13:08:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2297 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:08:45 dist-test-slave-jq4t krb5kdc[31154](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:08:45 dist-test-slave-jq4t krb5kdc[31154](info): set up 2 sockets
Aug 09 13:08:45 dist-test-slave-jq4t krb5kdc[31154](info): commencing operation
krb5kdc: starting...
W20260809 13:08:46.691877 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.328s user 0.003s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:08:46 dist-test-slave-jq4t krb5kdc[31154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280926, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:08:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:08:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
I20260809 13:08:47.044822 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:45679
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:45993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:45679
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:08:47.416152 31175 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:47.416551 31175 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:47.416747 31175 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:47.424445 31175 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:08:47.424639 31175 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:47.424755 31175 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:47.424870 31175 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:08:47.424958 31175 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:08:47.435375 31175 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:45993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:45679
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:45679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:47.436937 31175 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:47.438334 31175 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:47.450953 31187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:47.450975 31184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:47.451025 31185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:47.452517 31175 server_base.cc:1034] running on GCE node
I20260809 13:08:47.453392 31175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:47.454995 31175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:47.456409 31175 hybrid_clock.cc:648] HybridClock initialized: now 1786280927456351 us; error 59 us; skew 500 ppm
I20260809 13:08:47.456905 31175 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:08:47 dist-test-slave-jq4t krb5kdc[31154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280927, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:08:47.461174 31175 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:08:47.462909 31175 webserver.cc:460] Webserver started at http://127.28.155.254:37957/ using document root <none> and password file <none>
I20260809 13:08:47.463718 31175 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:47.463863 31175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:47.464221 31175 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:47.467617 31175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "6e02a8a8331146b5865d623ea243fbe1"
format_stamp: "Formatted at 2026-08-09 13:08:47 on dist-test-slave-jq4t"
server_key: "5015442d626c92bbe3977a79062a36a8"
server_key_iv: "792fc920fc08fe23bb6b08b095366413"
server_key_version: "encryptionkey@0"
I20260809 13:08:47.468439 31175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "6e02a8a8331146b5865d623ea243fbe1"
format_stamp: "Formatted at 2026-08-09 13:08:47 on dist-test-slave-jq4t"
server_key: "5015442d626c92bbe3977a79062a36a8"
server_key_iv: "792fc920fc08fe23bb6b08b095366413"
server_key_version: "encryptionkey@0"
I20260809 13:08:47.473975 31175 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260809 13:08:47.477783 31195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:47.479247 31175 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 13:08:47.479467 31175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "6e02a8a8331146b5865d623ea243fbe1"
format_stamp: "Formatted at 2026-08-09 13:08:47 on dist-test-slave-jq4t"
server_key: "5015442d626c92bbe3977a79062a36a8"
server_key_iv: "792fc920fc08fe23bb6b08b095366413"
server_key_version: "encryptionkey@0"
I20260809 13:08:47.479703 31175 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:47.513904 31175 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:47.518669 31175 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:47.519024 31175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:47.539670 31175 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:45679
I20260809 13:08:47.539691 31267 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:45679 every 8 connection(s)
I20260809 13:08:47.541345 31175 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:08:47.545706 31268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:47.551009 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 31175
I20260809 13:08:47.551218 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:08:47.551683 29295 external_mini_cluster.cc:1428] Setting key 7a3f6e074846b891c9bd50532c001c82
I20260809 13:08:47.558907 31268 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e02a8a8331146b5865d623ea243fbe1: Bootstrap starting.
I20260809 13:08:47.563022 31268 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e02a8a8331146b5865d623ea243fbe1: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:47.564419 31268 log.cc:824] T 00000000000000000000000000000000 P 6e02a8a8331146b5865d623ea243fbe1: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:47.567631 31268 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e02a8a8331146b5865d623ea243fbe1: No bootstrap required, opened a new log
Aug 09 13:08:47 dist-test-slave-jq4t krb5kdc[31154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280926, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:08:47.578855 31272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:47.553761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49337 (local address 127.28.155.254:45679)
0809 13:08:47.554749 (+ 988us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:47.554765 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:47.554829 (+ 64us) server_negotiation.cc:407] Connection header received
0809 13:08:47.557436 (+ 2607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:47.557469 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:47.557982 (+ 513us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:47.558446 (+ 464us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:47.559923 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:47.562089 (+ 2166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:47.563523 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:47.564696 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:47.564897 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:47.569418 (+ 4521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:47.569430 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:47.569456 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:47.569502 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:47.573751 (+ 4249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:47.574489 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:47.574499 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:47.574515 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:47.574765 (+ 250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:47.575155 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:47.575161 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:47.575164 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:47.575979 (+ 815us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:47.576318 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:47.576750 (+ 432us) server_negotiation.cc:299] Negotiation successful
0809 13:08:47.577279 (+ 529us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":670,"thread_start_us":417,"threads_started":1}
I20260809 13:08:47.579217 31268 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e02a8a8331146b5865d623ea243fbe1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e02a8a8331146b5865d623ea243fbe1" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 45679 } }
I20260809 13:08:47.579752 31268 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6e02a8a8331146b5865d623ea243fbe1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:08:47.579864 31268 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e02a8a8331146b5865d623ea243fbe1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e02a8a8331146b5865d623ea243fbe1, State: Initialized, Role: FOLLOWER
I20260809 13:08:47.580613 31268 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e02a8a8331146b5865d623ea243fbe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e02a8a8331146b5865d623ea243fbe1" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 45679 } }
I20260809 13:08:47.580945 31268 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6e02a8a8331146b5865d623ea243fbe1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:08:47.581110 31268 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6e02a8a8331146b5865d623ea243fbe1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:08:47.581305 31268 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e02a8a8331146b5865d623ea243fbe1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:47.583601 29295 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 13:08:47.584275 31268 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6e02a8a8331146b5865d623ea243fbe1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e02a8a8331146b5865d623ea243fbe1" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 45679 } }
I20260809 13:08:47.584942 31268 leader_election.cc:302] T 00000000000000000000000000000000 P 6e02a8a8331146b5865d623ea243fbe1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6e02a8a8331146b5865d623ea243fbe1; no voters:
I20260809 13:08:47.585636 31268 leader_election.cc:288] T 00000000000000000000000000000000 P 6e02a8a8331146b5865d623ea243fbe1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:08:47.585767 31274 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6e02a8a8331146b5865d623ea243fbe1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:08:47.587230 31274 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6e02a8a8331146b5865d623ea243fbe1 [term 1 LEADER]: Becoming Leader. State: Replica: 6e02a8a8331146b5865d623ea243fbe1, State: Running, Role: LEADER
I20260809 13:08:47.587860 31274 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6e02a8a8331146b5865d623ea243fbe1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e02a8a8331146b5865d623ea243fbe1" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 45679 } }
I20260809 13:08:47.588341 31268 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e02a8a8331146b5865d623ea243fbe1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:08:47.590749 31276 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e02a8a8331146b5865d623ea243fbe1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e02a8a8331146b5865d623ea243fbe1. Latest consensus state: current_term: 1 leader_uuid: "6e02a8a8331146b5865d623ea243fbe1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e02a8a8331146b5865d623ea243fbe1" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 45679 } } }
I20260809 13:08:47.591229 31276 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e02a8a8331146b5865d623ea243fbe1 [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:47.591831 31275 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e02a8a8331146b5865d623ea243fbe1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6e02a8a8331146b5865d623ea243fbe1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e02a8a8331146b5865d623ea243fbe1" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 45679 } } }
I20260809 13:08:47.592159 31275 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e02a8a8331146b5865d623ea243fbe1 [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:47.594163 31284 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:08:47.601234 31284 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:08:47.614734 31284 catalog_manager.cc:1347] Generated new cluster ID: 0b2585ef992e404a88d9b3c0e2f7e0ce
I20260809 13:08:47.614892 31284 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:08:47.618726 31272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:47.597847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36553 (local address 127.28.155.254:45679)
0809 13:08:47.598341 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:47.598351 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:47.599038 (+ 687us) server_negotiation.cc:407] Connection header received
0809 13:08:47.599344 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:47.599351 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:47.599470 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:47.599553 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:47.601900 (+ 2347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:47.603179 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:47.605194 (+ 2015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:47.605960 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:47.606107 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:47.609631 (+ 3524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:47.609638 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:47.609644 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:47.609689 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:47.614319 (+ 4630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:47.615345 (+ 1026us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:47.615350 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:47.615354 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:47.615545 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:47.616063 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:47.616069 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:47.616076 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:47.616551 (+ 475us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:47.616818 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:47.618100 (+ 1282us) server_negotiation.cc:299] Negotiation successful
0809 13:08:47.618352 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360}
I20260809 13:08:47.645984 31284 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:08:47.647352 31284 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:08:47.655102 31284 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6e02a8a8331146b5865d623ea243fbe1: Generated new TSK 0
I20260809 13:08:47.656196 31284 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 13:08:47.668936 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 31175
I20260809 13:08:47.670069 31261 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:08:47.767100 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 31175
2026-08-09T13:08:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2448 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:08:47 dist-test-slave-jq4t krb5kdc[31316](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:08:47 dist-test-slave-jq4t krb5kdc[31316](info): set up 2 sockets
Aug 09 13:08:47 dist-test-slave-jq4t krb5kdc[31316](info): commencing operation
krb5kdc: starting...
W20260809 13:08:49.112198 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.300s user 0.000s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:08:49 dist-test-slave-jq4t krb5kdc[31316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280929, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:08:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:08:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
I20260809 13:08:49.467988 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:35677
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:32865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:35677
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:08:49.838702 31338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:49.839012 31338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:49.839110 31338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:49.846414 31338 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:08:49.846544 31338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:49.846592 31338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:49.846654 31338 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:08:49.846694 31338 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:08:49.856626 31338 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:32865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:35677
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:35677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:49.857940 31338 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:49.859261 31338 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:49.871526 31345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:49.871554 31347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:49.871615 31350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:49.872727 31338 server_base.cc:1034] running on GCE node
I20260809 13:08:49.873567 31338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:49.874970 31338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:49.876216 31338 hybrid_clock.cc:648] HybridClock initialized: now 1786280929876158 us; error 58 us; skew 500 ppm
I20260809 13:08:49.876660 31338 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:08:49 dist-test-slave-jq4t krb5kdc[31316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280929, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:08:49.884299 31338 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:08:49.886040 31338 webserver.cc:460] Webserver started at http://127.28.155.254:42553/ using document root <none> and password file <none>
I20260809 13:08:49.886804 31338 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:49.886971 31338 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:49.887310 31338 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:49.890617 31338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "55f5f2ca99e3496791768389c0edc22c"
format_stamp: "Formatted at 2026-08-09 13:08:49 on dist-test-slave-jq4t"
server_key: "31f261b52c0f657615bb6d2f33710b69"
server_key_iv: "bcedc7c6b8e7506b8138b80148d86c80"
server_key_version: "encryptionkey@0"
I20260809 13:08:49.891516 31338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "55f5f2ca99e3496791768389c0edc22c"
format_stamp: "Formatted at 2026-08-09 13:08:49 on dist-test-slave-jq4t"
server_key: "31f261b52c0f657615bb6d2f33710b69"
server_key_iv: "bcedc7c6b8e7506b8138b80148d86c80"
server_key_version: "encryptionkey@0"
I20260809 13:08:49.897161 31338 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 13:08:49.900835 31360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:49.902132 31338 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:08:49.902325 31338 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "55f5f2ca99e3496791768389c0edc22c"
format_stamp: "Formatted at 2026-08-09 13:08:49 on dist-test-slave-jq4t"
server_key: "31f261b52c0f657615bb6d2f33710b69"
server_key_iv: "bcedc7c6b8e7506b8138b80148d86c80"
server_key_version: "encryptionkey@0"
I20260809 13:08:49.902546 31338 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:49.919608 31338 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:49.924050 31338 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:49.924384 31338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:49.943917 31338 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:35677
I20260809 13:08:49.943953 31443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:35677 every 8 connection(s)
I20260809 13:08:49.945540 31338 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:08:49.949790 31445 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:49.954912 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 31338
I20260809 13:08:49.955101 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:08:49.955615 29295 external_mini_cluster.cc:1428] Setting key 1bd84b9f06254f5c3f914705195b2143
I20260809 13:08:49.962865 31445 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55f5f2ca99e3496791768389c0edc22c: Bootstrap starting.
I20260809 13:08:49.967073 31445 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 55f5f2ca99e3496791768389c0edc22c: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:49.968587 31445 log.cc:824] T 00000000000000000000000000000000 P 55f5f2ca99e3496791768389c0edc22c: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:49.972371 31453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:49.957651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44087 (local address 127.28.155.254:35677)
0809 13:08:49.958734 (+ 1083us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:49.958750 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:49.958808 (+ 58us) server_negotiation.cc:407] Connection header received
0809 13:08:49.961422 (+ 2614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:49.961452 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:49.961983 (+ 531us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:49.962468 (+ 485us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:49.963056 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:49.965220 (+ 2164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:49.966692 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:49.967867 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:49.968076 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:49.969485 (+ 1409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:49.969496 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:49.969513 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:49.970186 (+ 673us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:49.970290 (+ 104us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:49.970328 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:49.970448 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:49.970686 (+ 238us) server_negotiation.cc:299] Negotiation successful
0809 13:08:49.970997 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":779,"thread_start_us":477,"threads_started":1}
I20260809 13:08:49.972466 31445 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55f5f2ca99e3496791768389c0edc22c: No bootstrap required, opened a new log
I20260809 13:08:49.976665 29295 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 13:08:49.981828 31445 raft_consensus.cc:348] T 00000000000000000000000000000000 P 55f5f2ca99e3496791768389c0edc22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55f5f2ca99e3496791768389c0edc22c" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 35677 } }
I20260809 13:08:49.982352 31445 raft_consensus.cc:374] T 00000000000000000000000000000000 P 55f5f2ca99e3496791768389c0edc22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:08:49.982528 31445 raft_consensus.cc:729] T 00000000000000000000000000000000 P 55f5f2ca99e3496791768389c0edc22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55f5f2ca99e3496791768389c0edc22c, State: Initialized, Role: FOLLOWER
I20260809 13:08:49.983295 31445 consensus_queue.cc:260] T 00000000000000000000000000000000 P 55f5f2ca99e3496791768389c0edc22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55f5f2ca99e3496791768389c0edc22c" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 35677 } }
I20260809 13:08:49.983697 31445 raft_consensus.cc:388] T 00000000000000000000000000000000 P 55f5f2ca99e3496791768389c0edc22c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:08:49.983881 31445 raft_consensus.cc:482] T 00000000000000000000000000000000 P 55f5f2ca99e3496791768389c0edc22c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:08:49.984107 31445 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 55f5f2ca99e3496791768389c0edc22c [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:49.987525 31445 raft_consensus.cc:504] T 00000000000000000000000000000000 P 55f5f2ca99e3496791768389c0edc22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55f5f2ca99e3496791768389c0edc22c" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 35677 } }
I20260809 13:08:49.988241 31445 leader_election.cc:302] T 00000000000000000000000000000000 P 55f5f2ca99e3496791768389c0edc22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 55f5f2ca99e3496791768389c0edc22c; no voters:
I20260809 13:08:49.989162 31445 leader_election.cc:288] T 00000000000000000000000000000000 P 55f5f2ca99e3496791768389c0edc22c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:08:49.989753 31453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:49.981521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52325 (local address 127.28.155.254:35677)
0809 13:08:49.981739 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:49.981745 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:49.982195 (+ 450us) server_negotiation.cc:407] Connection header received
0809 13:08:49.982464 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:49.982469 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:49.982594 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:49.982720 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:49.983555 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:49.984772 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:49.986706 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:49.987182 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:49.987287 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:49.988754 (+ 1467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:49.988759 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:49.988763 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:49.988784 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:49.988828 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:49.988845 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:49.988964 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:49.989131 (+ 167us) server_negotiation.cc:299] Negotiation successful
0809 13:08:49.989250 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 13:08:49.989285 31465 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 55f5f2ca99e3496791768389c0edc22c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:08:49.990900 31465 raft_consensus.cc:686] T 00000000000000000000000000000000 P 55f5f2ca99e3496791768389c0edc22c [term 1 LEADER]: Becoming Leader. State: Replica: 55f5f2ca99e3496791768389c0edc22c, State: Running, Role: LEADER
I20260809 13:08:49.991725 31465 consensus_queue.cc:237] T 00000000000000000000000000000000 P 55f5f2ca99e3496791768389c0edc22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55f5f2ca99e3496791768389c0edc22c" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 35677 } }
I20260809 13:08:49.991962 31445 sys_catalog.cc:564] T 00000000000000000000000000000000 P 55f5f2ca99e3496791768389c0edc22c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:08:49.995258 31470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55f5f2ca99e3496791768389c0edc22c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 55f5f2ca99e3496791768389c0edc22c. Latest consensus state: current_term: 1 leader_uuid: "55f5f2ca99e3496791768389c0edc22c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55f5f2ca99e3496791768389c0edc22c" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 35677 } } }
I20260809 13:08:49.995815 31470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55f5f2ca99e3496791768389c0edc22c [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:49.996449 31468 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55f5f2ca99e3496791768389c0edc22c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "55f5f2ca99e3496791768389c0edc22c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55f5f2ca99e3496791768389c0edc22c" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 35677 } } }
I20260809 13:08:49.996840 31468 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55f5f2ca99e3496791768389c0edc22c [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:49.996922 31478 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:08:50.005059 31478 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:08:50.016295 31478 catalog_manager.cc:1347] Generated new cluster ID: 11320f3950c346bbb312c427f61dd4fd
I20260809 13:08:50.016462 31478 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:08:50.043668 31478 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:08:50.045318 31478 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:08:50.055294 31478 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 55f5f2ca99e3496791768389c0edc22c: Generated new TSK 0
I20260809 13:08:50.056322 31478 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 13:08:50.073153 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 31338
W20260809 13:08:50.074554 31435 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:44087
W20260809 13:08:50.075436 29295 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 31338: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 13:08:50.075615 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 31338
2026-08-09T13:08:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2309 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:08:50 dist-test-slave-jq4t krb5kdc[31498](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:08:50 dist-test-slave-jq4t krb5kdc[31498](info): set up 2 sockets
Aug 09 13:08:50 dist-test-slave-jq4t krb5kdc[31498](info): commencing operation
krb5kdc: starting...
W20260809 13:08:51.443497 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.321s user 0.000s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:08:51 dist-test-slave-jq4t krb5kdc[31498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280931, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:08:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:08:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
I20260809 13:08:51.799415 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:41225
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:42283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:41225
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:08:52.172574 31519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:52.172914 31519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:52.173086 31519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:52.180801 31519 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:08:52.180949 31519 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:52.181080 31519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:52.181177 31519 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:08:52.181265 31519 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:08:52.191843 31519 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:42283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:41225
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:41225
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:52.193447 31519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:52.194829 31519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:52.207283 31526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:52.207366 31527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:52.207342 31529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:52.208652 31519 server_base.cc:1034] running on GCE node
I20260809 13:08:52.209476 31519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:52.211010 31519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:52.212229 31519 hybrid_clock.cc:648] HybridClock initialized: now 1786280932212181 us; error 39 us; skew 500 ppm
I20260809 13:08:52.212672 31519 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:08:52 dist-test-slave-jq4t krb5kdc[31498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280932, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:08:52.216102 31519 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:08:52.217829 31519 webserver.cc:460] Webserver started at http://127.28.155.254:36431/ using document root <none> and password file <none>
I20260809 13:08:52.218591 31519 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:52.218750 31519 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:52.219092 31519 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:52.222600 31519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "8774c4feb3204ad4ae28fc081f270064"
format_stamp: "Formatted at 2026-08-09 13:08:52 on dist-test-slave-jq4t"
server_key: "fdbabfa75208e62187a34c1b629b1835"
server_key_iv: "c17b5240e8d22227cc0539e7d0d4a458"
server_key_version: "encryptionkey@0"
I20260809 13:08:52.223443 31519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "8774c4feb3204ad4ae28fc081f270064"
format_stamp: "Formatted at 2026-08-09 13:08:52 on dist-test-slave-jq4t"
server_key: "fdbabfa75208e62187a34c1b629b1835"
server_key_iv: "c17b5240e8d22227cc0539e7d0d4a458"
server_key_version: "encryptionkey@0"
I20260809 13:08:52.229126 31519 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 13:08:52.232811 31542 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:52.234210 31519 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:08:52.234416 31519 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "8774c4feb3204ad4ae28fc081f270064"
format_stamp: "Formatted at 2026-08-09 13:08:52 on dist-test-slave-jq4t"
server_key: "fdbabfa75208e62187a34c1b629b1835"
server_key_iv: "c17b5240e8d22227cc0539e7d0d4a458"
server_key_version: "encryptionkey@0"
I20260809 13:08:52.234633 31519 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:52.241335 31519 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:52.245812 31519 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:52.246150 31519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:52.266541 31519 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:41225
I20260809 13:08:52.266579 31617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:41225 every 8 connection(s)
I20260809 13:08:52.268041 31519 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:08:52.272143 31619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:52.276644 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 31519
I20260809 13:08:52.276834 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:08:52.277307 29295 external_mini_cluster.cc:1428] Setting key d790958d7822cc0bad89663148b1321f
I20260809 13:08:52.283979 31619 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8774c4feb3204ad4ae28fc081f270064: Bootstrap starting.
I20260809 13:08:52.286211 31623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:52.279255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52141 (local address 127.28.155.254:41225)
0809 13:08:52.280129 (+ 874us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:52.280141 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:52.280183 (+ 42us) server_negotiation.cc:407] Connection header received
0809 13:08:52.282513 (+ 2330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:52.282539 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:52.282877 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:52.283272 (+ 395us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:52.284394 (+ 1122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:52.284400 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:52.284414 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:52.284438 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:52.284580 (+ 142us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:52.284614 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:52.284890 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:52.285043 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 13:08:52.285245 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":656,"thread_start_us":414,"threads_started":1}
I20260809 13:08:52.287572 31619 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8774c4feb3204ad4ae28fc081f270064: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:52.288861 31619 log.cc:824] T 00000000000000000000000000000000 P 8774c4feb3204ad4ae28fc081f270064: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:52.290151 29295 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 13:08:52.292548 31619 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8774c4feb3204ad4ae28fc081f270064: No bootstrap required, opened a new log
I20260809 13:08:52.298017 31623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:52.295122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36531 (local address 127.28.155.254:41225)
0809 13:08:52.295335 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:52.295341 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:52.295915 (+ 574us) server_negotiation.cc:407] Connection header received
0809 13:08:52.296097 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:52.296101 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:52.296155 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:52.296239 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:52.297301 (+ 1062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:52.297305 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:52.297308 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 13:08:52.297323 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:52.297362 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 13:08:52.297377 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:52.297464 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:52.297607 (+ 143us) server_negotiation.cc:299] Negotiation successful
0809 13:08:52.297656 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 13:08:52.302637 31619 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8774c4feb3204ad4ae28fc081f270064 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8774c4feb3204ad4ae28fc081f270064" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 41225 } }
I20260809 13:08:52.303212 31619 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8774c4feb3204ad4ae28fc081f270064 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 13:08:52.303333 31619 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8774c4feb3204ad4ae28fc081f270064 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8774c4feb3204ad4ae28fc081f270064, State: Initialized, Role: FOLLOWER
I20260809 13:08:52.303956 31619 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8774c4feb3204ad4ae28fc081f270064 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8774c4feb3204ad4ae28fc081f270064" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 41225 } }
I20260809 13:08:52.304216 31619 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8774c4feb3204ad4ae28fc081f270064 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 13:08:52.304387 31619 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8774c4feb3204ad4ae28fc081f270064 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 13:08:52.304605 31619 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8774c4feb3204ad4ae28fc081f270064 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:52.306957 31619 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8774c4feb3204ad4ae28fc081f270064 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8774c4feb3204ad4ae28fc081f270064" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 41225 } }
I20260809 13:08:52.307505 31619 leader_election.cc:302] T 00000000000000000000000000000000 P 8774c4feb3204ad4ae28fc081f270064 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8774c4feb3204ad4ae28fc081f270064; no voters:
I20260809 13:08:52.308195 31619 leader_election.cc:288] T 00000000000000000000000000000000 P 8774c4feb3204ad4ae28fc081f270064 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 13:08:52.308287 31634 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8774c4feb3204ad4ae28fc081f270064 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:08:52.309154 31634 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8774c4feb3204ad4ae28fc081f270064 [term 1 LEADER]: Becoming Leader. State: Replica: 8774c4feb3204ad4ae28fc081f270064, State: Running, Role: LEADER
I20260809 13:08:52.309850 31634 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8774c4feb3204ad4ae28fc081f270064 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8774c4feb3204ad4ae28fc081f270064" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 41225 } }
I20260809 13:08:52.310776 31619 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8774c4feb3204ad4ae28fc081f270064 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:08:52.313196 31638 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8774c4feb3204ad4ae28fc081f270064 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8774c4feb3204ad4ae28fc081f270064. Latest consensus state: current_term: 1 leader_uuid: "8774c4feb3204ad4ae28fc081f270064" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8774c4feb3204ad4ae28fc081f270064" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 41225 } } }
I20260809 13:08:52.313618 31637 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8774c4feb3204ad4ae28fc081f270064 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8774c4feb3204ad4ae28fc081f270064" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8774c4feb3204ad4ae28fc081f270064" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 41225 } } }
I20260809 13:08:52.313933 31638 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8774c4feb3204ad4ae28fc081f270064 [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:52.314033 31637 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8774c4feb3204ad4ae28fc081f270064 [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:52.316227 31646 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 13:08:52.321002 31646 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:08:52.330734 31646 catalog_manager.cc:1347] Generated new cluster ID: cc4746f0650c448c881ebf695176e66a
I20260809 13:08:52.330900 31646 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:08:52.347877 31646 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:08:52.348358 31646 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:08:52.355309 31646 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8774c4feb3204ad4ae28fc081f270064: Generated new TSK 0
I20260809 13:08:52.356200 31646 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 13:08:52.368530 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 31519
W20260809 13:08:52.369963 31611 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:52141
W20260809 13:08:52.370720 29295 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 31519: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 13:08:52.370893 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 31519
2026-08-09T13:08:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2297 ms)
[----------] 18 tests from AuthTokenIssuingTest (42212 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:08:52 dist-test-slave-jq4t krb5kdc[31666](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:08:52 dist-test-slave-jq4t krb5kdc[31666](info): set up 2 sockets
Aug 09 13:08:52 dist-test-slave-jq4t krb5kdc[31666](info): commencing operation
krb5kdc: starting...
W20260809 13:08:53.735291 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.314s user 0.002s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:08:53 dist-test-slave-jq4t krb5kdc[31666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280933, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:08:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:08:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
I20260809 13:08:54.100324 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:46641
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:40209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:46641,127.28.155.253:35645,127.28.155.252:38727
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:08:54.461843 31686 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 13:08:54.462282 31686 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:54.462442 31686 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:54.462553 31686 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:54.470207 31686 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:08:54.470314 31686 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:54.470423 31686 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:54.470549 31686 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:08:54.470674 31686 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:08:54.481696 31686 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:40209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:46641,127.28.155.253:35645,127.28.155.252:38727
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:46641
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:54.483310 31686 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:54.485371 31686 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:54.498754 31694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:54.498814 31692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:54.498840 31697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:54.499728 31686 server_base.cc:1034] running on GCE node
I20260809 13:08:54.500609 31686 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:54.502106 31686 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:54.503341 31686 hybrid_clock.cc:648] HybridClock initialized: now 1786280934503283 us; error 33 us; skew 500 ppm
I20260809 13:08:54.503715 31686 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:08:54 dist-test-slave-jq4t krb5kdc[31666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280934, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:08:54.507148 31686 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:08:54.508798 31686 webserver.cc:460] Webserver started at http://127.28.155.254:41651/ using document root <none> and password file <none>
I20260809 13:08:54.509553 31686 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:54.509675 31686 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:54.510036 31686 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:54.513448 31686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "0773267ed5f148a0a1aa6ef2b5cd5961"
format_stamp: "Formatted at 2026-08-09 13:08:54 on dist-test-slave-jq4t"
server_key: "95f5081fb0ab310620da1b5c86767d89"
server_key_iv: "ac1e34bfa25256bfb443ab076d973c85"
server_key_version: "encryptionkey@0"
I20260809 13:08:54.514326 31686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "0773267ed5f148a0a1aa6ef2b5cd5961"
format_stamp: "Formatted at 2026-08-09 13:08:54 on dist-test-slave-jq4t"
server_key: "95f5081fb0ab310620da1b5c86767d89"
server_key_iv: "ac1e34bfa25256bfb443ab076d973c85"
server_key_version: "encryptionkey@0"
I20260809 13:08:54.520152 31686 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260809 13:08:54.524128 31708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:54.525843 31686 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:08:54.526077 31686 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "0773267ed5f148a0a1aa6ef2b5cd5961"
format_stamp: "Formatted at 2026-08-09 13:08:54 on dist-test-slave-jq4t"
server_key: "95f5081fb0ab310620da1b5c86767d89"
server_key_iv: "ac1e34bfa25256bfb443ab076d973c85"
server_key_version: "encryptionkey@0"
I20260809 13:08:54.526351 31686 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:54.543649 31686 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:54.548945 31686 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:54.549293 31686 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:54.570393 31686 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:46641
I20260809 13:08:54.570412 31779 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:46641 every 8 connection(s)
I20260809 13:08:54.571916 31686 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:08:54.575981 31780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:54.576047 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 31686
I20260809 13:08:54.576282 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:08:54.577234 29295 external_mini_cluster.cc:1428] Setting key bfdf22359a811b2c0af03176ac5c57a3
I20260809 13:08:54.586835 31780 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46641 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 13:08:54 dist-test-slave-jq4t krb5kdc[31666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280934, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.28.155.253@KRBTEST.COM; defaulting to no policy
I20260809 13:08:54.614593 31783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:54.591194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:46641 (local address 127.0.0.1:60414)
0809 13:08:54.592125 (+ 931us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:54.592182 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:54.595297 (+ 3115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:54.596203 (+ 906us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:54.596213 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:54.597087 (+ 874us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:08:54.597670 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:54.597703 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:54.599402 (+ 1699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:54.599410 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:54.601384 (+ 1974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:54.601402 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:54.602362 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:54.602372 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:54.602629 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:54.603400 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:08:54.603443 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:08:54.606349 (+ 2906us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:08:54.609876 (+ 3527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:08:54.609890 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:08:54.609903 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:08:54.610347 (+ 444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:08:54.610800 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:08:54.610808 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:08:54.610812 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:08:54.611001 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:08:54.611844 (+ 843us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:08:54.611852 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:08:54.612087 (+ 235us) client_negotiation.cc:769] Sending connection context
0809 13:08:54.612355 (+ 268us) client_negotiation.cc:240] Negotiation successful
0809 13:08:54.613121 (+ 766us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":639,"mutex_wait_us":205,"thread_start_us":411,"threads_started":1}
I20260809 13:08:54.614625 31785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:54.592641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60414 (local address 127.28.155.254:46641)
0809 13:08:54.593501 (+ 860us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:54.593513 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:54.593562 (+ 49us) server_negotiation.cc:407] Connection header received
0809 13:08:54.595693 (+ 2131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:54.595698 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:54.595930 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:54.596102 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:54.597999 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:54.599223 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:54.601545 (+ 2322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:54.602097 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:54.602229 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:54.606615 (+ 4386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:54.606624 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:54.606636 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:54.606666 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:54.609715 (+ 3049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:54.610513 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:54.610520 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:54.610523 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:54.610679 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:54.611135 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:54.611145 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:54.611149 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:54.611697 (+ 548us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:54.611925 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:54.612535 (+ 610us) server_negotiation.cc:299] Negotiation successful
0809 13:08:54.612980 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":666,"thread_start_us":475,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.253@KRBTEST.COM" created.
I20260809 13:08:54.618117 31780 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.253" port: 35645 } has no permanent_uuid. Determining permanent_uuid...
I20260809 13:08:54.619323 31783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:54.618860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:35645 (local address 127.0.0.1:38272)
0809 13:08:54.619062 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:54.619194 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:35645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260809 13:08:54.619659 31715 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.155.253:35645: connect: Connection refused (error 111)
I20260809 13:08:54.621425 31783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:54.621001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:35645 (local address 127.0.0.1:38280)
0809 13:08:54.621188 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:54.621263 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:35645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260809 13:08:54.621625 31780 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.253:35645: Network error: Client connection negotiation failed: client connection to 127.28.155.253:35645: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.253.keytab.
Entry for principal kudu/127.28.155.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.253.keytab.
I20260809 13:08:54.657737 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.253:35645
--webserver_interface=127.28.155.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.253.keytab
--principal=kudu/127.28.155.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:40209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:46641,127.28.155.253:35645,127.28.155.252:38727
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 13:08:54.671036 31780 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.253" port: 35645 } attempt: 1
I20260809 13:08:54.672566 31783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:54.671992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:35645 (local address 127.0.0.1:38292)
0809 13:08:54.672223 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:54.672360 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:35645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260809 13:08:54.673674 31783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:54.673277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:35645 (local address 127.0.0.1:38306)
0809 13:08:54.673451 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:54.673531 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:35645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260809 13:08:54.673858 31780 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.253:35645: Network error: Client connection negotiation failed: client connection to 127.28.155.253:35645: connect: Connection refused (error 111)
I20260809 13:08:54.742152 31780 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.253" port: 35645 } attempt: 2
I20260809 13:08:54.743539 31783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:54.743014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:35645 (local address 127.0.0.1:38318)
0809 13:08:54.743282 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:54.743379 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:35645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260809 13:08:54.744753 31783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:54.744275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:35645 (local address 127.0.0.1:38334)
0809 13:08:54.744468 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:54.744610 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:35645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260809 13:08:54.744943 31780 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.253:35645: Network error: Client connection negotiation failed: client connection to 127.28.155.253:35645: connect: Connection refused (error 111)
I20260809 13:08:54.836201 31780 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.253" port: 35645 } attempt: 3
I20260809 13:08:54.837574 31783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:54.837094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:35645 (local address 127.0.0.1:38342)
0809 13:08:54.837316 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:54.837418 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:35645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260809 13:08:54.838784 31783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:54.838379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:35645 (local address 127.0.0.1:38352)
0809 13:08:54.838555 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:54.838629 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:35645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260809 13:08:54.838971 31780 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.253:35645: Network error: Client connection negotiation failed: client connection to 127.28.155.253:35645: connect: Connection refused (error 111)
I20260809 13:08:54.982235 31780 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.253" port: 35645 } attempt: 4
I20260809 13:08:54.983651 31783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:54.983043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:35645 (local address 127.0.0.1:38364)
0809 13:08:54.983390 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:54.983488 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:35645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189}
I20260809 13:08:54.984889 31783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:54.984440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:35645 (local address 127.0.0.1:38368)
0809 13:08:54.984648 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:54.984746 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:35645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
W20260809 13:08:54.985131 31780 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.253:35645: Network error: Client connection negotiation failed: client connection to 127.28.155.253:35645: connect: Connection refused (error 111)
W20260809 13:08:55.027050 31789 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 13:08:55.027472 31789 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:55.027611 31789 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:55.027757 31789 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:55.035717 31789 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:08:55.035871 31789 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:55.036012 31789 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:55.036108 31789 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:08:55.036238 31789 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:08:55.046937 31789 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:40209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:46641,127.28.155.253:35645,127.28.155.252:38727
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.253.keytab
--principal=kudu/127.28.155.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.253:35645
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.28.155.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:55.048430 31789 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:55.049943 31789 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:55.062703 31795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:55.062909 31796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:55.063035 31799 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:55.064339 31789 server_base.cc:1034] running on GCE node
I20260809 13:08:55.065311 31789 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:55.066975 31789 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:55.068243 31789 hybrid_clock.cc:648] HybridClock initialized: now 1786280935068176 us; error 47 us; skew 500 ppm
I20260809 13:08:55.068676 31789 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:08:55 dist-test-slave-jq4t krb5kdc[31666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280935, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:08:55.075227 31789 init.cc:377] Logged in from keytab as kudu/127.28.155.253@KRBTEST.COM (short username kudu)
I20260809 13:08:55.076973 31789 webserver.cc:460] Webserver started at http://127.28.155.253:44273/ using document root <none> and password file <none>
I20260809 13:08:55.077752 31789 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:55.077899 31789 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:55.078253 31789 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:55.081547 31789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-1/data/instance:
uuid: "991aff91f4a446ba8fb259638ba4c186"
format_stamp: "Formatted at 2026-08-09 13:08:55 on dist-test-slave-jq4t"
server_key: "ea6ef635c49a9c4d184d6d3435d987cb"
server_key_iv: "4cd80b05c9d8410eec3e951173292198"
server_key_version: "encryptionkey@0"
I20260809 13:08:55.082408 31789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-1/wal/instance:
uuid: "991aff91f4a446ba8fb259638ba4c186"
format_stamp: "Formatted at 2026-08-09 13:08:55 on dist-test-slave-jq4t"
server_key: "ea6ef635c49a9c4d184d6d3435d987cb"
server_key_iv: "4cd80b05c9d8410eec3e951173292198"
server_key_version: "encryptionkey@0"
I20260809 13:08:55.087944 31789 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 13:08:55.091557 31808 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:55.092967 31789 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 13:08:55.093168 31789 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-1/wal
uuid: "991aff91f4a446ba8fb259638ba4c186"
format_stamp: "Formatted at 2026-08-09 13:08:55 on dist-test-slave-jq4t"
server_key: "ea6ef635c49a9c4d184d6d3435d987cb"
server_key_iv: "4cd80b05c9d8410eec3e951173292198"
server_key_version: "encryptionkey@0"
I20260809 13:08:55.093425 31789 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:55.108430 31789 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:55.112836 31789 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:55.113148 31789 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:55.134158 31789 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.253:35645
I20260809 13:08:55.134182 31895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.253:35645 every 8 connection(s)
I20260809 13:08:55.135716 31789 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-1/data/info.pb
I20260809 13:08:55.139839 31896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:55.144423 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 31789
I20260809 13:08:55.144680 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-1/wal/instance
I20260809 13:08:55.145155 29295 external_mini_cluster.cc:1428] Setting key c044dc1feeb0b6673267471e1ff3ade1
I20260809 13:08:55.147020 31896 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46641 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 13:08:55 dist-test-slave-jq4t krb5kdc[31666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280935, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.253@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:08:55.173339 31900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.149909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60426 (local address 127.28.155.254:46641)
0809 13:08:55.150491 (+ 582us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:55.150498 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:55.151640 (+ 1142us) server_negotiation.cc:407] Connection header received
0809 13:08:55.154770 (+ 3130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:55.154775 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:55.154851 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:55.154957 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:55.157330 (+ 2373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.158103 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.160645 (+ 2542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.161227 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.161394 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:55.165515 (+ 4121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:55.165524 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:55.165532 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:55.165597 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:55.169589 (+ 3992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:55.170439 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:55.170448 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:55.170455 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:55.170621 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:55.171079 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:55.171087 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:55.171093 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:55.171524 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:55.171698 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:55.172531 (+ 833us) server_negotiation.cc:299] Negotiation successful
0809 13:08:55.172810 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":289,"threads_started":1}
I20260809 13:08:55.174064 31901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.150510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:46641 (local address 127.0.0.1:60426)
0809 13:08:55.151424 (+ 914us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:55.151487 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:55.154389 (+ 2902us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:55.155250 (+ 861us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:55.155264 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:55.156114 (+ 850us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:08:55.157050 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:55.157079 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.158295 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.158304 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:55.160444 (+ 2140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:55.160464 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.161503 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.161509 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:55.161746 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:55.162576 (+ 830us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:08:55.162599 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:08:55.165203 (+ 2604us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:08:55.169744 (+ 4541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:08:55.169753 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:08:55.169767 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:08:55.170276 (+ 509us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:08:55.170734 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:08:55.170738 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:08:55.170740 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:08:55.170949 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:08:55.171659 (+ 710us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:08:55.171666 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:08:55.172078 (+ 412us) client_negotiation.cc:769] Sending connection context
0809 13:08:55.172333 (+ 255us) client_negotiation.cc:240] Negotiation successful
0809 13:08:55.172825 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":346,"threads_started":1}
I20260809 13:08:55.176038 31896 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.253" port: 35645 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.28.155.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.252@KRBTEST.COM" created.
Aug 09 13:08:55 dist-test-slave-jq4t krb5kdc[31666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280935, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.253@KRBTEST.COM for kudu/127.28.155.253@KRBTEST.COM
I20260809 13:08:55.193356 31903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.177346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38370 (local address 127.28.155.253:35645)
0809 13:08:55.178163 (+ 817us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:55.178169 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:55.178196 (+ 27us) server_negotiation.cc:407] Connection header received
0809 13:08:55.178239 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:55.178244 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:55.178421 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:55.178595 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:55.179410 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.180575 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.181710 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.182264 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.182407 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:55.187121 (+ 4714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:55.187137 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:55.187154 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:55.187186 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:55.190205 (+ 3019us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:55.191084 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:55.191091 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:55.191093 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:55.191211 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:55.191653 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:55.191656 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:55.191658 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:55.192028 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:55.192187 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:55.192682 (+ 495us) server_negotiation.cc:299] Negotiation successful
0809 13:08:55.193044 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":125,"server-negotiator.queue_time_us":657,"thread_start_us":462,"threads_started":1}
I20260809 13:08:55.193398 31901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.176847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:35645 (local address 127.0.0.1:38370)
0809 13:08:55.177046 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:55.177067 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:55.177203 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:55.178580 (+ 1377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:55.178584 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:55.179081 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:08:55.179222 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:55.179231 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.180705 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.180713 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:55.181568 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:55.181579 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.182416 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.182421 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:55.182628 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:55.183255 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:08:55.183272 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:08:55.186839 (+ 3567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:08:55.190366 (+ 3527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:08:55.190374 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:08:55.190380 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:08:55.190946 (+ 566us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:08:55.191321 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:08:55.191328 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:08:55.191334 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:08:55.191544 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:08:55.192164 (+ 620us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:08:55.192172 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:08:55.192357 (+ 185us) client_negotiation.cc:769] Sending connection context
0809 13:08:55.192564 (+ 207us) client_negotiation.cc:240] Negotiation successful
0809 13:08:55.192910 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260809 13:08:55.195919 31896 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } has no permanent_uuid. Determining permanent_uuid...
I20260809 13:08:55.197328 31901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.196716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:38727 (local address 127.0.0.1:48342)
0809 13:08:55.196959 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:55.197108 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260809 13:08:55.197669 31809 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
I20260809 13:08:55.199596 31901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.199106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:38727 (local address 127.0.0.1:48356)
0809 13:08:55.199313 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:55.199422 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 13:08:55.199848 31896 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.252:38727: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.252.keytab.
Entry for principal kudu/127.28.155.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.252.keytab.
I20260809 13:08:55.228622 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.252:38727
--webserver_interface=127.28.155.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.252.keytab
--principal=kudu/127.28.155.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:40209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:46641,127.28.155.253:35645,127.28.155.252:38727
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 13:08:55.249225 31896 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } attempt: 1
I20260809 13:08:55.250635 31901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.250133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:38727 (local address 127.0.0.1:48370)
0809 13:08:55.250340 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:55.250463 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260809 13:08:55.251751 31901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.251372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:38727 (local address 127.0.0.1:48378)
0809 13:08:55.251564 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:55.251637 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260809 13:08:55.251966 31896 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.252:38727: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
I20260809 13:08:55.284407 31780 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.253" port: 35645 } attempt: 5
Aug 09 13:08:55 dist-test-slave-jq4t krb5kdc[31666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280934, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for kudu/127.28.155.253@KRBTEST.COM
I20260809 13:08:55.300858 31783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.285459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:35645 (local address 127.0.0.1:46402)
0809 13:08:55.285700 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:55.285723 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:55.285915 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:55.286463 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:55.286469 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:55.286881 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:08:55.287070 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:55.287079 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.288587 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.288599 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:55.289492 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:55.289503 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.290567 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.290571 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:55.290727 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:55.291486 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:08:55.291508 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:08:55.294007 (+ 2499us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:08:55.298342 (+ 4335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:08:55.298347 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:08:55.298350 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:08:55.298772 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:08:55.299211 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:08:55.299215 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:08:55.299217 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:08:55.299365 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:08:55.299998 (+ 633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:08:55.300001 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:08:55.300138 (+ 137us) client_negotiation.cc:769] Sending connection context
0809 13:08:55.300249 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 13:08:55.300586 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103}
I20260809 13:08:55.300997 31903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.285440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46402 (local address 127.28.155.253:35645)
0809 13:08:55.285648 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:55.285655 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:55.285807 (+ 152us) server_negotiation.cc:407] Connection header received
0809 13:08:55.286137 (+ 330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:55.286143 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:55.286260 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:55.286406 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:55.287239 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.288367 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.289658 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.290407 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.290571 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:55.294267 (+ 3696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:55.294277 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:55.294284 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:55.294338 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:55.298159 (+ 3821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:55.298901 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:55.298908 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:55.298911 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:55.299088 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:55.299473 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:55.299478 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:55.299481 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:55.299879 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:55.300048 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:55.300408 (+ 360us) server_negotiation.cc:299] Negotiation successful
0809 13:08:55.300688 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 13:08:55.302131 31780 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } has no permanent_uuid. Determining permanent_uuid...
I20260809 13:08:55.303264 31783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.302887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:38727 (local address 127.0.0.1:59508)
0809 13:08:55.303057 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:55.303136 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260809 13:08:55.304270 31783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.303933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:38727 (local address 127.0.0.1:59510)
0809 13:08:55.304085 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:55.304167 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 13:08:55.304546 31780 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.252:38727: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
I20260809 13:08:55.320199 31896 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } attempt: 2
I20260809 13:08:55.321404 31901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.320937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:38727 (local address 127.0.0.1:59512)
0809 13:08:55.321143 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:55.321241 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260809 13:08:55.322438 31901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.322104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:38727 (local address 127.0.0.1:59514)
0809 13:08:55.322257 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:55.322319 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 13:08:55.322660 31896 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.252:38727: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
I20260809 13:08:55.355880 31780 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } attempt: 1
I20260809 13:08:55.357438 31783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.356720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:38727 (local address 127.0.0.1:59520)
0809 13:08:55.357028 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:55.357179 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260809 13:08:55.358752 31783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.358210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:38727 (local address 127.0.0.1:59524)
0809 13:08:55.358433 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:55.358548 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260809 13:08:55.359062 31780 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.252:38727: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
I20260809 13:08:55.413877 31896 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } attempt: 3
I20260809 13:08:55.415127 31901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.414629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:38727 (local address 127.0.0.1:59530)
0809 13:08:55.414837 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:55.414952 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260809 13:08:55.416320 31901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.415885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:38727 (local address 127.0.0.1:59536)
0809 13:08:55.416134 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:55.416207 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142}
W20260809 13:08:55.416569 31896 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.252:38727: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
I20260809 13:08:55.427346 31780 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } attempt: 2
I20260809 13:08:55.428783 31783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.428093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:38727 (local address 127.0.0.1:59544)
0809 13:08:55.428396 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:55.428555 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260809 13:08:55.429878 31783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.429489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:38727 (local address 127.0.0.1:59548)
0809 13:08:55.429635 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:55.429723 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 13:08:55.430143 31780 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.252:38727: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
I20260809 13:08:55.536381 31780 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } attempt: 3
I20260809 13:08:55.537667 31783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.537187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:38727 (local address 127.0.0.1:59552)
0809 13:08:55.537393 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:55.537492 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260809 13:08:55.538779 31783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.538404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:38727 (local address 127.0.0.1:59560)
0809 13:08:55.538599 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:55.538677 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
W20260809 13:08:55.539027 31780 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.252:38727: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
I20260809 13:08:55.559789 31896 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } attempt: 4
I20260809 13:08:55.561018 31901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.560455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:38727 (local address 127.0.0.1:59566)
0809 13:08:55.560746 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:55.560843 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
I20260809 13:08:55.562119 31901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.561781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:38727 (local address 127.0.0.1:59572)
0809 13:08:55.561932 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:55.562011 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 13:08:55.562333 31896 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.252:38727: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
W20260809 13:08:55.610424 31908 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 13:08:55.610846 31908 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:55.610980 31908 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:55.611116 31908 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:55.618765 31908 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:08:55.618914 31908 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:55.619038 31908 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:55.619124 31908 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:08:55.619235 31908 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:08:55.629606 31908 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:40209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:46641,127.28.155.253:35645,127.28.155.252:38727
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.252.keytab
--principal=kudu/127.28.155.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.252:38727
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.28.155.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:55.631168 31908 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:55.632601 31908 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:55.645123 31915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:55.645256 31919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:55.645277 31916 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:55.646242 31908 server_base.cc:1034] running on GCE node
I20260809 13:08:55.647094 31908 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:55.648564 31908 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:55.649827 31908 hybrid_clock.cc:648] HybridClock initialized: now 1786280935649760 us; error 54 us; skew 500 ppm
I20260809 13:08:55.650183 31908 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:08:55 dist-test-slave-jq4t krb5kdc[31666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280935, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:08:55.653987 31908 init.cc:377] Logged in from keytab as kudu/127.28.155.252@KRBTEST.COM (short username kudu)
I20260809 13:08:55.655696 31908 webserver.cc:460] Webserver started at http://127.28.155.252:39977/ using document root <none> and password file <none>
I20260809 13:08:55.656582 31908 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:55.656716 31908 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:55.657070 31908 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:55.660205 31908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-2/data/instance:
uuid: "442516dcaa9b49f58cf912a83014b279"
format_stamp: "Formatted at 2026-08-09 13:08:55 on dist-test-slave-jq4t"
server_key: "addef02742d36865a3a362ddc1db0c17"
server_key_iv: "b0bb47d3bea4b9ab8e7c3b7d73e80d96"
server_key_version: "encryptionkey@0"
I20260809 13:08:55.661116 31908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-2/wal/instance:
uuid: "442516dcaa9b49f58cf912a83014b279"
format_stamp: "Formatted at 2026-08-09 13:08:55 on dist-test-slave-jq4t"
server_key: "addef02742d36865a3a362ddc1db0c17"
server_key_iv: "b0bb47d3bea4b9ab8e7c3b7d73e80d96"
server_key_version: "encryptionkey@0"
I20260809 13:08:55.666663 31908 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 13:08:55.670215 31930 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:55.671610 31908 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 13:08:55.671819 31908 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-2/wal
uuid: "442516dcaa9b49f58cf912a83014b279"
format_stamp: "Formatted at 2026-08-09 13:08:55 on dist-test-slave-jq4t"
server_key: "addef02742d36865a3a362ddc1db0c17"
server_key_iv: "b0bb47d3bea4b9ab8e7c3b7d73e80d96"
server_key_version: "encryptionkey@0"
I20260809 13:08:55.672065 31908 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:55.698366 31908 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:55.702742 31908 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:55.703068 31908 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:55.716287 31780 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } attempt: 4
I20260809 13:08:55.717628 31783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.717167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:38727 (local address 127.0.0.1:59588)
0809 13:08:55.717362 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:55.717468 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 13:08:55.718701 31783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.718352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:38727 (local address 127.0.0.1:59604)
0809 13:08:55.718510 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:55.718584 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260809 13:08:55.718951 31780 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.252:38727: Network error: Client connection negotiation failed: client connection to 127.28.155.252:38727: connect: Connection refused (error 111)
I20260809 13:08:55.723384 31908 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.252:38727
I20260809 13:08:55.723392 31999 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.252:38727 every 8 connection(s)
I20260809 13:08:55.725075 31908 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-2/data/info.pb
I20260809 13:08:55.729243 32000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:55.734956 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 31908
I20260809 13:08:55.735168 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786280548611909-29295-0/minicluster-data/master-2/wal/instance
I20260809 13:08:55.735642 29295 external_mini_cluster.cc:1428] Setting key 87f4da0d68f9424f898948f7ebf1263d
I20260809 13:08:55.737016 32000 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46641 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 13:08:55 dist-test-slave-jq4t krb5kdc[31666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280935, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.252@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
Aug 09 13:08:55 dist-test-slave-jq4t krb5kdc[31666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280933, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.252@KRBTEST.COM
I20260809 13:08:55.757213 32006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.740241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33208 (local address 127.28.155.254:46641)
0809 13:08:55.741914 (+ 1673us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:55.741925 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:55.741941 (+ 16us) server_negotiation.cc:407] Connection header received
0809 13:08:55.741994 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:55.741997 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:55.742065 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:55.742197 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:55.743540 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.744333 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.745902 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.746300 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.746440 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:55.750277 (+ 3837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:55.750284 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:55.750291 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:55.750337 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:55.753931 (+ 3594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:55.754775 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:55.754782 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:55.754786 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:55.754961 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:55.755361 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:55.755364 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:55.755366 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:55.755634 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:55.755796 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:55.756546 (+ 750us) server_negotiation.cc:299] Negotiation successful
0809 13:08:55.756774 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1577,"thread_start_us":1449,"threads_started":1}
I20260809 13:08:55.758499 32004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.737747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59606 (local address 127.28.155.252:38727)
0809 13:08:55.738634 (+ 887us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:55.738649 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:55.738705 (+ 56us) server_negotiation.cc:407] Connection header received
0809 13:08:55.741195 (+ 2490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:55.741223 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:55.741540 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:55.741739 (+ 199us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:55.743387 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.744681 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.745982 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.746527 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.746736 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:55.751307 (+ 4571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:55.751316 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:55.751332 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:55.751377 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:55.754954 (+ 3577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:55.755921 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:55.755928 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:55.755930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:55.756072 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:55.756469 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:55.756522 (+ 53us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:55.756528 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:55.756881 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:55.757228 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:55.757691 (+ 463us) server_negotiation.cc:299] Negotiation successful
0809 13:08:55.757942 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":55,"server-negotiator.queue_time_us":625,"thread_start_us":375,"threads_started":1}
I20260809 13:08:55.758548 32007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.740251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:46641 (local address 127.0.0.1:33208)
0809 13:08:55.741080 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:55.741126 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:55.741429 (+ 303us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:55.742286 (+ 857us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:55.742296 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:55.742965 (+ 669us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:08:55.743343 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:55.743360 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.744540 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.744544 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:55.745740 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:55.745751 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.746555 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.746562 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:55.746731 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:55.747534 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:08:55.747556 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:08:55.750049 (+ 2493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:08:55.754084 (+ 4035us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:08:55.754095 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:08:55.754105 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:08:55.754632 (+ 527us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:08:55.755077 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:08:55.755080 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:08:55.755082 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:08:55.755257 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:08:55.755772 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:08:55.755781 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:08:55.756136 (+ 355us) client_negotiation.cc:769] Sending connection context
0809 13:08:55.756426 (+ 290us) client_negotiation.cc:240] Negotiation successful
0809 13:08:55.756982 (+ 556us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":566,"mutex_wait_us":43,"spinlock_wait_cycles":13056,"thread_start_us":388,"threads_started":1}
I20260809 13:08:55.760346 32000 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.253" port: 35645 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 13:08:55 dist-test-slave-jq4t krb5kdc[31666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280935, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.252@KRBTEST.COM for kudu/127.28.155.253@KRBTEST.COM
Aug 09 13:08:55 dist-test-slave-jq4t krb5kdc[31666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280933, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:08:55.774173 32007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.761086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:35645 (local address 127.0.0.1:46406)
0809 13:08:55.761365 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:55.761385 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:55.761508 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:55.761993 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:55.761998 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:55.762469 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:08:55.762648 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:55.762656 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.763645 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.763652 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:55.764616 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:55.764628 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.765361 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.765367 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:55.765558 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:55.766157 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:08:55.766173 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:08:55.768357 (+ 2184us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:08:55.771686 (+ 3329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:08:55.771691 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:08:55.771695 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:08:55.772064 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:08:55.772464 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:08:55.772469 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:08:55.772510 (+ 41us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:08:55.772666 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:08:55.773190 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:08:55.773195 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:08:55.773350 (+ 155us) client_negotiation.cc:769] Sending connection context
0809 13:08:55.773509 (+ 159us) client_negotiation.cc:240] Negotiation successful
0809 13:08:55.773794 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163}
I20260809 13:08:55.774209 31903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.761290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46406 (local address 127.28.155.253:35645)
0809 13:08:55.761509 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:55.761515 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:55.761541 (+ 26us) server_negotiation.cc:407] Connection header received
0809 13:08:55.761621 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:55.761625 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:55.761685 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:55.761795 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:55.762803 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.763501 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.764769 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.765200 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.765338 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:55.768587 (+ 3249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:55.768592 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:55.768595 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:55.768628 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:55.771544 (+ 2916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:55.772194 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:55.772200 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:55.772203 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:55.772342 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:55.772781 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:55.772786 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:55.772789 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:55.773066 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:55.773224 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:55.773603 (+ 379us) server_negotiation.cc:299] Negotiation successful
0809 13:08:55.773818 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 13:08:55.775279 32000 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } has no permanent_uuid. Determining permanent_uuid...
I20260809 13:08:55.776767 32006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.761871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33220 (local address 127.28.155.254:46641)
0809 13:08:55.762055 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:55.762062 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:55.762081 (+ 19us) server_negotiation.cc:407] Connection header received
0809 13:08:55.762168 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:55.762174 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:55.762251 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:55.762358 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:55.763549 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.764221 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.765470 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.766060 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.766217 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:55.770641 (+ 4424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:55.770649 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:55.770658 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:55.770690 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:55.773444 (+ 2754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:55.774131 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:55.774137 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:55.774141 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:55.774441 (+ 300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:55.774890 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:55.774894 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:55.774896 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:55.775366 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:55.775671 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:55.776110 (+ 439us) server_negotiation.cc:299] Negotiation successful
0809 13:08:55.776378 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
Aug 09 13:08:55 dist-test-slave-jq4t krb5kdc[31666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280935, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.252@KRBTEST.COM for kudu/127.28.155.252@KRBTEST.COM
Aug 09 13:08:55 dist-test-slave-jq4t krb5kdc[31666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280933, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.253@KRBTEST.COM
I20260809 13:08:55.790143 32007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.776102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:38727 (local address 127.0.0.1:59608)
0809 13:08:55.776283 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:55.776303 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:55.776399 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:55.777021 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:55.777025 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:55.777461 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:08:55.777606 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:55.777614 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.778661 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.778666 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:55.779580 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:55.779592 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.780294 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.780299 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:55.780546 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:55.781154 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:08:55.781171 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:08:55.783153 (+ 1982us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:08:55.787181 (+ 4028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:08:55.787186 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:08:55.787191 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:08:55.787727 (+ 536us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:08:55.788222 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:08:55.788230 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:08:55.788234 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:08:55.788418 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:08:55.789130 (+ 712us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:08:55.789134 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:08:55.789264 (+ 130us) client_negotiation.cc:769] Sending connection context
0809 13:08:55.789416 (+ 152us) client_negotiation.cc:240] Negotiation successful
0809 13:08:55.789657 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 13:08:55.790182 32004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.776102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59608 (local address 127.28.155.252:38727)
0809 13:08:55.776610 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:55.776616 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:55.776631 (+ 15us) server_negotiation.cc:407] Connection header received
0809 13:08:55.776670 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:55.776674 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:55.776737 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:55.776831 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:55.777755 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.778486 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.779723 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.780140 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.780273 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:55.783322 (+ 3049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:55.783329 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:55.783333 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:55.783368 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:55.787014 (+ 3646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:55.787910 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:55.787917 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:55.787921 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:55.788070 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:55.788614 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:55.788618 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:55.788620 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:55.788956 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:55.789118 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:55.789555 (+ 437us) server_negotiation.cc:299] Negotiation successful
0809 13:08:55.789799 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400}
I20260809 13:08:55.795010 31903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.778758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46420 (local address 127.28.155.253:35645)
0809 13:08:55.778959 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:55.778962 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:55.778976 (+ 14us) server_negotiation.cc:407] Connection header received
0809 13:08:55.779017 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:55.779020 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:55.779070 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:55.779174 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:55.780368 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.781149 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.782416 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.782901 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.783055 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:55.789027 (+ 5972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:55.789037 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:55.789043 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:55.789083 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:55.792337 (+ 3254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:55.793188 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:55.793192 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:55.793194 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:55.793330 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:55.793740 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:55.793744 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:55.793746 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:55.793995 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:55.794206 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:55.794570 (+ 364us) server_negotiation.cc:299] Negotiation successful
0809 13:08:55.794738 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 13:08:55.796639 32000 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 442516dcaa9b49f58cf912a83014b279: Bootstrap starting.
I20260809 13:08:55.800349 29295 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 13:08:55.800835 32000 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 442516dcaa9b49f58cf912a83014b279: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:55.802205 32000 log.cc:824] T 00000000000000000000000000000000 P 442516dcaa9b49f58cf912a83014b279: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:55.805730 32000 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 442516dcaa9b49f58cf912a83014b279: No bootstrap required, opened a new log
I20260809 13:08:55.804088 31746 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "0773267ed5f148a0a1aa6ef2b5cd5961"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33220
I20260809 13:08:55.817029 32000 raft_consensus.cc:348] T 00000000000000000000000000000000 P 442516dcaa9b49f58cf912a83014b279 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0773267ed5f148a0a1aa6ef2b5cd5961" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46641 } } peers { permanent_uuid: "991aff91f4a446ba8fb259638ba4c186" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 35645 } } peers { permanent_uuid: "442516dcaa9b49f58cf912a83014b279" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } }
I20260809 13:08:55.817504 32000 raft_consensus.cc:729] T 00000000000000000000000000000000 P 442516dcaa9b49f58cf912a83014b279 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 442516dcaa9b49f58cf912a83014b279, State: Initialized, Role: FOLLOWER
I20260809 13:08:55.818058 32000 consensus_queue.cc:260] T 00000000000000000000000000000000 P 442516dcaa9b49f58cf912a83014b279 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0773267ed5f148a0a1aa6ef2b5cd5961" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46641 } } peers { permanent_uuid: "991aff91f4a446ba8fb259638ba4c186" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 35645 } } peers { permanent_uuid: "442516dcaa9b49f58cf912a83014b279" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } }
I20260809 13:08:55.819069 32011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 442516dcaa9b49f58cf912a83014b279 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0773267ed5f148a0a1aa6ef2b5cd5961" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46641 } } peers { permanent_uuid: "991aff91f4a446ba8fb259638ba4c186" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 35645 } } peers { permanent_uuid: "442516dcaa9b49f58cf912a83014b279" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } } }
I20260809 13:08:55.819437 32011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 442516dcaa9b49f58cf912a83014b279 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 13:08:55.820470 32000 sys_catalog.cc:564] T 00000000000000000000000000000000 P 442516dcaa9b49f58cf912a83014b279 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 13:08:55.830367 32031 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 442516dcaa9b49f58cf912a83014b279: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 13:08:55.830502 32031 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 13:08:55.827988 31908 master_runner.cc:186] Error getting master registration for 127.28.155.254:46641: OK, instance_id { permanent_uuid: "0773267ed5f148a0a1aa6ef2b5cd5961" instance_seqno: 1786280934564575 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 13:08:55.839988 31908 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 13:08:55.861545 31896 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } attempt: 5
Aug 09 13:08:55 dist-test-slave-jq4t krb5kdc[31666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280935, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.253@KRBTEST.COM for kudu/127.28.155.252@KRBTEST.COM
I20260809 13:08:55.878669 31901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.862371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:38727 (local address 127.0.0.1:59616)
0809 13:08:55.862623 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:55.862647 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:55.862805 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:55.863238 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:55.863244 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:55.863831 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:08:55.864079 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:55.864093 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.865682 (+ 1589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.865689 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:55.867154 (+ 1465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:55.867173 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.868019 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.868025 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:55.868270 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:55.869041 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:08:55.869060 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:08:55.871282 (+ 2222us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:08:55.875507 (+ 4225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:08:55.875511 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:08:55.875515 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:08:55.876130 (+ 615us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:08:55.876599 (+ 469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:08:55.876603 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:08:55.876607 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:08:55.876775 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:08:55.877574 (+ 799us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:08:55.877580 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:08:55.877746 (+ 166us) client_negotiation.cc:769] Sending connection context
0809 13:08:55.877929 (+ 183us) client_negotiation.cc:240] Negotiation successful
0809 13:08:55.878235 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87}
I20260809 13:08:55.878695 32004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.862451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59616 (local address 127.28.155.252:38727)
0809 13:08:55.862668 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:55.862672 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:55.862748 (+ 76us) server_negotiation.cc:407] Connection header received
0809 13:08:55.862952 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:55.862960 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:55.863056 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:55.863169 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:55.864247 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.865453 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.867306 (+ 1853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:55.867843 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:55.867986 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:55.871488 (+ 3502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:55.871495 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:55.871500 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:55.871542 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:55.875336 (+ 3794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:55.876270 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:55.876276 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:55.876280 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:55.876459 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:55.876893 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:55.876903 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:55.876907 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:55.877440 (+ 533us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:55.877613 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:55.878032 (+ 419us) server_negotiation.cc:299] Negotiation successful
0809 13:08:55.878295 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 13:08:55.883533 31896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 991aff91f4a446ba8fb259638ba4c186: Bootstrap starting.
I20260809 13:08:55.886929 31896 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 991aff91f4a446ba8fb259638ba4c186: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:55.888361 31896 log.cc:824] T 00000000000000000000000000000000 P 991aff91f4a446ba8fb259638ba4c186: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:55.891278 31896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 991aff91f4a446ba8fb259638ba4c186: No bootstrap required, opened a new log
I20260809 13:08:55.902763 31896 raft_consensus.cc:348] T 00000000000000000000000000000000 P 991aff91f4a446ba8fb259638ba4c186 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0773267ed5f148a0a1aa6ef2b5cd5961" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46641 } } peers { permanent_uuid: "991aff91f4a446ba8fb259638ba4c186" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 35645 } } peers { permanent_uuid: "442516dcaa9b49f58cf912a83014b279" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } }
I20260809 13:08:55.903244 31896 raft_consensus.cc:729] T 00000000000000000000000000000000 P 991aff91f4a446ba8fb259638ba4c186 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 991aff91f4a446ba8fb259638ba4c186, State: Initialized, Role: FOLLOWER
I20260809 13:08:55.903832 31896 consensus_queue.cc:260] T 00000000000000000000000000000000 P 991aff91f4a446ba8fb259638ba4c186 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0773267ed5f148a0a1aa6ef2b5cd5961" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46641 } } peers { permanent_uuid: "991aff91f4a446ba8fb259638ba4c186" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 35645 } } peers { permanent_uuid: "442516dcaa9b49f58cf912a83014b279" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } }
I20260809 13:08:55.905045 32034 sys_catalog.cc:455] T 00000000000000000000000000000000 P 991aff91f4a446ba8fb259638ba4c186 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0773267ed5f148a0a1aa6ef2b5cd5961" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46641 } } peers { permanent_uuid: "991aff91f4a446ba8fb259638ba4c186" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 35645 } } peers { permanent_uuid: "442516dcaa9b49f58cf912a83014b279" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } } }
I20260809 13:08:55.905514 32034 sys_catalog.cc:458] T 00000000000000000000000000000000 P 991aff91f4a446ba8fb259638ba4c186 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 13:08:55.906440 31896 sys_catalog.cc:564] T 00000000000000000000000000000000 P 991aff91f4a446ba8fb259638ba4c186 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 13:08:55.918421 32053 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 991aff91f4a446ba8fb259638ba4c186: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 13:08:55.918677 32053 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 13:08:55.915262 31789 master_runner.cc:186] Error getting master registration for 127.28.155.254:46641: OK, instance_id { permanent_uuid: "0773267ed5f148a0a1aa6ef2b5cd5961" instance_seqno: 1786280934564575 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 13:08:55.927194 31789 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 13:08:55.955516 31937 tablet.cc:2369] T 00000000000000000000000000000000 P 442516dcaa9b49f58cf912a83014b279: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:08:55.996248 31780 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } attempt: 5
Aug 09 13:08:56 dist-test-slave-jq4t krb5kdc[31666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280934, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for kudu/127.28.155.252@KRBTEST.COM
I20260809 13:08:56.016067 31783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.997161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:38727 (local address 127.0.0.1:59630)
0809 13:08:55.997490 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:55.997513 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:55.997662 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:55.998113 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:55.998120 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:55.998729 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:08:55.998977 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:55.998990 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:56.000650 (+ 1660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:56.000656 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:56.002218 (+ 1562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:56.002235 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:56.003582 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:56.003589 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:56.003801 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:56.004615 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:08:56.004643 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:08:56.007876 (+ 3233us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:08:56.012808 (+ 4932us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:08:56.012814 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:08:56.012818 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:08:56.013436 (+ 618us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:08:56.013959 (+ 523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:08:56.013965 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:08:56.013970 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:08:56.014158 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:08:56.014910 (+ 752us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:08:56.014916 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:08:56.015127 (+ 211us) client_negotiation.cc:769] Sending connection context
0809 13:08:56.015285 (+ 158us) client_negotiation.cc:240] Negotiation successful
0809 13:08:56.015614 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195}
I20260809 13:08:56.017305 32004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:55.997269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59630 (local address 127.28.155.252:38727)
0809 13:08:55.997493 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:55.997500 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:55.997677 (+ 177us) server_negotiation.cc:407] Connection header received
0809 13:08:55.997798 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:55.997804 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:55.997912 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:55.998059 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:55.999194 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:56.000432 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:56.002411 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:56.003196 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:56.003321 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:56.008188 (+ 4867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:56.008195 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:56.008200 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:56.008246 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:56.012647 (+ 4401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:56.013595 (+ 948us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:56.013602 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:56.013606 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:56.013795 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:56.014284 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:56.014291 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:56.014296 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:56.014679 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:56.014833 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:56.016611 (+ 1778us) server_negotiation.cc:299] Negotiation successful
0809 13:08:56.016895 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 13:08:56.024760 31780 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0773267ed5f148a0a1aa6ef2b5cd5961: Bootstrap starting.
I20260809 13:08:56.029409 31780 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0773267ed5f148a0a1aa6ef2b5cd5961: Neither blocks nor log segments found. Creating new log.
I20260809 13:08:56.030930 31780 log.cc:824] T 00000000000000000000000000000000 P 0773267ed5f148a0a1aa6ef2b5cd5961: Log is configured to *not* fsync() on all Append() calls
I20260809 13:08:56.034884 31780 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0773267ed5f148a0a1aa6ef2b5cd5961: No bootstrap required, opened a new log
I20260809 13:08:56.046298 31780 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0773267ed5f148a0a1aa6ef2b5cd5961 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0773267ed5f148a0a1aa6ef2b5cd5961" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46641 } } peers { permanent_uuid: "991aff91f4a446ba8fb259638ba4c186" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 35645 } } peers { permanent_uuid: "442516dcaa9b49f58cf912a83014b279" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } }
I20260809 13:08:56.046772 31780 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0773267ed5f148a0a1aa6ef2b5cd5961 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0773267ed5f148a0a1aa6ef2b5cd5961, State: Initialized, Role: FOLLOWER
I20260809 13:08:56.047333 31780 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0773267ed5f148a0a1aa6ef2b5cd5961 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0773267ed5f148a0a1aa6ef2b5cd5961" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46641 } } peers { permanent_uuid: "991aff91f4a446ba8fb259638ba4c186" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 35645 } } peers { permanent_uuid: "442516dcaa9b49f58cf912a83014b279" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } }
I20260809 13:08:56.048785 32056 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0773267ed5f148a0a1aa6ef2b5cd5961 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0773267ed5f148a0a1aa6ef2b5cd5961" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46641 } } peers { permanent_uuid: "991aff91f4a446ba8fb259638ba4c186" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 35645 } } peers { permanent_uuid: "442516dcaa9b49f58cf912a83014b279" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } } }
I20260809 13:08:56.049559 32056 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0773267ed5f148a0a1aa6ef2b5cd5961 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 13:08:56.050083 31780 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0773267ed5f148a0a1aa6ef2b5cd5961 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:08:56.050174 31746 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0773267ed5f148a0a1aa6ef2b5cd5961 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 13:08:56.050395 31746 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0773267ed5f148a0a1aa6ef2b5cd5961 [term 0 FOLLOWER]: Advancing to term 1
W20260809 13:08:56.052721 31719 tablet.cc:2369] T 00000000000000000000000000000000 P 0773267ed5f148a0a1aa6ef2b5cd5961: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:08:56.054059 31746 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0773267ed5f148a0a1aa6ef2b5cd5961 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0773267ed5f148a0a1aa6ef2b5cd5961" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46641 } } peers { permanent_uuid: "991aff91f4a446ba8fb259638ba4c186" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 35645 } } peers { permanent_uuid: "442516dcaa9b49f58cf912a83014b279" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } }
I20260809 13:08:56.056303 31746 leader_election.cc:288] T 00000000000000000000000000000000 P 0773267ed5f148a0a1aa6ef2b5cd5961 [CANDIDATE]: Term 1 election: Requested vote from peers 991aff91f4a446ba8fb259638ba4c186 (127.28.155.253:35645), 442516dcaa9b49f58cf912a83014b279 (127.28.155.252:38727)
I20260809 13:08:56.056653 31852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0773267ed5f148a0a1aa6ef2b5cd5961" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "991aff91f4a446ba8fb259638ba4c186"
I20260809 13:08:56.057236 31852 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 991aff91f4a446ba8fb259638ba4c186 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:56.065914 31964 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0773267ed5f148a0a1aa6ef2b5cd5961" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "442516dcaa9b49f58cf912a83014b279"
I20260809 13:08:56.066548 31964 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 442516dcaa9b49f58cf912a83014b279 [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:08:56.069834 31852 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 991aff91f4a446ba8fb259638ba4c186 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0773267ed5f148a0a1aa6ef2b5cd5961 in term 1.
I20260809 13:08:56.070690 31715 leader_election.cc:302] T 00000000000000000000000000000000 P 0773267ed5f148a0a1aa6ef2b5cd5961 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0773267ed5f148a0a1aa6ef2b5cd5961, 991aff91f4a446ba8fb259638ba4c186; no voters:
I20260809 13:08:56.071295 32056 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0773267ed5f148a0a1aa6ef2b5cd5961 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:08:56.072465 31964 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 442516dcaa9b49f58cf912a83014b279 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0773267ed5f148a0a1aa6ef2b5cd5961 in term 1.
I20260809 13:08:56.083438 32056 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0773267ed5f148a0a1aa6ef2b5cd5961 [term 1 LEADER]: Becoming Leader. State: Replica: 0773267ed5f148a0a1aa6ef2b5cd5961, State: Running, Role: LEADER
I20260809 13:08:56.084326 32056 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0773267ed5f148a0a1aa6ef2b5cd5961 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0773267ed5f148a0a1aa6ef2b5cd5961" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46641 } } peers { permanent_uuid: "991aff91f4a446ba8fb259638ba4c186" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 35645 } } peers { permanent_uuid: "442516dcaa9b49f58cf912a83014b279" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } }
I20260809 13:08:56.092353 32067 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0773267ed5f148a0a1aa6ef2b5cd5961 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0773267ed5f148a0a1aa6ef2b5cd5961. Latest consensus state: current_term: 1 leader_uuid: "0773267ed5f148a0a1aa6ef2b5cd5961" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0773267ed5f148a0a1aa6ef2b5cd5961" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46641 } } peers { permanent_uuid: "991aff91f4a446ba8fb259638ba4c186" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 35645 } } peers { permanent_uuid: "442516dcaa9b49f58cf912a83014b279" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } } }
I20260809 13:08:56.092960 32067 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0773267ed5f148a0a1aa6ef2b5cd5961 [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:56.095477 32077 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260809 13:08:56.115998 31814 tablet.cc:2369] T 00000000000000000000000000000000 P 991aff91f4a446ba8fb259638ba4c186: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:08:56.118583 32077 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:08:56.169487 32006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:56.103025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33236 (local address 127.28.155.254:46641)
0809 13:08:56.103221 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:56.103228 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:56.112535 (+ 9307us) server_negotiation.cc:407] Connection header received
0809 13:08:56.114035 (+ 1500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:56.114041 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:56.114131 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:56.114214 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:56.119320 (+ 5106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:56.120539 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:56.124696 (+ 4157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:56.125416 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:56.125522 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:56.153161 (+ 27639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:56.153168 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:56.153174 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:56.153223 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:56.157460 (+ 4237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:56.160592 (+ 3132us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:56.160600 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:56.160607 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:56.160779 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:56.161663 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:56.161668 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:56.161672 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:56.162119 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:56.162415 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:56.168756 (+ 6341us) server_negotiation.cc:299] Negotiation successful
0809 13:08:56.169099 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 13:08:56.179018 31964 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 442516dcaa9b49f58cf912a83014b279 [term 1 FOLLOWER]: Refusing update from remote peer 0773267ed5f148a0a1aa6ef2b5cd5961: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:08:56.179486 32103 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 13:08:56.180333 32067 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0773267ed5f148a0a1aa6ef2b5cd5961 [LEADER]: Connected to new peer: Peer: permanent_uuid: "442516dcaa9b49f58cf912a83014b279" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:08:56.187757 31852 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 991aff91f4a446ba8fb259638ba4c186 [term 1 FOLLOWER]: Refusing update from remote peer 0773267ed5f148a0a1aa6ef2b5cd5961: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:08:56.193414 32067 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0773267ed5f148a0a1aa6ef2b5cd5961 [LEADER]: Connected to new peer: Peer: permanent_uuid: "991aff91f4a446ba8fb259638ba4c186" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 35645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:08:56.197041 32004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:56.110284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59636 (local address 127.28.155.252:38727)
0809 13:08:56.110549 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:56.110558 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:56.125595 (+ 15037us) server_negotiation.cc:407] Connection header received
0809 13:08:56.126692 (+ 1097us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:56.126699 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:56.126812 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:56.126894 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:56.135767 (+ 8873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:56.136990 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:56.150654 (+ 13664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:56.151568 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:56.151729 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:56.179800 (+ 28071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:56.179807 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:56.179812 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:56.179871 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:56.183783 (+ 3912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:56.184787 (+ 1004us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:56.184793 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:56.184797 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:56.184990 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:56.185474 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:56.185479 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:56.185483 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:56.185913 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:56.186204 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:56.196285 (+ 10081us) server_negotiation.cc:299] Negotiation successful
0809 13:08:56.196621 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260809 13:08:56.200821 31903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:56.126346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46432 (local address 127.28.155.253:35645)
0809 13:08:56.126532 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:56.126539 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:56.130863 (+ 4324us) server_negotiation.cc:407] Connection header received
0809 13:08:56.131707 (+ 844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:56.131713 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:56.131806 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:56.131896 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:56.158558 (+ 26662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:56.159833 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:56.174790 (+ 14957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:56.175571 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:56.175686 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:56.190929 (+ 15243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:56.190936 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:56.190941 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:56.190990 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:56.195151 (+ 4161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:56.198007 (+ 2856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:56.198015 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:56.198018 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:56.198194 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:56.198731 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:56.198737 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:56.198740 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:56.199167 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:56.199414 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:56.200062 (+ 648us) server_negotiation.cc:299] Negotiation successful
0809 13:08:56.200346 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 13:08:56.208820 32011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 442516dcaa9b49f58cf912a83014b279 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0773267ed5f148a0a1aa6ef2b5cd5961. Latest consensus state: current_term: 1 leader_uuid: "0773267ed5f148a0a1aa6ef2b5cd5961" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0773267ed5f148a0a1aa6ef2b5cd5961" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46641 } } peers { permanent_uuid: "991aff91f4a446ba8fb259638ba4c186" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 35645 } } peers { permanent_uuid: "442516dcaa9b49f58cf912a83014b279" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } } }
I20260809 13:08:56.209518 32011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 442516dcaa9b49f58cf912a83014b279 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 13:08:56.219769 32092 mvcc.cc:205] Tried to move back new op lower bound from 7316606714458955776 to 7316606714208079872. Current Snapshot: MvccSnapshot[applied={T|T < 7316606714458955776}]
I20260809 13:08:56.222057 32105 mvcc.cc:205] Tried to move back new op lower bound from 7316606714458955776 to 7316606714208079872. Current Snapshot: MvccSnapshot[applied={T|T < 7316606714458955776}]
I20260809 13:08:56.228192 32034 sys_catalog.cc:455] T 00000000000000000000000000000000 P 991aff91f4a446ba8fb259638ba4c186 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0773267ed5f148a0a1aa6ef2b5cd5961. Latest consensus state: current_term: 1 leader_uuid: "0773267ed5f148a0a1aa6ef2b5cd5961" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0773267ed5f148a0a1aa6ef2b5cd5961" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46641 } } peers { permanent_uuid: "991aff91f4a446ba8fb259638ba4c186" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 35645 } } peers { permanent_uuid: "442516dcaa9b49f58cf912a83014b279" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } } }
I20260809 13:08:56.228576 32034 sys_catalog.cc:458] T 00000000000000000000000000000000 P 991aff91f4a446ba8fb259638ba4c186 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 13:08:56.236056 32067 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0773267ed5f148a0a1aa6ef2b5cd5961 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0773267ed5f148a0a1aa6ef2b5cd5961" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0773267ed5f148a0a1aa6ef2b5cd5961" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46641 } } peers { permanent_uuid: "991aff91f4a446ba8fb259638ba4c186" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 35645 } } peers { permanent_uuid: "442516dcaa9b49f58cf912a83014b279" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } } }
I20260809 13:08:56.236811 32107 mvcc.cc:205] Tried to move back new op lower bound from 7316606714458955776 to 7316606714208079872. Current Snapshot: MvccSnapshot[applied={T|T < 7316606714458955776}]
I20260809 13:08:56.237507 32067 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0773267ed5f148a0a1aa6ef2b5cd5961 [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:56.237730 32067 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0773267ed5f148a0a1aa6ef2b5cd5961 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0773267ed5f148a0a1aa6ef2b5cd5961" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0773267ed5f148a0a1aa6ef2b5cd5961" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46641 } } peers { permanent_uuid: "991aff91f4a446ba8fb259638ba4c186" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 35645 } } peers { permanent_uuid: "442516dcaa9b49f58cf912a83014b279" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } } }
I20260809 13:08:56.238044 32067 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0773267ed5f148a0a1aa6ef2b5cd5961 [sys.catalog]: This master's current role is: LEADER
I20260809 13:08:56.257280 32077 catalog_manager.cc:1347] Generated new cluster ID: 23c1b78db36144a6a5cf319ba96e4923
I20260809 13:08:56.257477 32077 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:08:56.257812 32011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 442516dcaa9b49f58cf912a83014b279 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0773267ed5f148a0a1aa6ef2b5cd5961" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0773267ed5f148a0a1aa6ef2b5cd5961" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46641 } } peers { permanent_uuid: "991aff91f4a446ba8fb259638ba4c186" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 35645 } } peers { permanent_uuid: "442516dcaa9b49f58cf912a83014b279" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } } }
I20260809 13:08:56.258097 32011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 442516dcaa9b49f58cf912a83014b279 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 13:08:56.261476 32034 sys_catalog.cc:455] T 00000000000000000000000000000000 P 991aff91f4a446ba8fb259638ba4c186 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0773267ed5f148a0a1aa6ef2b5cd5961" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0773267ed5f148a0a1aa6ef2b5cd5961" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 46641 } } peers { permanent_uuid: "991aff91f4a446ba8fb259638ba4c186" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 35645 } } peers { permanent_uuid: "442516dcaa9b49f58cf912a83014b279" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 38727 } } }
I20260809 13:08:56.261729 32034 sys_catalog.cc:458] T 00000000000000000000000000000000 P 991aff91f4a446ba8fb259638ba4c186 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 13:08:56.334676 32077 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:08:56.337047 32077 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:08:56.373661 32077 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0773267ed5f148a0a1aa6ef2b5cd5961: Generated new TSK 0
I20260809 13:08:56.375005 32077 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 13:08:56.542624 32006 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:08:56.530676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33238 (local address 127.28.155.254:46641)
0809 13:08:56.530967 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:56.530974 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:56.539161 (+ 8187us) server_negotiation.cc:407] Connection header received
0809 13:08:56.540819 (+ 1658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:56.540828 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:56.540926 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:56.541011 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:56.542263 (+ 1252us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33238: BlockingRecv error: recv got EOF from 127.0.0.1:33238 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
W20260809 13:08:56.548084 32004 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:08:56.533341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59644 (local address 127.28.155.252:38727)
0809 13:08:56.533545 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:56.533551 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:56.544082 (+ 10531us) server_negotiation.cc:407] Connection header received
0809 13:08:56.544215 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:56.544220 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:56.544310 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:56.544423 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:56.547790 (+ 3367us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59644: BlockingRecv error: recv got EOF from 127.0.0.1:59644 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260809 13:08:56.549111 31903 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:08:56.539790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46440 (local address 127.28.155.253:35645)
0809 13:08:56.540004 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:56.540012 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:56.547004 (+ 6992us) server_negotiation.cc:407] Connection header received
0809 13:08:56.547599 (+ 595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:56.547606 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:56.547706 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:56.547776 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:56.548870 (+ 1094us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46440: BlockingRecv error: recv got EOF from 127.0.0.1:46440 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260809 13:08:56.578969 31903 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:08:56.576613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46448 (local address 127.28.155.253:35645)
0809 13:08:56.576818 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:56.576827 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:56.577323 (+ 496us) server_negotiation.cc:407] Connection header received
0809 13:08:56.577615 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:56.577620 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:56.577722 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:56.577843 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:56.578630 (+ 787us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46448: BlockingRecv error: recv got EOF from 127.0.0.1:46448 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260809 13:08:56.585470 31903 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:08:56.583397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46462 (local address 127.28.155.253:35645)
0809 13:08:56.583631 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:56.583640 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:56.584117 (+ 477us) server_negotiation.cc:407] Connection header received
0809 13:08:56.584326 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:56.584331 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:56.584412 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:56.584541 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:56.585256 (+ 715us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46462: BlockingRecv error: recv got EOF from 127.0.0.1:46462 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
W20260809 13:08:56.592594 31903 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:08:56.590443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46472 (local address 127.28.155.253:35645)
0809 13:08:56.590674 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:56.590683 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:56.591212 (+ 529us) server_negotiation.cc:407] Connection header received
0809 13:08:56.591415 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:56.591421 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:56.591511 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:56.591617 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:56.592312 (+ 695us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46472: BlockingRecv error: recv got EOF from 127.0.0.1:46472 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260809 13:08:56.602130 31903 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:08:56.599973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46486 (local address 127.28.155.253:35645)
0809 13:08:56.600244 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:56.600252 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:56.600804 (+ 552us) server_negotiation.cc:407] Connection header received
0809 13:08:56.601010 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:56.601015 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:56.601097 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:56.601202 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:56.601908 (+ 706us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46486: BlockingRecv error: recv got EOF from 127.0.0.1:46486 (error 108)
Metrics: {"server-negotiator.queue_time_us":126}
W20260809 13:08:56.615926 31903 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:08:56.613698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46502 (local address 127.28.155.253:35645)
0809 13:08:56.613908 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:56.613918 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:56.614464 (+ 546us) server_negotiation.cc:407] Connection header received
0809 13:08:56.614710 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:56.614714 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:56.614788 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:56.614898 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:56.615684 (+ 786us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46502: BlockingRecv error: recv got EOF from 127.0.0.1:46502 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260809 13:08:56.638067 31903 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:08:56.635398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46514 (local address 127.28.155.253:35645)
0809 13:08:56.635645 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:56.635655 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:56.636324 (+ 669us) server_negotiation.cc:407] Connection header received
0809 13:08:56.636589 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:56.636594 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:56.636671 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:56.636783 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:56.637687 (+ 904us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46514: BlockingRecv error: recv got EOF from 127.0.0.1:46514 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260809 13:08:56.676638 31903 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:08:56.674082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46522 (local address 127.28.155.253:35645)
0809 13:08:56.674335 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:56.674344 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:56.674973 (+ 629us) server_negotiation.cc:407] Connection header received
0809 13:08:56.675271 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:56.675276 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:56.675375 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:56.675487 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:56.676336 (+ 849us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46522: BlockingRecv error: recv got EOF from 127.0.0.1:46522 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260809 13:08:56.746783 31903 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:08:56.744411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46528 (local address 127.28.155.253:35645)
0809 13:08:56.744724 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:56.744734 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:56.745321 (+ 587us) server_negotiation.cc:407] Connection header received
0809 13:08:56.745546 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:56.745559 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:56.745637 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:56.745752 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:56.746556 (+ 804us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46528: BlockingRecv error: recv got EOF from 127.0.0.1:46528 (error 108)
Metrics: {"server-negotiator.queue_time_us":117}
I20260809 13:08:56.833592 32031 catalog_manager.cc:1259] Loaded cluster ID: 23c1b78db36144a6a5cf319ba96e4923
I20260809 13:08:56.833724 32031 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 442516dcaa9b49f58cf912a83014b279: loading cluster ID for follower catalog manager: success
I20260809 13:08:56.838218 32031 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 442516dcaa9b49f58cf912a83014b279: acquiring CA information for follower catalog manager: success
I20260809 13:08:56.841241 32031 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 442516dcaa9b49f58cf912a83014b279: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 13:08:56.881948 31903 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:08:56.879610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46544 (local address 127.28.155.253:35645)
0809 13:08:56.879858 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:56.879867 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:56.880285 (+ 418us) server_negotiation.cc:407] Connection header received
0809 13:08:56.880531 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:56.880540 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:56.880666 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:56.880818 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:56.881595 (+ 777us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46544: BlockingRecv error: recv got EOF from 127.0.0.1:46544 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 13:08:56.921198 32053 catalog_manager.cc:1259] Loaded cluster ID: 23c1b78db36144a6a5cf319ba96e4923
I20260809 13:08:56.921341 32053 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 991aff91f4a446ba8fb259638ba4c186: loading cluster ID for follower catalog manager: success
I20260809 13:08:56.924261 32053 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 991aff91f4a446ba8fb259638ba4c186: acquiring CA information for follower catalog manager: success
I20260809 13:08:56.926162 32053 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 991aff91f4a446ba8fb259638ba4c186: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 13:08:57.153867 31903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:57.148010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46552 (local address 127.28.155.253:35645)
0809 13:08:57.148261 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:57.148268 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:57.148523 (+ 255us) server_negotiation.cc:407] Connection header received
0809 13:08:57.148722 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:57.148726 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:57.148896 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:57.149007 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:08:57.149439 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:57.150145 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:57.151614 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:57.152025 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:57.152119 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:57.152605 (+ 486us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:08:57.153173 (+ 568us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:08:57.153299 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:57.153449 (+ 150us) server_negotiation.cc:299] Negotiation successful
0809 13:08:57.153527 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260809 13:08:57.166646 32221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:57.160368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59660 (local address 127.28.155.252:38727)
0809 13:08:57.161006 (+ 638us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:57.161013 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:57.161291 (+ 278us) server_negotiation.cc:407] Connection header received
0809 13:08:57.161487 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:57.161492 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:57.161665 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:57.161813 (+ 148us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:08:57.162183 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:57.162931 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:57.164275 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:57.164794 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:57.164939 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:57.165437 (+ 498us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:08:57.165994 (+ 557us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:08:57.166128 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:57.166213 (+ 85us) server_negotiation.cc:299] Negotiation successful
0809 13:08:57.166285 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":357,"threads_started":1}
I20260809 13:08:57.181452 32221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:57.173833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59672 (local address 127.28.155.252:38727)
0809 13:08:57.174036 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:57.174045 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:57.174895 (+ 850us) server_negotiation.cc:407] Connection header received
0809 13:08:57.175254 (+ 359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:57.175259 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:57.175366 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:57.175440 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:08:57.176378 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:57.177553 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:57.179469 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:57.179997 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:57.180138 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:57.180648 (+ 510us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:08:57.180773 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:08:57.180881 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:57.181038 (+ 157us) server_negotiation.cc:299] Negotiation successful
0809 13:08:57.181124 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 13:08:57.182835 31903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:57.174400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46568 (local address 127.28.155.253:35645)
0809 13:08:57.174608 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:57.174617 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:57.175605 (+ 988us) server_negotiation.cc:407] Connection header received
0809 13:08:57.175811 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:57.175819 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:57.175902 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:57.176004 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:08:57.176867 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:57.177965 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:57.180444 (+ 2479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:57.181135 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:57.181264 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:57.181883 (+ 619us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:08:57.182009 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:08:57.182118 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:57.182257 (+ 139us) server_negotiation.cc:299] Negotiation successful
0809 13:08:57.182342 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 13:08:57.183619 32230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:57.174160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33242 (local address 127.28.155.254:46641)
0809 13:08:57.175637 (+ 1477us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:57.175643 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:57.175662 (+ 19us) server_negotiation.cc:407] Connection header received
0809 13:08:57.175796 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:57.175802 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:57.176043 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:57.176255 (+ 212us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:08:57.177002 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:57.177884 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:57.180644 (+ 2760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:57.181298 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:57.182250 (+ 952us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:57.182474 (+ 224us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:08:57.182896 (+ 422us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:08:57.183091 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:57.183227 (+ 136us) server_negotiation.cc:299] Negotiation successful
0809 13:08:57.183322 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1322,"thread_start_us":1213,"threads_started":1}
I20260809 13:08:57.189143 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 31686
I20260809 13:08:57.190344 31774 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:08:57.306766 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 31686
W20260809 13:08:57.336412 31933 connection.cc:535] server connection from 127.0.0.1:59630 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 13:08:57.336875 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 31789
I20260809 13:08:57.338172 31883 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:08:57.459105 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 31789
I20260809 13:08:57.492027 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 31908
I20260809 13:08:57.493304 31991 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:08:57.607990 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 31908
2026-08-09T13:08:57Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5238 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 13:08:57 dist-test-slave-jq4t krb5kdc[32241](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 13:08:57 dist-test-slave-jq4t krb5kdc[32241](info): set up 2 sockets
Aug 09 13:08:57 dist-test-slave-jq4t krb5kdc[32241](info): commencing operation
krb5kdc: starting...
W20260809 13:08:58.964849 29295 mini_kdc.cc:121] Time spent starting KDC: real 1.306s user 0.005s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/krb5kdc/test-user.keytab.
Aug 09 13:08:59 dist-test-slave-jq4t krb5kdc[32241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280939, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T13:08:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T13:08:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
Entry for principal kudu/127.28.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab.
I20260809 13:08:59.323945 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:44973
--webserver_interface=127.28.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:38985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:44973,127.28.155.253:40843,127.28.155.252:40395
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 13:08:59.695251 32266 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 13:08:59.695683 32266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:08:59.695838 32266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:08:59.695986 32266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:08:59.703361 32266 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:08:59.703486 32266 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:08:59.703598 32266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:08:59.703698 32266 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:08:59.703791 32266 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:08:59.713842 32266 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:38985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:44973,127.28.155.253:40843,127.28.155.252:40395
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.254.keytab
--principal=kudu/127.28.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.254:44973
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:08:59.715256 32266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:08:59.716718 32266 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:08:59.729116 32276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:59.729053 32281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:08:59.728938 32277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:08:59.730299 32266 server_base.cc:1034] running on GCE node
I20260809 13:08:59.731185 32266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:08:59.732760 32266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:08:59.734017 32266 hybrid_clock.cc:648] HybridClock initialized: now 1786280939733950 us; error 40 us; skew 500 ppm
I20260809 13:08:59.734364 32266 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:08:59 dist-test-slave-jq4t krb5kdc[32241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280939, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:08:59.737859 32266 init.cc:377] Logged in from keytab as kudu/127.28.155.254@KRBTEST.COM (short username kudu)
I20260809 13:08:59.739336 32266 webserver.cc:460] Webserver started at http://127.28.155.254:32901/ using document root <none> and password file <none>
I20260809 13:08:59.740064 32266 fs_manager.cc:359] Metadata directory not provided
I20260809 13:08:59.740204 32266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:08:59.740619 32266 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:08:59.743983 32266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-0/data/instance:
uuid: "920571f0fbbf45edabe98cf97ee8fcdc"
format_stamp: "Formatted at 2026-08-09 13:08:59 on dist-test-slave-jq4t"
server_key: "5bd0b51c2c73ec7eccbabcc47106cfef"
server_key_iv: "fd9f45f012f10b11607706b50c6be7f6"
server_key_version: "encryptionkey@0"
I20260809 13:08:59.744904 32266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-0/wal/instance:
uuid: "920571f0fbbf45edabe98cf97ee8fcdc"
format_stamp: "Formatted at 2026-08-09 13:08:59 on dist-test-slave-jq4t"
server_key: "5bd0b51c2c73ec7eccbabcc47106cfef"
server_key_iv: "fd9f45f012f10b11607706b50c6be7f6"
server_key_version: "encryptionkey@0"
I20260809 13:08:59.750505 32266 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260809 13:08:59.754311 32290 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:08:59.755745 32266 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 13:08:59.755959 32266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-0/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-0/wal
uuid: "920571f0fbbf45edabe98cf97ee8fcdc"
format_stamp: "Formatted at 2026-08-09 13:08:59 on dist-test-slave-jq4t"
server_key: "5bd0b51c2c73ec7eccbabcc47106cfef"
server_key_iv: "fd9f45f012f10b11607706b50c6be7f6"
server_key_version: "encryptionkey@0"
I20260809 13:08:59.756206 32266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:08:59.779210 32266 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:08:59.784235 32266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:08:59.784637 32266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:08:59.805379 32266 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.254:44973
I20260809 13:08:59.805413 32378 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.254:44973 every 8 connection(s)
I20260809 13:08:59.806877 32266 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-0/data/info.pb
I20260809 13:08:59.810571 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 32266
I20260809 13:08:59.810788 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-0/wal/instance
I20260809 13:08:59.811406 32379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:08:59.811431 29295 external_mini_cluster.cc:1428] Setting key 71fa9f360659c654e69096ee5b2ce5c5
I20260809 13:08:59.822695 32379 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44973 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 13:08:59 dist-test-slave-jq4t krb5kdc[32241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280939, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:08:59.849982 32384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:59.827124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44344 (local address 127.28.155.254:44973)
0809 13:08:59.829186 (+ 2062us) server_negotiation.cc:206] Beginning negotiation
0809 13:08:59.829192 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:08:59.829236 (+ 44us) server_negotiation.cc:407] Connection header received
0809 13:08:59.831141 (+ 1905us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:08:59.831152 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:08:59.831487 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:08:59.831711 (+ 224us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:08:59.833051 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:59.835072 (+ 2021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:59.836660 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:08:59.837724 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:08:59.837912 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:59.842081 (+ 4169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:08:59.842089 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:08:59.842101 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:08:59.842133 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:08:59.845365 (+ 3232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:59.846363 (+ 998us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:59.846369 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:59.846372 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:59.846551 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:08:59.847075 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:08:59.847078 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:08:59.847080 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:08:59.847623 (+ 543us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:08:59.847788 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 13:08:59.848593 (+ 805us) server_negotiation.cc:299] Negotiation successful
0809 13:08:59.848863 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1857,"spinlock_wait_cycles":40832,"thread_start_us":1611,"threads_started":1}
I20260809 13:08:59.850085 32381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:59.827124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:44973 (local address 127.0.0.1:44344)
0809 13:08:59.828189 (+ 1065us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:59.828247 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 13:08:59.830707 (+ 2460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:08:59.831739 (+ 1032us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:08:59.831744 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:08:59.832347 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:08:59.832815 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:59.832834 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:59.835328 (+ 2494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:59.835333 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:59.836439 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:08:59.836451 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:08:59.838023 (+ 1572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:08:59.838035 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:08:59.838239 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:08:59.839039 (+ 800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:08:59.839062 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:08:59.841817 (+ 2755us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:08:59.845530 (+ 3713us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:08:59.845546 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:08:59.845560 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:08:59.846209 (+ 649us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:08:59.846683 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:08:59.846691 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:08:59.846697 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:08:59.846949 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:08:59.847779 (+ 830us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:08:59.847790 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:08:59.848101 (+ 311us) client_negotiation.cc:769] Sending connection context
0809 13:08:59.848413 (+ 312us) client_negotiation.cc:240] Negotiation successful
0809 13:08:59.849022 (+ 609us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":734,"mutex_wait_us":1,"thread_start_us":462,"threads_started":1}
WARNING: no policy specified for kudu/127.28.155.253@KRBTEST.COM; defaulting to no policy
I20260809 13:08:59.853070 32379 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40843 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.253@KRBTEST.COM" created.
I20260809 13:08:59.854452 32381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:59.854006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:40843 (local address 127.0.0.1:40722)
0809 13:08:59.854199 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:59.854326 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260809 13:08:59.854782 32296 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.155.253:40843: connect: Connection refused (error 111)
I20260809 13:08:59.856446 32381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:59.856079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:40843 (local address 127.0.0.1:40738)
0809 13:08:59.856237 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:59.856306 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 13:08:59.856724 32379 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.253:40843: Network error: Client connection negotiation failed: client connection to 127.28.155.253:40843: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.253.keytab.
Entry for principal kudu/127.28.155.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.253.keytab.
I20260809 13:08:59.893620 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.253:40843
--webserver_interface=127.28.155.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.253.keytab
--principal=kudu/127.28.155.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:38985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:44973,127.28.155.253:40843,127.28.155.252:40395
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 13:08:59.906145 32379 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40843 } attempt: 1
I20260809 13:08:59.907531 32381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:59.907028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:40843 (local address 127.0.0.1:40744)
0809 13:08:59.907250 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:59.907391 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260809 13:08:59.908727 32381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:59.908328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:40843 (local address 127.0.0.1:40750)
0809 13:08:59.908470 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:59.908597 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 13:08:59.909016 32379 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.253:40843: Network error: Client connection negotiation failed: client connection to 127.28.155.253:40843: connect: Connection refused (error 111)
I20260809 13:08:59.977331 32379 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40843 } attempt: 2
I20260809 13:08:59.978776 32381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:59.978222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:40843 (local address 127.0.0.1:40764)
0809 13:08:59.978502 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:59.978615 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260809 13:08:59.980050 32381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:08:59.979615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:40843 (local address 127.0.0.1:40780)
0809 13:08:59.979804 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0809 13:08:59.979895 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260809 13:08:59.980348 32379 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.253:40843: Network error: Client connection negotiation failed: client connection to 127.28.155.253:40843: connect: Connection refused (error 111)
I20260809 13:09:00.071681 32379 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40843 } attempt: 3
I20260809 13:09:00.073083 32381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.072639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:40843 (local address 127.0.0.1:40788)
0809 13:09:00.072843 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:00.072942 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260809 13:09:00.074219 32381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.073871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:40843 (local address 127.0.0.1:40804)
0809 13:09:00.074008 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:00.074079 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 13:09:00.074465 32379 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.253:40843: Network error: Client connection negotiation failed: client connection to 127.28.155.253:40843: connect: Connection refused (error 111)
I20260809 13:09:00.217784 32379 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40843 } attempt: 4
I20260809 13:09:00.219226 32381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.218605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:40843 (local address 127.0.0.1:40816)
0809 13:09:00.218977 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:00.219077 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209}
I20260809 13:09:00.220345 32381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.219996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:40843 (local address 127.0.0.1:40824)
0809 13:09:00.220129 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:00.220214 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.253:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 13:09:00.220636 32379 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.253:40843: Network error: Client connection negotiation failed: client connection to 127.28.155.253:40843: connect: Connection refused (error 111)
W20260809 13:09:00.254791 32390 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 13:09:00.255124 32390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:09:00.255223 32390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:09:00.255373 32390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:09:00.263154 32390 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:09:00.263266 32390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:09:00.263381 32390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:09:00.263469 32390 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:09:00.263577 32390 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:09:00.274250 32390 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:38985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:44973,127.28.155.253:40843,127.28.155.252:40395
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.253.keytab
--principal=kudu/127.28.155.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.253:40843
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.28.155.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:09:00.275681 32390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:09:00.277179 32390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:09:00.289561 32397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:09:00.289580 32398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:09:00.289577 32400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:09:00.290740 32390 server_base.cc:1034] running on GCE node
I20260809 13:09:00.291668 32390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:09:00.293251 32390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:09:00.294477 32390 hybrid_clock.cc:648] HybridClock initialized: now 1786280940294386 us; error 60 us; skew 500 ppm
I20260809 13:09:00.294839 32390 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:09:00 dist-test-slave-jq4t krb5kdc[32241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280940, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:09:00.300874 32390 init.cc:377] Logged in from keytab as kudu/127.28.155.253@KRBTEST.COM (short username kudu)
I20260809 13:09:00.302495 32390 webserver.cc:460] Webserver started at http://127.28.155.253:33031/ using document root <none> and password file <none>
I20260809 13:09:00.303265 32390 fs_manager.cc:359] Metadata directory not provided
I20260809 13:09:00.303406 32390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:09:00.303755 32390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:09:00.306945 32390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-1/data/instance:
uuid: "573fee041758446096796e5fa648eb35"
format_stamp: "Formatted at 2026-08-09 13:09:00 on dist-test-slave-jq4t"
server_key: "f82a6a483ce4ab2e952a1e2d7f59eda1"
server_key_iv: "aee2253c809079ba3442408f363e7a0c"
server_key_version: "encryptionkey@0"
I20260809 13:09:00.307772 32390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-1/wal/instance:
uuid: "573fee041758446096796e5fa648eb35"
format_stamp: "Formatted at 2026-08-09 13:09:00 on dist-test-slave-jq4t"
server_key: "f82a6a483ce4ab2e952a1e2d7f59eda1"
server_key_iv: "aee2253c809079ba3442408f363e7a0c"
server_key_version: "encryptionkey@0"
I20260809 13:09:00.313195 32390 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 13:09:00.316900 32411 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:09:00.318282 32390 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 13:09:00.318481 32390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-1/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-1/wal
uuid: "573fee041758446096796e5fa648eb35"
format_stamp: "Formatted at 2026-08-09 13:09:00 on dist-test-slave-jq4t"
server_key: "f82a6a483ce4ab2e952a1e2d7f59eda1"
server_key_iv: "aee2253c809079ba3442408f363e7a0c"
server_key_version: "encryptionkey@0"
I20260809 13:09:00.318727 32390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:09:00.348862 32390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:09:00.353809 32390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:09:00.354133 32390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:09:00.373868 32390 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.253:40843
I20260809 13:09:00.373883 32490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.253:40843 every 8 connection(s)
I20260809 13:09:00.375329 32390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-1/data/info.pb
I20260809 13:09:00.379314 32495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:09:00.380086 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 32390
I20260809 13:09:00.380314 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-1/wal/instance
I20260809 13:09:00.380996 29295 external_mini_cluster.cc:1428] Setting key d200406216ce8104bf0034075573c78b
I20260809 13:09:00.390051 32495 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44973 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 13:09:00 dist-test-slave-jq4t krb5kdc[32241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280940, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.253@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:09:00.415541 32498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.393991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44358 (local address 127.28.155.254:44973)
0809 13:09:00.394589 (+ 598us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:00.394599 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:00.395751 (+ 1152us) server_negotiation.cc:407] Connection header received
0809 13:09:00.397892 (+ 2141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:00.397898 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:00.398002 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:00.398150 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:09:00.400349 (+ 2199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:00.401188 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:00.403776 (+ 2588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:00.404185 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:00.404282 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:09:00.409022 (+ 4740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:09:00.409027 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:09:00.409030 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:09:00.409078 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:09:00.411987 (+ 2909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:09:00.412920 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:09:00.412929 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:09:00.412932 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:09:00.413085 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:09:00.413551 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:09:00.413563 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:09:00.413565 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:09:00.413873 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:09:00.414055 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0809 13:09:00.414864 (+ 809us) server_negotiation.cc:299] Negotiation successful
0809 13:09:00.415130 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":439,"thread_start_us":282,"threads_started":1}
I20260809 13:09:00.416689 32500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.394627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:44973 (local address 127.0.0.1:44358)
0809 13:09:00.395543 (+ 916us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:00.395603 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 13:09:00.397583 (+ 1980us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:09:00.398378 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:09:00.398387 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:09:00.399241 (+ 854us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:09:00.400083 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:09:00.400113 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:09:00.401394 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:09:00.401403 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:09:00.403620 (+ 2217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:09:00.403639 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:09:00.404445 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:09:00.404454 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:09:00.404831 (+ 377us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:09:00.405696 (+ 865us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:09:00.405738 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:09:00.408761 (+ 3023us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:09:00.412166 (+ 3405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:09:00.412176 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:09:00.412196 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:09:00.412786 (+ 590us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:09:00.413211 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:09:00.413216 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:09:00.413220 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:09:00.413416 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:09:00.414022 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:09:00.414032 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:09:00.414440 (+ 408us) client_negotiation.cc:769] Sending connection context
0809 13:09:00.414751 (+ 311us) client_negotiation.cc:240] Negotiation successful
0809 13:09:00.415350 (+ 599us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"thread_start_us":397,"threads_started":1}
WARNING: no policy specified for kudu/127.28.155.252@KRBTEST.COM; defaulting to no policy
I20260809 13:09:00.418651 32495 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40843 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.155.252@KRBTEST.COM" created.
Aug 09 13:09:00 dist-test-slave-jq4t krb5kdc[32241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280940, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.253@KRBTEST.COM for kudu/127.28.155.253@KRBTEST.COM
I20260809 13:09:00.434428 32500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.419552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:40843 (local address 127.0.0.1:40828)
0809 13:09:00.419709 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:00.419725 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 13:09:00.419813 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:09:00.421091 (+ 1278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:09:00.421096 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:09:00.421575 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:09:00.421793 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:09:00.421803 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:09:00.423405 (+ 1602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:09:00.423411 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:09:00.424299 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:09:00.424311 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:09:00.425212 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:09:00.425217 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:09:00.425414 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:09:00.426124 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:09:00.426143 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:09:00.428281 (+ 2138us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:09:00.431720 (+ 3439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:09:00.431726 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:09:00.431730 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:09:00.432147 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:09:00.432577 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:09:00.432582 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:09:00.432586 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:09:00.432733 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:09:00.433374 (+ 641us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:09:00.433382 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:09:00.433533 (+ 151us) client_negotiation.cc:769] Sending connection context
0809 13:09:00.433680 (+ 147us) client_negotiation.cc:240] Negotiation successful
0809 13:09:00.433987 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260809 13:09:00.434552 32502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.419773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40828 (local address 127.28.155.253:40843)
0809 13:09:00.420574 (+ 801us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:00.420580 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:00.420608 (+ 28us) server_negotiation.cc:407] Connection header received
0809 13:09:00.420653 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:00.420659 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:00.420938 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:00.421102 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:09:00.421973 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:00.423268 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:00.424444 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:00.425061 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:00.425204 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:09:00.428556 (+ 3352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:09:00.428569 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:09:00.428583 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:09:00.428613 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:09:00.431561 (+ 2948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:09:00.432291 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:09:00.432303 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:09:00.432306 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:09:00.432421 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:09:00.432852 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:09:00.432857 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:09:00.432861 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:09:00.433226 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:09:00.433454 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0809 13:09:00.433827 (+ 373us) server_negotiation.cc:299] Negotiation successful
0809 13:09:00.434123 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":40,"server-negotiator.queue_time_us":583,"thread_start_us":453,"threads_started":1}
I20260809 13:09:00.437505 32495 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } has no permanent_uuid. Determining permanent_uuid...
I20260809 13:09:00.438822 32500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.438201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:40395 (local address 127.0.0.1:54220)
0809 13:09:00.438408 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:00.438600 (+ 192us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260809 13:09:00.439100 32418 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
I20260809 13:09:00.441535 32500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.441053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:40395 (local address 127.0.0.1:54228)
0809 13:09:00.441266 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:00.441370 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260809 13:09:00.441783 32495 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.252:40395: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.155.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.252.keytab.
Entry for principal kudu/127.28.155.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.252.keytab.
I20260809 13:09:00.463953 29295 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
/tmp/dist-test-taskqeHpK4/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.252:40395
--webserver_interface=127.28.155.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.252.keytab
--principal=kudu/127.28.155.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.155.212:38985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.155.254:44973,127.28.155.253:40843,127.28.155.252:40395
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 13:09:00.491168 32495 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } attempt: 1
I20260809 13:09:00.492779 32500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.492078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:40395 (local address 127.0.0.1:54234)
0809 13:09:00.492351 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:00.492543 (+ 192us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260809 13:09:00.493966 32500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.493478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:40395 (local address 127.0.0.1:54236)
0809 13:09:00.493692 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:00.493801 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260809 13:09:00.494222 32495 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.252:40395: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
I20260809 13:09:00.520036 32379 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40843 } attempt: 5
Aug 09 13:09:00 dist-test-slave-jq4t krb5kdc[32241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280939, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for kudu/127.28.155.253@KRBTEST.COM
I20260809 13:09:00.536041 32381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.520934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:40843 (local address 127.0.0.1:40842)
0809 13:09:00.521165 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:00.521190 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 13:09:00.521347 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:09:00.521817 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:09:00.521820 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:09:00.522350 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:09:00.522586 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:09:00.522596 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:09:00.524213 (+ 1617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:09:00.524217 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:09:00.525190 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:09:00.525202 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:09:00.526194 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:09:00.526199 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:09:00.526370 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:09:00.527066 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:09:00.527083 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:09:00.529190 (+ 2107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:09:00.533696 (+ 4506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:09:00.533701 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:09:00.533703 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:09:00.534106 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:09:00.534523 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:09:00.534526 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:09:00.534529 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:09:00.534659 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:09:00.535294 (+ 635us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:09:00.535297 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:09:00.535435 (+ 138us) client_negotiation.cc:769] Sending connection context
0809 13:09:00.535551 (+ 116us) client_negotiation.cc:240] Negotiation successful
0809 13:09:00.535782 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89}
I20260809 13:09:00.536260 32502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.521183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40842 (local address 127.28.155.253:40843)
0809 13:09:00.521436 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:00.521443 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:00.521468 (+ 25us) server_negotiation.cc:407] Connection header received
0809 13:09:00.521540 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:00.521545 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:00.521643 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:00.521778 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:09:00.522762 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:00.524070 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:00.525362 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:00.526045 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:00.526184 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:09:00.529413 (+ 3229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:09:00.529432 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:09:00.529439 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:09:00.529489 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:09:00.533538 (+ 4049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:09:00.534232 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:09:00.534239 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:09:00.534243 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:09:00.534400 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:09:00.534766 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:09:00.534772 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:09:00.534776 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:09:00.535175 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:09:00.535330 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 13:09:00.535699 (+ 369us) server_negotiation.cc:299] Negotiation successful
0809 13:09:00.535936 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260809 13:09:00.537375 32379 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } has no permanent_uuid. Determining permanent_uuid...
I20260809 13:09:00.538350 32381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.537986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:40395 (local address 127.0.0.1:54246)
0809 13:09:00.538156 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:00.538228 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 13:09:00.539294 32381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.538976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:40395 (local address 127.0.0.1:54254)
0809 13:09:00.539111 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:00.539196 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 13:09:00.539515 32379 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.252:40395: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
I20260809 13:09:00.562537 32495 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } attempt: 2
I20260809 13:09:00.563855 32500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.563298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:40395 (local address 127.0.0.1:54266)
0809 13:09:00.563539 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:00.563654 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260809 13:09:00.565021 32500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.564638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:40395 (local address 127.0.0.1:54276)
0809 13:09:00.564792 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:00.564879 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 13:09:00.565240 32495 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.252:40395: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
I20260809 13:09:00.590782 32379 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } attempt: 1
I20260809 13:09:00.592094 32381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.591587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:40395 (local address 127.0.0.1:54288)
0809 13:09:00.591811 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:00.591913 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260809 13:09:00.593215 32381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.592868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:40395 (local address 127.0.0.1:54290)
0809 13:09:00.593030 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:00.593109 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260809 13:09:00.593443 32379 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.252:40395: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
I20260809 13:09:00.656512 32495 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } attempt: 3
I20260809 13:09:00.657852 32500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.657358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:40395 (local address 127.0.0.1:54300)
0809 13:09:00.657565 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:00.657663 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260809 13:09:00.659021 32500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.658605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:40395 (local address 127.0.0.1:54306)
0809 13:09:00.658833 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:00.658909 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146}
W20260809 13:09:00.659325 32495 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.252:40395: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
I20260809 13:09:00.661659 32379 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } attempt: 2
I20260809 13:09:00.662668 32381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.662208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:40395 (local address 127.0.0.1:54310)
0809 13:09:00.662434 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:00.662523 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260809 13:09:00.663673 32381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.663325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:40395 (local address 127.0.0.1:54326)
0809 13:09:00.663485 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:00.663562 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 13:09:00.663897 32379 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.252:40395: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
I20260809 13:09:00.770181 32379 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } attempt: 3
I20260809 13:09:00.771473 32381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.770952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:40395 (local address 127.0.0.1:54340)
0809 13:09:00.771193 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:00.771296 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260809 13:09:00.772622 32381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.772206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:40395 (local address 127.0.0.1:54342)
0809 13:09:00.772365 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:00.772446 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260809 13:09:00.772845 32379 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.252:40395: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
I20260809 13:09:00.802578 32495 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } attempt: 4
I20260809 13:09:00.803893 32500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.803369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:40395 (local address 127.0.0.1:54352)
0809 13:09:00.803635 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:00.803728 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260809 13:09:00.805158 32500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.804693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:40395 (local address 127.0.0.1:54358)
0809 13:09:00.804881 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:00.804997 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260809 13:09:00.805516 32495 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.252:40395: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
W20260809 13:09:00.834491 32505 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 13:09:00.834887 32505 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 13:09:00.835035 32505 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 13:09:00.835181 32505 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 13:09:00.842687 32505 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 13:09:00.842806 32505 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 13:09:00.842941 32505 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 13:09:00.843039 32505 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 13:09:00.843150 32505 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 13:09:00.853367 32505 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.155.212:38985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.28.155.254:44973,127.28.155.253:40843,127.28.155.252:40395
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/krb5kdc/kudu_127.28.155.252.keytab
--principal=kudu/127.28.155.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.155.252:40395
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.28.155.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:32:11 UTC on ccycloud.quasar-ficarf.root.comops.site
build id 4575995
ASAN enabled
I20260809 13:09:00.854705 32505 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 13:09:00.856088 32505 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 13:09:00.868436 32514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:09:00.868557 32510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 13:09:00.868582 32517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 13:09:00.869526 32505 server_base.cc:1034] running on GCE node
I20260809 13:09:00.870334 32505 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 13:09:00.871798 32505 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 13:09:00.873147 32505 hybrid_clock.cc:648] HybridClock initialized: now 1786280940873051 us; error 61 us; skew 500 ppm
I20260809 13:09:00.873538 32505 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 13:09:00 dist-test-slave-jq4t krb5kdc[32241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280940, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 13:09:00.876952 32505 init.cc:377] Logged in from keytab as kudu/127.28.155.252@KRBTEST.COM (short username kudu)
I20260809 13:09:00.878453 32505 webserver.cc:460] Webserver started at http://127.28.155.252:42737/ using document root <none> and password file <none>
I20260809 13:09:00.879237 32505 fs_manager.cc:359] Metadata directory not provided
I20260809 13:09:00.879377 32505 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 13:09:00.879721 32505 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 13:09:00.882828 32505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-2/data/instance:
uuid: "50978e44838c4a548c061ee93e20460e"
format_stamp: "Formatted at 2026-08-09 13:09:00 on dist-test-slave-jq4t"
server_key: "3b2570a70fff85962348bd78a78da095"
server_key_iv: "77d6628e3e0abf79b50292abf1031cdb"
server_key_version: "encryptionkey@0"
I20260809 13:09:00.883672 32505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-2/wal/instance:
uuid: "50978e44838c4a548c061ee93e20460e"
format_stamp: "Formatted at 2026-08-09 13:09:00 on dist-test-slave-jq4t"
server_key: "3b2570a70fff85962348bd78a78da095"
server_key_iv: "77d6628e3e0abf79b50292abf1031cdb"
server_key_version: "encryptionkey@0"
I20260809 13:09:00.889156 32505 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 13:09:00.892757 32528 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 13:09:00.894107 32505 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 13:09:00.894313 32505 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-2/data,/tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-2/wal
uuid: "50978e44838c4a548c061ee93e20460e"
format_stamp: "Formatted at 2026-08-09 13:09:00 on dist-test-slave-jq4t"
server_key: "3b2570a70fff85962348bd78a78da095"
server_key_iv: "77d6628e3e0abf79b50292abf1031cdb"
server_key_version: "encryptionkey@0"
I20260809 13:09:00.894557 32505 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 13:09:00.934206 32505 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 13:09:00.939049 32505 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 13:09:00.939397 32505 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 13:09:00.950079 32379 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } attempt: 4
I20260809 13:09:00.951514 32381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.950965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:40395 (local address 127.0.0.1:54366)
0809 13:09:00.951241 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:00.951359 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260809 13:09:00.952735 32381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.952218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:40395 (local address 127.0.0.1:54374)
0809 13:09:00.952374 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:00.952553 (+ 179us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 13:09:00.952988 32379 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.155.252:40395: Network error: Client connection negotiation failed: client connection to 127.28.155.252:40395: connect: Connection refused (error 111)
I20260809 13:09:00.960691 32505 rpc_server.cc:307] RPC server started. Bound to: 127.28.155.252:40395
I20260809 13:09:00.960721 32603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.155.252:40395 every 8 connection(s)
I20260809 13:09:00.962141 32505 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-2/data/info.pb
I20260809 13:09:00.966168 32604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 13:09:00.970139 29295 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu as pid 32505
I20260809 13:09:00.970323 29295 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqeHpK4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786280548611909-29295-0/minicluster-data/master-2/wal/instance
I20260809 13:09:00.970736 29295 external_mini_cluster.cc:1428] Setting key 110f5a8d25d5afbc096297528da78abf
I20260809 13:09:00.974211 32604 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44973 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 13:09:00 dist-test-slave-jq4t krb5kdc[32241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280939, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.252@KRBTEST.COM
Aug 09 13:09:00 dist-test-slave-jq4t krb5kdc[32241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280940, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.252@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:09:00.995229 32608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.972694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54386 (local address 127.28.155.252:40395)
0809 13:09:00.973638 (+ 944us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:00.973654 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:00.973706 (+ 52us) server_negotiation.cc:407] Connection header received
0809 13:09:00.975590 (+ 1884us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:00.975627 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:00.976172 (+ 545us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:00.976651 (+ 479us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:09:00.978021 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:00.980145 (+ 2124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:00.981668 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:00.982396 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:00.982602 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:09:00.987438 (+ 4836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:09:00.987452 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:09:00.987469 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:09:00.987515 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:09:00.990530 (+ 3015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:09:00.991440 (+ 910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:09:00.991447 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:09:00.991454 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:09:00.991614 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:09:00.992087 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:09:00.992093 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:09:00.992096 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:09:00.992974 (+ 878us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:09:00.993258 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0809 13:09:00.993681 (+ 423us) server_negotiation.cc:299] Negotiation successful
0809 13:09:00.994099 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":681,"thread_start_us":407,"threads_started":1}
I20260809 13:09:00.995289 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.978463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44362 (local address 127.28.155.254:44973)
0809 13:09:00.979075 (+ 612us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:00.979083 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:00.979552 (+ 469us) server_negotiation.cc:407] Connection header received
0809 13:09:00.979734 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:00.979738 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:00.979803 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:00.979898 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:09:00.981237 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:00.982114 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:00.983677 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:00.984356 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:00.984547 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:09:00.988619 (+ 4072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:09:00.988624 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:09:00.988627 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:09:00.988661 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:09:00.991881 (+ 3220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:09:00.992886 (+ 1005us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:09:00.992889 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:09:00.992891 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:09:00.993064 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:09:00.993536 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:09:00.993541 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:09:00.993544 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:09:00.993907 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:09:00.994086 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0809 13:09:00.994625 (+ 539us) server_negotiation.cc:299] Negotiation successful
0809 13:09:00.994841 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":479,"thread_start_us":279,"threads_started":1}
I20260809 13:09:00.995333 32611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.978493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.254:44973 (local address 127.0.0.1:44362)
0809 13:09:00.979382 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:00.979436 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 13:09:00.979611 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:09:00.980002 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:09:00.980009 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:09:00.980813 (+ 804us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:09:00.981072 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:09:00.981081 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:09:00.982283 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:09:00.982290 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:09:00.983509 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:09:00.983521 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:09:00.984625 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:09:00.984630 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:09:00.984762 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:09:00.985471 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:09:00.985495 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:09:00.988342 (+ 2847us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:09:00.992087 (+ 3745us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:09:00.992100 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:09:00.992107 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:09:00.992767 (+ 660us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:09:00.993195 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:09:00.993200 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:09:00.993206 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:09:00.993369 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:09:00.994119 (+ 750us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:09:00.994127 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:09:00.994295 (+ 168us) client_negotiation.cc:769] Sending connection context
0809 13:09:00.994497 (+ 202us) client_negotiation.cc:240] Negotiation successful
0809 13:09:00.994839 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":635,"spinlock_wait_cycles":26496,"thread_start_us":484,"threads_started":1}
I20260809 13:09:00.997083 32604 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40843 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 13:09:01 dist-test-slave-jq4t krb5kdc[32241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280940, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.252@KRBTEST.COM for kudu/127.28.155.253@KRBTEST.COM
Aug 09 13:09:01 dist-test-slave-jq4t krb5kdc[32241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280939, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.254@KRBTEST.COM
I20260809 13:09:01.012449 32502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.998000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40846 (local address 127.28.155.253:40843)
0809 13:09:00.998229 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:00.998236 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:00.998362 (+ 126us) server_negotiation.cc:407] Connection header received
0809 13:09:00.998750 (+ 388us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:00.998757 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:00.998851 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:00.998955 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:09:00.999882 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:01.000685 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:01.002134 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:01.002557 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:01.002654 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:09:01.006326 (+ 3672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:09:01.006331 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:09:01.006334 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:09:01.006368 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:09:01.009777 (+ 3409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:09:01.010536 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:09:01.010542 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:09:01.010546 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:09:01.010705 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:09:01.011090 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:09:01.011095 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:09:01.011098 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:09:01.011492 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:09:01.011655 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 13:09:01.012001 (+ 346us) server_negotiation.cc:299] Negotiation successful
0809 13:09:01.012162 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 13:09:01.012641 32611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.998082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.253:40843 (local address 127.0.0.1:40846)
0809 13:09:00.998268 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:00.998290 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 13:09:00.998409 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:09:00.999007 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:09:00.999013 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:09:00.999529 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:09:00.999733 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:09:00.999745 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:09:01.000874 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:09:01.000878 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:09:01.001976 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:09:01.001993 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:09:01.002710 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:09:01.002716 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:09:01.002949 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:09:01.003608 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:09:01.003624 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:09:01.006123 (+ 2499us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:09:01.009908 (+ 3785us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:09:01.009911 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:09:01.009914 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:09:01.010406 (+ 492us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:09:01.010831 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:09:01.010835 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:09:01.010837 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:09:01.010976 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:09:01.011613 (+ 637us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:09:01.011616 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:09:01.011746 (+ 130us) client_negotiation.cc:769] Sending connection context
0809 13:09:01.011907 (+ 161us) client_negotiation.cc:240] Negotiation successful
0809 13:09:01.012217 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 13:09:01.013757 32604 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } has no permanent_uuid. Determining permanent_uuid...
I20260809 13:09:01.014776 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:00.998606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44364 (local address 127.28.155.254:44973)
0809 13:09:00.998799 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:00.998803 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:00.998818 (+ 15us) server_negotiation.cc:407] Connection header received
0809 13:09:00.998995 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:00.999000 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:00.999089 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:00.999193 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:09:01.000783 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:01.001478 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:01.002960 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:01.003620 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:01.003717 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:09:01.008194 (+ 4477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:09:01.008200 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:09:01.008205 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:09:01.008244 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:09:01.011741 (+ 3497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:09:01.012573 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:09:01.012579 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:09:01.012583 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:09:01.012751 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:09:01.013221 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:09:01.013226 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:09:01.013229 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:09:01.013595 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:09:01.013920 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0809 13:09:01.014212 (+ 292us) server_negotiation.cc:299] Negotiation successful
0809 13:09:01.014448 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
Aug 09 13:09:01 dist-test-slave-jq4t krb5kdc[32241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280940, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.252@KRBTEST.COM for kudu/127.28.155.252@KRBTEST.COM
Aug 09 13:09:01 dist-test-slave-jq4t krb5kdc[32241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280939, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.155.253@KRBTEST.COM
I20260809 13:09:01.029757 32608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:01.014616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54396 (local address 127.28.155.252:40395)
0809 13:09:01.014756 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:01.014762 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:01.014851 (+ 89us) server_negotiation.cc:407] Connection header received
0809 13:09:01.015024 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:01.015032 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:01.015109 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:01.015217 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:09:01.016063 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:01.017063 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:01.018795 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:01.019472 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:01.019600 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:09:01.023694 (+ 4094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:09:01.023699 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:09:01.023702 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:09:01.023732 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:09:01.026755 (+ 3023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:09:01.027392 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:09:01.027396 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:09:01.027398 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:09:01.027522 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:09:01.027948 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:09:01.027951 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:09:01.027953 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:09:01.028345 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:09:01.028531 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0809 13:09:01.028985 (+ 454us) server_negotiation.cc:299] Negotiation successful
0809 13:09:01.029503 (+ 518us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":205,"server-negotiator.queue_time_us":54}
I20260809 13:09:01.029839 32611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:01.014480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:40395 (local address 127.0.0.1:54396)
0809 13:09:01.014755 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:01.014775 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 13:09:01.014910 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:09:01.015267 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:09:01.015272 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:09:01.015772 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:09:01.015921 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:09:01.015932 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:09:01.017194 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:09:01.017202 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:09:01.018650 (+ 1448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:09:01.018667 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:09:01.019627 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:09:01.019632 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:09:01.019804 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:09:01.020463 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:09:01.020537 (+ 74us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:09:01.023480 (+ 2943us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:09:01.026885 (+ 3405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:09:01.026891 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:09:01.026895 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:09:01.027259 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:09:01.027651 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:09:01.027658 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:09:01.027662 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:09:01.027833 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:09:01.028522 (+ 689us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:09:01.028529 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:09:01.028729 (+ 200us) client_negotiation.cc:769] Sending connection context
0809 13:09:01.028896 (+ 167us) client_negotiation.cc:240] Negotiation successful
0809 13:09:01.029269 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":3}
I20260809 13:09:01.033919 32502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:01.016659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40848 (local address 127.28.155.253:40843)
0809 13:09:01.016820 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:01.016826 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:01.016843 (+ 17us) server_negotiation.cc:407] Connection header received
0809 13:09:01.016910 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:01.016915 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:01.016981 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:01.017081 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:09:01.018744 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:01.019841 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:01.021641 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:01.022391 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:01.022532 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:09:01.027417 (+ 4885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:09:01.027422 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:09:01.027426 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:09:01.027461 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:09:01.030782 (+ 3321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:09:01.031686 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:09:01.031695 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:09:01.031698 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:09:01.031921 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:09:01.032308 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:09:01.032314 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:09:01.032317 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:09:01.032761 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:09:01.033043 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0809 13:09:01.033303 (+ 260us) server_negotiation.cc:299] Negotiation successful
0809 13:09:01.033563 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 13:09:01.036403 32604 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50978e44838c4a548c061ee93e20460e: Bootstrap starting.
I20260809 13:09:01.039271 29295 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 13:09:01.040545 32604 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 50978e44838c4a548c061ee93e20460e: Neither blocks nor log segments found. Creating new log.
I20260809 13:09:01.041946 32604 log.cc:824] T 00000000000000000000000000000000 P 50978e44838c4a548c061ee93e20460e: Log is configured to *not* fsync() on all Append() calls
I20260809 13:09:01.045024 32604 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50978e44838c4a548c061ee93e20460e: No bootstrap required, opened a new log
I20260809 13:09:01.042527 32332 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "920571f0fbbf45edabe98cf97ee8fcdc"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44364
I20260809 13:09:01.052863 32604 raft_consensus.cc:348] T 00000000000000000000000000000000 P 50978e44838c4a548c061ee93e20460e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "920571f0fbbf45edabe98cf97ee8fcdc" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44973 } } peers { permanent_uuid: "573fee041758446096796e5fa648eb35" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40843 } } peers { permanent_uuid: "50978e44838c4a548c061ee93e20460e" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } }
I20260809 13:09:01.053220 32604 raft_consensus.cc:729] T 00000000000000000000000000000000 P 50978e44838c4a548c061ee93e20460e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50978e44838c4a548c061ee93e20460e, State: Initialized, Role: FOLLOWER
I20260809 13:09:01.053838 32604 consensus_queue.cc:260] T 00000000000000000000000000000000 P 50978e44838c4a548c061ee93e20460e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "920571f0fbbf45edabe98cf97ee8fcdc" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44973 } } peers { permanent_uuid: "573fee041758446096796e5fa648eb35" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40843 } } peers { permanent_uuid: "50978e44838c4a548c061ee93e20460e" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } }
I20260809 13:09:01.054837 32614 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50978e44838c4a548c061ee93e20460e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "920571f0fbbf45edabe98cf97ee8fcdc" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44973 } } peers { permanent_uuid: "573fee041758446096796e5fa648eb35" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40843 } } peers { permanent_uuid: "50978e44838c4a548c061ee93e20460e" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } } }
I20260809 13:09:01.055219 32614 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50978e44838c4a548c061ee93e20460e [sys.catalog]: This master's current role is: FOLLOWER
I20260809 13:09:01.056209 32604 sys_catalog.cc:564] T 00000000000000000000000000000000 P 50978e44838c4a548c061ee93e20460e [sys.catalog]: configured and running, proceeding with master startup.
W20260809 13:09:01.066377 32631 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 50978e44838c4a548c061ee93e20460e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 13:09:01.066517 32631 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 13:09:01.064731 32505 master_runner.cc:186] Error getting master registration for 127.28.155.254:44973: OK, instance_id { permanent_uuid: "920571f0fbbf45edabe98cf97ee8fcdc" instance_seqno: 1786280939799322 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 13:09:01.075309 32505 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 13:09:01.104768 32495 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } attempt: 5
Aug 09 13:09:01 dist-test-slave-jq4t krb5kdc[32241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280940, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.253@KRBTEST.COM for kudu/127.28.155.252@KRBTEST.COM
I20260809 13:09:01.122782 32500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:01.105585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:40395 (local address 127.0.0.1:54400)
0809 13:09:01.105838 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:01.105860 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 13:09:01.106025 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:09:01.106445 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:09:01.106450 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:09:01.107040 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:09:01.107274 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:09:01.107287 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:09:01.108824 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:09:01.108830 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:09:01.110304 (+ 1474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:09:01.110322 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:09:01.111109 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:09:01.111116 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:09:01.111363 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:09:01.112060 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:09:01.112088 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:09:01.115071 (+ 2983us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:09:01.119557 (+ 4486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:09:01.119562 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:09:01.119567 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:09:01.120117 (+ 550us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:09:01.120578 (+ 461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:09:01.120583 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:09:01.120588 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:09:01.120812 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:09:01.121591 (+ 779us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:09:01.121597 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:09:01.121777 (+ 180us) client_negotiation.cc:769] Sending connection context
0809 13:09:01.121978 (+ 201us) client_negotiation.cc:240] Negotiation successful
0809 13:09:01.122321 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88}
I20260809 13:09:01.122792 32608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:01.105619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54400 (local address 127.28.155.252:40395)
0809 13:09:01.105860 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:01.105864 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:01.105931 (+ 67us) server_negotiation.cc:407] Connection header received
0809 13:09:01.106174 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:01.106179 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:01.106269 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:01.106391 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:09:01.107442 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:01.108676 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:01.110447 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:01.110952 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:01.111092 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:09:01.115303 (+ 4211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:09:01.115310 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:09:01.115315 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:09:01.115370 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:09:01.119368 (+ 3998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:09:01.120254 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:09:01.120260 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:09:01.120264 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:09:01.120427 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:09:01.120930 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:09:01.120938 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:09:01.120942 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:09:01.121431 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:09:01.121587 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 13:09:01.122118 (+ 531us) server_negotiation.cc:299] Negotiation successful
0809 13:09:01.122413 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 13:09:01.129611 32495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 573fee041758446096796e5fa648eb35: Bootstrap starting.
I20260809 13:09:01.133051 32495 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 573fee041758446096796e5fa648eb35: Neither blocks nor log segments found. Creating new log.
I20260809 13:09:01.134166 32495 log.cc:824] T 00000000000000000000000000000000 P 573fee041758446096796e5fa648eb35: Log is configured to *not* fsync() on all Append() calls
I20260809 13:09:01.137076 32495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 573fee041758446096796e5fa648eb35: No bootstrap required, opened a new log
I20260809 13:09:01.144299 32495 raft_consensus.cc:348] T 00000000000000000000000000000000 P 573fee041758446096796e5fa648eb35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "920571f0fbbf45edabe98cf97ee8fcdc" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44973 } } peers { permanent_uuid: "573fee041758446096796e5fa648eb35" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40843 } } peers { permanent_uuid: "50978e44838c4a548c061ee93e20460e" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } }
I20260809 13:09:01.144742 32495 raft_consensus.cc:729] T 00000000000000000000000000000000 P 573fee041758446096796e5fa648eb35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 573fee041758446096796e5fa648eb35, State: Initialized, Role: FOLLOWER
I20260809 13:09:01.145211 32495 consensus_queue.cc:260] T 00000000000000000000000000000000 P 573fee041758446096796e5fa648eb35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "920571f0fbbf45edabe98cf97ee8fcdc" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44973 } } peers { permanent_uuid: "573fee041758446096796e5fa648eb35" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40843 } } peers { permanent_uuid: "50978e44838c4a548c061ee93e20460e" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } }
I20260809 13:09:01.146210 32635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 573fee041758446096796e5fa648eb35 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "920571f0fbbf45edabe98cf97ee8fcdc" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44973 } } peers { permanent_uuid: "573fee041758446096796e5fa648eb35" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40843 } } peers { permanent_uuid: "50978e44838c4a548c061ee93e20460e" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } } }
I20260809 13:09:01.146638 32635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 573fee041758446096796e5fa648eb35 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 13:09:01.147410 32495 sys_catalog.cc:564] T 00000000000000000000000000000000 P 573fee041758446096796e5fa648eb35 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 13:09:01.167706 32656 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 573fee041758446096796e5fa648eb35: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 13:09:01.167970 32656 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 13:09:01.155220 32390 master_runner.cc:186] Error getting master registration for 127.28.155.254:44973: OK, instance_id { permanent_uuid: "920571f0fbbf45edabe98cf97ee8fcdc" instance_seqno: 1786280939799322 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 13:09:01.169204 32390 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 13:09:01.191828 32538 tablet.cc:2369] T 00000000000000000000000000000000 P 50978e44838c4a548c061ee93e20460e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:09:01.230263 32379 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } attempt: 5
Aug 09 13:09:01 dist-test-slave-jq4t krb5kdc[32241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786280939, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.155.254@KRBTEST.COM for kudu/127.28.155.252@KRBTEST.COM
I20260809 13:09:01.247475 32381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:01.231138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.155.252:40395 (local address 127.0.0.1:54410)
0809 13:09:01.231431 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0809 13:09:01.231451 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 13:09:01.231599 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 13:09:01.232023 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 13:09:01.232028 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 13:09:01.232651 (+ 623us) client_negotiation.cc:189] Negotiated authn=SASL
0809 13:09:01.232908 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:09:01.232926 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:09:01.234495 (+ 1569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:09:01.234501 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:09:01.236034 (+ 1533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 13:09:01.236049 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 13:09:01.236888 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 13:09:01.236894 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 13:09:01.237109 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:09:01.237811 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 13:09:01.237834 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 13:09:01.240422 (+ 2588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 13:09:01.244724 (+ 4302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:09:01.244729 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:09:01.244733 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:09:01.245116 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:09:01.245534 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 13:09:01.245538 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 13:09:01.245542 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 13:09:01.245690 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 13:09:01.246321 (+ 631us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 13:09:01.246326 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 13:09:01.246497 (+ 171us) client_negotiation.cc:769] Sending connection context
0809 13:09:01.246644 (+ 147us) client_negotiation.cc:240] Negotiation successful
0809 13:09:01.247040 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180}
I20260809 13:09:01.247462 32608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:01.231211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54410 (local address 127.28.155.252:40395)
0809 13:09:01.231420 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:01.231427 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:01.231520 (+ 93us) server_negotiation.cc:407] Connection header received
0809 13:09:01.231753 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:01.231759 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:01.231856 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:01.231980 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:09:01.233108 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:01.234360 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:01.236176 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:01.236706 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:01.236842 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:09:01.240642 (+ 3800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:09:01.240648 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:09:01.240655 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:09:01.240697 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:09:01.244594 (+ 3897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:09:01.245257 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:09:01.245262 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:09:01.245266 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:09:01.245426 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:09:01.245810 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:09:01.245817 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:09:01.245822 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:09:01.246212 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:09:01.246355 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 13:09:01.246768 (+ 413us) server_negotiation.cc:299] Negotiation successful
0809 13:09:01.247021 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 13:09:01.254352 32379 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 920571f0fbbf45edabe98cf97ee8fcdc: Bootstrap starting.
I20260809 13:09:01.258613 32379 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 920571f0fbbf45edabe98cf97ee8fcdc: Neither blocks nor log segments found. Creating new log.
I20260809 13:09:01.260038 32379 log.cc:824] T 00000000000000000000000000000000 P 920571f0fbbf45edabe98cf97ee8fcdc: Log is configured to *not* fsync() on all Append() calls
I20260809 13:09:01.263703 32379 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 920571f0fbbf45edabe98cf97ee8fcdc: No bootstrap required, opened a new log
I20260809 13:09:01.271566 32379 raft_consensus.cc:348] T 00000000000000000000000000000000 P 920571f0fbbf45edabe98cf97ee8fcdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "920571f0fbbf45edabe98cf97ee8fcdc" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44973 } } peers { permanent_uuid: "573fee041758446096796e5fa648eb35" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40843 } } peers { permanent_uuid: "50978e44838c4a548c061ee93e20460e" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } }
I20260809 13:09:01.271989 32379 raft_consensus.cc:729] T 00000000000000000000000000000000 P 920571f0fbbf45edabe98cf97ee8fcdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 920571f0fbbf45edabe98cf97ee8fcdc, State: Initialized, Role: FOLLOWER
I20260809 13:09:01.272565 32379 consensus_queue.cc:260] T 00000000000000000000000000000000 P 920571f0fbbf45edabe98cf97ee8fcdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "920571f0fbbf45edabe98cf97ee8fcdc" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44973 } } peers { permanent_uuid: "573fee041758446096796e5fa648eb35" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40843 } } peers { permanent_uuid: "50978e44838c4a548c061ee93e20460e" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } }
I20260809 13:09:01.273993 32659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 920571f0fbbf45edabe98cf97ee8fcdc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "920571f0fbbf45edabe98cf97ee8fcdc" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44973 } } peers { permanent_uuid: "573fee041758446096796e5fa648eb35" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40843 } } peers { permanent_uuid: "50978e44838c4a548c061ee93e20460e" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } } }
I20260809 13:09:01.274767 32659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 920571f0fbbf45edabe98cf97ee8fcdc [sys.catalog]: This master's current role is: FOLLOWER
I20260809 13:09:01.275346 32379 sys_catalog.cc:564] T 00000000000000000000000000000000 P 920571f0fbbf45edabe98cf97ee8fcdc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 13:09:01.275465 32332 raft_consensus.cc:482] T 00000000000000000000000000000000 P 920571f0fbbf45edabe98cf97ee8fcdc [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 13:09:01.275684 32332 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 920571f0fbbf45edabe98cf97ee8fcdc [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:09:01.279989 32332 raft_consensus.cc:504] T 00000000000000000000000000000000 P 920571f0fbbf45edabe98cf97ee8fcdc [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "920571f0fbbf45edabe98cf97ee8fcdc" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44973 } } peers { permanent_uuid: "573fee041758446096796e5fa648eb35" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40843 } } peers { permanent_uuid: "50978e44838c4a548c061ee93e20460e" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } }
I20260809 13:09:01.283054 32455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "920571f0fbbf45edabe98cf97ee8fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "573fee041758446096796e5fa648eb35"
I20260809 13:09:01.283725 32455 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 573fee041758446096796e5fa648eb35 [term 0 FOLLOWER]: Advancing to term 1
W20260809 13:09:01.287905 32300 tablet.cc:2369] T 00000000000000000000000000000000 P 920571f0fbbf45edabe98cf97ee8fcdc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:09:01.290179 32455 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 573fee041758446096796e5fa648eb35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 920571f0fbbf45edabe98cf97ee8fcdc in term 1.
I20260809 13:09:01.291256 32296 leader_election.cc:302] T 00000000000000000000000000000000 P 920571f0fbbf45edabe98cf97ee8fcdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 573fee041758446096796e5fa648eb35, 920571f0fbbf45edabe98cf97ee8fcdc; no voters:
I20260809 13:09:01.293313 32572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "920571f0fbbf45edabe98cf97ee8fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "50978e44838c4a548c061ee93e20460e"
I20260809 13:09:01.294013 32572 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 50978e44838c4a548c061ee93e20460e [term 0 FOLLOWER]: Advancing to term 1
I20260809 13:09:01.299185 32572 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 50978e44838c4a548c061ee93e20460e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 920571f0fbbf45edabe98cf97ee8fcdc in term 1.
I20260809 13:09:01.300153 32332 leader_election.cc:288] T 00000000000000000000000000000000 P 920571f0fbbf45edabe98cf97ee8fcdc [CANDIDATE]: Term 1 election: Requested vote from peers 573fee041758446096796e5fa648eb35 (127.28.155.253:40843), 50978e44838c4a548c061ee93e20460e (127.28.155.252:40395)
I20260809 13:09:01.307536 32659 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 920571f0fbbf45edabe98cf97ee8fcdc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 13:09:01.320808 32659 raft_consensus.cc:686] T 00000000000000000000000000000000 P 920571f0fbbf45edabe98cf97ee8fcdc [term 1 LEADER]: Becoming Leader. State: Replica: 920571f0fbbf45edabe98cf97ee8fcdc, State: Running, Role: LEADER
I20260809 13:09:01.321916 32659 consensus_queue.cc:237] T 00000000000000000000000000000000 P 920571f0fbbf45edabe98cf97ee8fcdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "920571f0fbbf45edabe98cf97ee8fcdc" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44973 } } peers { permanent_uuid: "573fee041758446096796e5fa648eb35" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40843 } } peers { permanent_uuid: "50978e44838c4a548c061ee93e20460e" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } }
I20260809 13:09:01.334409 32674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 920571f0fbbf45edabe98cf97ee8fcdc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 920571f0fbbf45edabe98cf97ee8fcdc. Latest consensus state: current_term: 1 leader_uuid: "920571f0fbbf45edabe98cf97ee8fcdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "920571f0fbbf45edabe98cf97ee8fcdc" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44973 } } peers { permanent_uuid: "573fee041758446096796e5fa648eb35" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40843 } } peers { permanent_uuid: "50978e44838c4a548c061ee93e20460e" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } } }
I20260809 13:09:01.334903 32674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 920571f0fbbf45edabe98cf97ee8fcdc [sys.catalog]: This master's current role is: LEADER
I20260809 13:09:01.350330 32690 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 13:09:01.353864 32686 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260809 13:09:01.356832 32421 tablet.cc:2369] T 00000000000000000000000000000000 P 573fee041758446096796e5fa648eb35: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 13:09:01.372423 32686 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 13:09:01.395435 32502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:01.352693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40858 (local address 127.28.155.253:40843)
0809 13:09:01.352943 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:01.352953 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:01.363616 (+ 10663us) server_negotiation.cc:407] Connection header received
0809 13:09:01.364327 (+ 711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:01.364336 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:01.364462 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:01.364577 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:09:01.367751 (+ 3174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:01.369292 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:01.371895 (+ 2603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:01.372841 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:01.372970 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:09:01.377932 (+ 4962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:09:01.377943 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:09:01.377950 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:09:01.378010 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:09:01.391482 (+ 13472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:09:01.392590 (+ 1108us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:09:01.392597 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:09:01.392601 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:09:01.392779 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:09:01.393361 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:09:01.393367 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:09:01.393370 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:09:01.393807 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:09:01.394049 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0809 13:09:01.394712 (+ 663us) server_negotiation.cc:299] Negotiation successful
0809 13:09:01.394981 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 13:09:01.401592 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:01.343248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44380 (local address 127.28.155.254:44973)
0809 13:09:01.343470 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:01.343477 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:01.359058 (+ 15581us) server_negotiation.cc:407] Connection header received
0809 13:09:01.359305 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:01.359312 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:01.359397 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:01.359496 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:09:01.364617 (+ 5121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:01.365810 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:01.389350 (+ 23540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:01.390126 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:01.390267 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:09:01.394529 (+ 4262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:09:01.394543 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:09:01.394549 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:09:01.394601 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:09:01.398400 (+ 3799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:09:01.399364 (+ 964us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:09:01.399370 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:09:01.399373 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:09:01.399522 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:09:01.399931 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:09:01.399936 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:09:01.399940 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:09:01.400243 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:09:01.400588 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0809 13:09:01.400804 (+ 216us) server_negotiation.cc:299] Negotiation successful
0809 13:09:01.401072 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 13:09:01.412833 32455 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 573fee041758446096796e5fa648eb35 [term 1 FOLLOWER]: Refusing update from remote peer 920571f0fbbf45edabe98cf97ee8fcdc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:09:01.414278 32572 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 50978e44838c4a548c061ee93e20460e [term 1 FOLLOWER]: Refusing update from remote peer 920571f0fbbf45edabe98cf97ee8fcdc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 13:09:01.415467 32674 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 920571f0fbbf45edabe98cf97ee8fcdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "50978e44838c4a548c061ee93e20460e" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:09:01.415827 32608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:01.363748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54418 (local address 127.28.155.252:40395)
0809 13:09:01.363976 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:01.363989 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:01.392752 (+ 28763us) server_negotiation.cc:407] Connection header received
0809 13:09:01.393078 (+ 326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:01.393084 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:01.393177 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:01.393259 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:09:01.400645 (+ 7386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:01.401733 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:01.403579 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:01.404205 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:01.404346 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:09:01.407634 (+ 3288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 13:09:01.407641 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 13:09:01.407646 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 13:09:01.407687 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 13:09:01.411761 (+ 4074us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:09:01.412674 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:09:01.412683 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:09:01.412686 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:09:01.412878 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 13:09:01.413516 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 13:09:01.413524 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 13:09:01.413527 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 13:09:01.413928 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 13:09:01.414225 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0809 13:09:01.415057 (+ 832us) server_negotiation.cc:299] Negotiation successful
0809 13:09:01.415352 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 13:09:01.415830 32659 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 920571f0fbbf45edabe98cf97ee8fcdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "573fee041758446096796e5fa648eb35" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 13:09:01.435623 32614 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50978e44838c4a548c061ee93e20460e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 920571f0fbbf45edabe98cf97ee8fcdc. Latest consensus state: current_term: 1 leader_uuid: "920571f0fbbf45edabe98cf97ee8fcdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "920571f0fbbf45edabe98cf97ee8fcdc" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44973 } } peers { permanent_uuid: "573fee041758446096796e5fa648eb35" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40843 } } peers { permanent_uuid: "50978e44838c4a548c061ee93e20460e" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } } }
I20260809 13:09:01.435967 32614 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50978e44838c4a548c061ee93e20460e [sys.catalog]: This master's current role is: FOLLOWER
I20260809 13:09:01.438632 32694 mvcc.cc:205] Tried to move back new op lower bound from 7316606735987245056 to 7316606735677489152. Current Snapshot: MvccSnapshot[applied={T|T < 7316606735987245056}]
I20260809 13:09:01.445922 32659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 920571f0fbbf45edabe98cf97ee8fcdc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "920571f0fbbf45edabe98cf97ee8fcdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "920571f0fbbf45edabe98cf97ee8fcdc" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44973 } } peers { permanent_uuid: "573fee041758446096796e5fa648eb35" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40843 } } peers { permanent_uuid: "50978e44838c4a548c061ee93e20460e" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } } }
I20260809 13:09:01.446259 32659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 920571f0fbbf45edabe98cf97ee8fcdc [sys.catalog]: This master's current role is: LEADER
I20260809 13:09:01.446910 32614 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50978e44838c4a548c061ee93e20460e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "920571f0fbbf45edabe98cf97ee8fcdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "920571f0fbbf45edabe98cf97ee8fcdc" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44973 } } peers { permanent_uuid: "573fee041758446096796e5fa648eb35" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40843 } } peers { permanent_uuid: "50978e44838c4a548c061ee93e20460e" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } } }
I20260809 13:09:01.447274 32614 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50978e44838c4a548c061ee93e20460e [sys.catalog]: This master's current role is: FOLLOWER
I20260809 13:09:01.450873 32686 catalog_manager.cc:1347] Generated new cluster ID: 43361ce138a14b358361251d79e6657f
I20260809 13:09:01.450999 32686 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 13:09:01.454607 32635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 573fee041758446096796e5fa648eb35 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 920571f0fbbf45edabe98cf97ee8fcdc. Latest consensus state: current_term: 1 leader_uuid: "920571f0fbbf45edabe98cf97ee8fcdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "920571f0fbbf45edabe98cf97ee8fcdc" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44973 } } peers { permanent_uuid: "573fee041758446096796e5fa648eb35" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40843 } } peers { permanent_uuid: "50978e44838c4a548c061ee93e20460e" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } } }
I20260809 13:09:01.454900 32635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 573fee041758446096796e5fa648eb35 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 13:09:01.465507 32698 mvcc.cc:205] Tried to move back new op lower bound from 7316606735987245056 to 7316606735677489152. Current Snapshot: MvccSnapshot[applied={T|T < 7316606735987245056}]
I20260809 13:09:01.466682 32674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 920571f0fbbf45edabe98cf97ee8fcdc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "920571f0fbbf45edabe98cf97ee8fcdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "920571f0fbbf45edabe98cf97ee8fcdc" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44973 } } peers { permanent_uuid: "573fee041758446096796e5fa648eb35" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40843 } } peers { permanent_uuid: "50978e44838c4a548c061ee93e20460e" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } } }
I20260809 13:09:01.468369 32674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 920571f0fbbf45edabe98cf97ee8fcdc [sys.catalog]: This master's current role is: LEADER
I20260809 13:09:01.478570 32635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 573fee041758446096796e5fa648eb35 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "920571f0fbbf45edabe98cf97ee8fcdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "920571f0fbbf45edabe98cf97ee8fcdc" member_type: VOTER last_known_addr { host: "127.28.155.254" port: 44973 } } peers { permanent_uuid: "573fee041758446096796e5fa648eb35" member_type: VOTER last_known_addr { host: "127.28.155.253" port: 40843 } } peers { permanent_uuid: "50978e44838c4a548c061ee93e20460e" member_type: VOTER last_known_addr { host: "127.28.155.252" port: 40395 } } }
I20260809 13:09:01.478883 32635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 573fee041758446096796e5fa648eb35 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 13:09:01.511781 32686 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 13:09:01.513895 32686 catalog_manager.cc:1504] Loading token signing keys...
I20260809 13:09:01.547922 32686 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 920571f0fbbf45edabe98cf97ee8fcdc: Generated new TSK 0
I20260809 13:09:01.549242 32686 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 13:09:01.704689 32502 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:09:01.695258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40870 (local address 127.28.155.253:40843)
0809 13:09:01.695500 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:01.695507 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:01.702497 (+ 6990us) server_negotiation.cc:407] Connection header received
0809 13:09:01.702968 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:01.702977 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:01.703083 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:01.703167 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:09:01.704391 (+ 1224us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40870: BlockingRecv error: recv got EOF from 127.0.0.1:40870 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260809 13:09:01.706647 32609 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:09:01.686565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44394 (local address 127.28.155.254:44973)
0809 13:09:01.686802 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:01.686809 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:01.700664 (+ 13855us) server_negotiation.cc:407] Connection header received
0809 13:09:01.705108 (+ 4444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:01.705114 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:01.705211 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:01.705286 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:09:01.706401 (+ 1115us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44394: BlockingRecv error: recv got EOF from 127.0.0.1:44394 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260809 13:09:01.709235 32608 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:09:01.701806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54432 (local address 127.28.155.252:40395)
0809 13:09:01.701990 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:01.701996 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:01.707264 (+ 5268us) server_negotiation.cc:407] Connection header received
0809 13:09:01.707851 (+ 587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:01.707857 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:01.707941 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:01.708015 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:09:01.708981 (+ 966us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54432: BlockingRecv error: recv got EOF from 127.0.0.1:54432 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260809 13:09:01.750238 32502 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:09:01.743577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40876 (local address 127.28.155.253:40843)
0809 13:09:01.743773 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:01.743780 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:01.748241 (+ 4461us) server_negotiation.cc:407] Connection header received
0809 13:09:01.748656 (+ 415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:01.748663 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:01.748805 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:01.748928 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:09:01.749897 (+ 969us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40876: BlockingRecv error: recv got EOF from 127.0.0.1:40876 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260809 13:09:01.758759 32502 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:09:01.754770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40878 (local address 127.28.155.253:40843)
0809 13:09:01.754976 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:01.754983 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:01.757042 (+ 2059us) server_negotiation.cc:407] Connection header received
0809 13:09:01.757269 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:01.757276 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:01.757377 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:01.757511 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:09:01.758498 (+ 987us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40878: BlockingRecv error: recv got EOF from 127.0.0.1:40878 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260809 13:09:01.766474 32502 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:09:01.763971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40884 (local address 127.28.155.253:40843)
0809 13:09:01.764162 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:01.764168 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:01.764800 (+ 632us) server_negotiation.cc:407] Connection header received
0809 13:09:01.764993 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:01.764998 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:01.765114 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:01.765230 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:09:01.766199 (+ 969us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40884: BlockingRecv error: recv got EOF from 127.0.0.1:40884 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260809 13:09:01.778681 32502 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:09:01.775048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40888 (local address 127.28.155.253:40843)
0809 13:09:01.775269 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:01.775277 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:01.777078 (+ 1801us) server_negotiation.cc:407] Connection header received
0809 13:09:01.777306 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:01.777311 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:01.777408 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:01.777512 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:09:01.778385 (+ 873us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40888: BlockingRecv error: recv got EOF from 127.0.0.1:40888 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
W20260809 13:09:01.794270 32502 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:09:01.792025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40892 (local address 127.28.155.253:40843)
0809 13:09:01.792277 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:01.792284 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:01.792681 (+ 397us) server_negotiation.cc:407] Connection header received
0809 13:09:01.792895 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:01.792899 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:01.792979 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:01.793066 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:09:01.794018 (+ 952us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40892: BlockingRecv error: recv got EOF from 127.0.0.1:40892 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260809 13:09:01.816975 32502 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:09:01.814475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40896 (local address 127.28.155.253:40843)
0809 13:09:01.814676 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:01.814683 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:01.815262 (+ 579us) server_negotiation.cc:407] Connection header received
0809 13:09:01.815513 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:01.815520 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:01.815650 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:01.815770 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:09:01.816714 (+ 944us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40896: BlockingRecv error: recv got EOF from 127.0.0.1:40896 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260809 13:09:01.855351 32502 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:09:01.853000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40900 (local address 127.28.155.253:40843)
0809 13:09:01.853265 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:01.853271 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:01.853672 (+ 401us) server_negotiation.cc:407] Connection header received
0809 13:09:01.853898 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:01.853902 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:01.853981 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:01.854079 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:09:01.855071 (+ 992us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40900: BlockingRecv error: recv got EOF from 127.0.0.1:40900 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
W20260809 13:09:01.925819 32502 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:09:01.923589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40908 (local address 127.28.155.253:40843)
0809 13:09:01.923839 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:01.923847 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:01.924267 (+ 420us) server_negotiation.cc:407] Connection header received
0809 13:09:01.924493 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:01.924500 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:01.924603 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:01.924724 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:09:01.925553 (+ 829us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40908: BlockingRecv error: recv got EOF from 127.0.0.1:40908 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260809 13:09:02.060705 32502 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 13:09:02.058346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40918 (local address 127.28.155.253:40843)
0809 13:09:02.058621 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:02.058631 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:02.058987 (+ 356us) server_negotiation.cc:407] Connection header received
0809 13:09:02.059253 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:02.059257 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:02.059395 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:02.059540 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0809 13:09:02.060384 (+ 844us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40918: BlockingRecv error: recv got EOF from 127.0.0.1:40918 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 13:09:02.068768 32631 catalog_manager.cc:1259] Loaded cluster ID: 43361ce138a14b358361251d79e6657f
I20260809 13:09:02.068881 32631 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 50978e44838c4a548c061ee93e20460e: loading cluster ID for follower catalog manager: success
I20260809 13:09:02.071508 32631 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 50978e44838c4a548c061ee93e20460e: acquiring CA information for follower catalog manager: success
I20260809 13:09:02.073403 32631 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 50978e44838c4a548c061ee93e20460e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 13:09:02.170327 32656 catalog_manager.cc:1259] Loaded cluster ID: 43361ce138a14b358361251d79e6657f
I20260809 13:09:02.170442 32656 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 573fee041758446096796e5fa648eb35: loading cluster ID for follower catalog manager: success
I20260809 13:09:02.173146 32656 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 573fee041758446096796e5fa648eb35: acquiring CA information for follower catalog manager: success
I20260809 13:09:02.175009 32656 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 573fee041758446096796e5fa648eb35: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 13:09:02.328186 32502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:02.322438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40920 (local address 127.28.155.253:40843)
0809 13:09:02.322674 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:02.322679 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:02.323022 (+ 343us) server_negotiation.cc:407] Connection header received
0809 13:09:02.323248 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:02.323252 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:02.323424 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:02.323545 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:09:02.324041 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:02.324819 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:02.326109 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:02.326522 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:02.326616 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:09:02.327085 (+ 469us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:09:02.327656 (+ 571us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:09:02.327770 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 13:09:02.327873 (+ 103us) server_negotiation.cc:299] Negotiation successful
0809 13:09:02.327942 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 13:09:02.340459 342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:02.334764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54448 (local address 127.28.155.252:40395)
0809 13:09:02.335239 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:02.335244 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:02.335338 (+ 94us) server_negotiation.cc:407] Connection header received
0809 13:09:02.335531 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:02.335535 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:02.335710 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:02.335857 (+ 147us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:09:02.336220 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:02.337027 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:02.338359 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:02.338741 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:02.338835 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:09:02.339367 (+ 532us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:09:02.339901 (+ 534us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:09:02.340014 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 13:09:02.340123 (+ 109us) server_negotiation.cc:299] Negotiation successful
0809 13:09:02.340193 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":265,"threads_started":1}
I20260809 13:09:02.355098 357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:02.346513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44404 (local address 127.28.155.254:44973)
0809 13:09:02.347230 (+ 717us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:02.347239 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:02.347578 (+ 339us) server_negotiation.cc:407] Connection header received
0809 13:09:02.347941 (+ 363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:02.347947 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:02.348205 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:02.348392 (+ 187us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:09:02.349648 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:02.350715 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:02.352357 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:02.352865 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:02.353006 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:09:02.353595 (+ 589us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:09:02.354114 (+ 519us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:09:02.354263 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 13:09:02.354677 (+ 414us) server_negotiation.cc:299] Negotiation successful
0809 13:09:02.354783 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":553,"thread_start_us":402,"threads_started":1}
I20260809 13:09:02.355212 32502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:02.346558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40926 (local address 127.28.155.253:40843)
0809 13:09:02.346779 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:02.346788 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:02.347877 (+ 1089us) server_negotiation.cc:407] Connection header received
0809 13:09:02.348223 (+ 346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:02.348231 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:02.348356 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:02.348436 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:09:02.349714 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:02.350936 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:02.353212 (+ 2276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:02.353756 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:02.353903 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:09:02.354411 (+ 508us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:09:02.354548 (+ 137us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:09:02.354642 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 13:09:02.354836 (+ 194us) server_negotiation.cc:299] Negotiation successful
0809 13:09:02.354920 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 13:09:02.356045 342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 13:09:02.348340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54462 (local address 127.28.155.252:40395)
0809 13:09:02.348730 (+ 390us) server_negotiation.cc:206] Beginning negotiation
0809 13:09:02.348737 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 13:09:02.349765 (+ 1028us) server_negotiation.cc:407] Connection header received
0809 13:09:02.350038 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 13:09:02.350051 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 13:09:02.350137 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 13:09:02.350231 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 13:09:02.350813 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:02.351986 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:02.354106 (+ 2120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 13:09:02.354682 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 13:09:02.354832 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 13:09:02.355271 (+ 439us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 13:09:02.355398 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 13:09:02.355496 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 13:09:02.355710 (+ 214us) server_negotiation.cc:299] Negotiation successful
0809 13:09:02.355805 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 13:09:02.360653 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 32266
I20260809 13:09:02.361840 32373 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:09:02.476943 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 32266
I20260809 13:09:02.506803 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 32390
I20260809 13:09:02.508159 32483 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:09:02.625089 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 32390
I20260809 13:09:02.652951 29295 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu pid 32505
I20260809 13:09:02.654276 32598 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 13:09:02.766947 29295 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqeHpK4/build/asan/bin/kudu with pid 32505
2026-08-09T13:09:02Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (5157 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (10395 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (394118 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST